__   __
  /  \ /  \     ______   _    _     __   __   __
 / /\ / /\ \   /  __  \ | |  | |   /  \  \ \ / /
/ /  / /  \ \  | |  | | | |  | |  / /\ \  \   /
\ \  \ \  / /  | |__| | | |__| | / ____ \  | |
 \ \/ \ \/ /   \_  ___/  \____/ /_/    \_\ |_|
  \__/ \__/      \ \__
                  \___\ by Red Hat
 Build, Store, and Distribute your Containers

Startup timestamp: 
Mon Apr 22 03:33:14 UTC 2024

Running all default registry services without migration
Running init script '/quay-registry/conf/init/certs_install.sh'
Installing extra certificates found in /quay-registry/conf/stack/extra_ca_certs directory
Running init script '/quay-registry/conf/init/client_certs.sh'
Running init script '/quay-registry/conf/init/copy_config_files.sh'
Running init script '/quay-registry/conf/init/d_validate_config_bundle.sh'
Validating Configuration
time="2024-04-22T03:33:15Z" level=debug msg="Validating AccessSettings"
time="2024-04-22T03:33:15Z" level=debug msg="Validating ActionLogArchiving"
time="2024-04-22T03:33:15Z" level=debug msg="Validating AppTokenAuthentication"
time="2024-04-22T03:33:15Z" level=debug msg="Validating BitbucketBuildTrigger"
time="2024-04-22T03:33:15Z" level=debug msg="Validating BuildManager"
time="2024-04-22T03:33:15Z" level=debug msg="Validating Database"
time="2024-04-22T03:33:15Z" level=debug msg="Scheme: postgresql"
time="2024-04-22T03:33:15Z" level=debug msg="Host: quayregistry-quay-database:5432"
time="2024-04-22T03:33:15Z" level=debug msg="Db: quayregistry-quay-database"
time="2024-04-22T03:33:15Z" level=debug msg="Params: "
time="2024-04-22T03:33:15Z" level=debug msg="Including params "
time="2024-04-22T03:33:15Z" level=debug msg="Pinging database at postgresql://quayregistry-quay-database:LR26GYE2Q6C1alDmIITINfDYIVNBINfu7Ep3m38KlTCvZwaP6XwkLo53vn3GRqC-4WmofCbZLtxhHtn8@quayregistry-quay-database:5432/quayregistry-quay-database"
plpgsql
pg_trgm
time="2024-04-22T03:33:15Z" level=debug msg="Validating DistributedStorage"
time="2024-04-22T03:33:15Z" level=debug msg="Validating ElasticSearch"
time="2024-04-22T03:33:15Z" level=debug msg="Validating Email"
time="2024-04-22T03:33:16Z" level=debug msg="Validating GitHubBuildTrigger"
time="2024-04-22T03:33:16Z" level=debug msg="Validating GitHubLogin"
time="2024-04-22T03:33:16Z" level=debug msg="Validating GitLabBuildTrigger"
time="2024-04-22T03:33:16Z" level=debug msg="Validating GoogleLogin"
time="2024-04-22T03:33:16Z" level=debug msg="Validating HostSettings"
time="2024-04-22T03:33:16Z" level=debug msg="Validating JWTAuthentication"
time="2024-04-22T03:33:16Z" level=debug msg="Validating LDAP"
time="2024-04-22T03:33:16Z" level=debug msg="Validating OIDC"
time="2024-04-22T03:33:16Z" level=debug msg="Validating QuayDocumentation"
time="2024-04-22T03:33:16Z" level=debug msg="Validating Redis"
time="2024-04-22T03:33:16Z" level=debug msg="Address: quayregistry-quay-redis:6379"
time="2024-04-22T03:33:16Z" level=debug msg="Username: "
time="2024-04-22T03:33:16Z" level=debug msg="Password Len: 0"
time="2024-04-22T03:33:16Z" level=debug msg="Ssl: <nil>"
time="2024-04-22T03:33:16Z" level=debug msg="Address: quayregistry-quay-redis:6379"
time="2024-04-22T03:33:16Z" level=debug msg="Username: "
time="2024-04-22T03:33:16Z" level=debug msg="Password Len: 0"
time="2024-04-22T03:33:16Z" level=debug msg="Ssl: <nil>"
time="2024-04-22T03:33:16Z" level=debug msg="Validating RepoMirror"
time="2024-04-22T03:33:16Z" level=debug msg="Validating SecurityScanner"
time="2024-04-22T03:33:16Z" level=debug msg="Validating TeamSyncing"
time="2024-04-22T03:33:16Z" level=debug msg="Validating TimeMachine"
time="2024-04-22T03:33:16Z" level=debug msg="Validating UserVisibleSettings"
+------------------------+-------+--------+
|      Field Group       | Error | Status |
+------------------------+-------+--------+
| AccessSettings         | -     | 🟢     |
+------------------------+-------+--------+
| ActionLogArchiving     | -     | 🟢     |
+------------------------+-------+--------+
| AppTokenAuthentication | -     | 🟢     |
+------------------------+-------+--------+
| BitbucketBuildTrigger  | -     | 🟢     |
+------------------------+-------+--------+
| BuildManager           | -     | 🟢     |
+------------------------+-------+--------+
| Database               | -     | 🟢     |
+------------------------+-------+--------+
| DistributedStorage     | -     | 🟢     |
+------------------------+-------+--------+
| ElasticSearch          | -     | 🟢     |
+------------------------+-------+--------+
| Email                  | -     | 🟢     |
+------------------------+-------+--------+
| GitHubBuildTrigger     | -     | 🟢     |
+------------------------+-------+--------+
| GitHubLogin            | -     | 🟢     |
+------------------------+-------+--------+
| GitLabBuildTrigger     | -     | 🟢     |
+------------------------+-------+--------+
| GoogleLogin            | -     | 🟢     |
+------------------------+-------+--------+
| HostSettings           | -     | 🟢     |
+------------------------+-------+--------+
| JWTAuthentication      | -     | 🟢     |
+------------------------+-------+--------+
| LDAP                   | -     | 🟢     |
+------------------------+-------+--------+
| OIDC                   | -     | 🟢     |
+------------------------+-------+--------+
| QuayDocumentation      | -     | 🟢     |
+------------------------+-------+--------+
| Redis                  | -     | 🟢     |
+------------------------+-------+--------+
| RepoMirror             | -     | 🟢     |
+------------------------+-------+--------+
| SecurityScanner        | -     | 🟢     |
+------------------------+-------+--------+
| TeamSyncing            | -     | 🟢     |
+------------------------+-------+--------+
| TimeMachine            | -     | 🟢     |
+------------------------+-------+--------+
| UserVisibleSettings    | -     | 🟢     |
+------------------------+-------+--------+
Running init script '/quay-registry/conf/init/nginx_conf_create.sh'
Running init script '/quay-registry/conf/init/supervisord_conf_create.sh'
Running init script '/quay-registry/conf/init/zz_boot.sh'
/app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
  if word_sep is not '':
2024-04-22 03:33:19,861 INFO RPC interface 'supervisor' initialized
2024-04-22 03:33:19,861 CRIT Server 'unix_http_server' running without any HTTP authentication checking
2024-04-22 03:33:19,861 INFO supervisord started with pid 7
2024-04-22 03:33:20,863 INFO spawned: 'stdout' with pid 59
2024-04-22 03:33:20,865 INFO spawned: 'autopruneworker' with pid 60
2024-04-22 03:33:20,866 INFO spawned: 'blobuploadcleanupworker' with pid 61
2024-04-22 03:33:20,868 INFO spawned: 'builder' with pid 62
2024-04-22 03:33:20,870 INFO spawned: 'buildlogsarchiver' with pid 63
2024-04-22 03:33:20,871 INFO spawned: 'chunkcleanupworker' with pid 64
2024-04-22 03:33:20,873 INFO spawned: 'dnsmasq' with pid 65
2024-04-22 03:33:20,874 INFO spawned: 'expiredappspecifictokenworker' with pid 66
2024-04-22 03:33:20,877 INFO spawned: 'exportactionlogsworker' with pid 67
2024-04-22 03:33:20,879 INFO spawned: 'gcworker' with pid 68
2024-04-22 03:33:20,881 INFO spawned: 'globalpromstats' with pid 69
2024-04-22 03:33:20,883 INFO spawned: 'gunicorn-registry' with pid 70
2024-04-22 03:33:20,885 INFO spawned: 'gunicorn-secscan' with pid 71
2024-04-22 03:33:20,951 INFO spawned: 'gunicorn-web' with pid 72
2024-04-22 03:33:20,953 INFO spawned: 'logrotateworker' with pid 73
2024-04-22 03:33:20,955 INFO spawned: 'manifestbackfillworker' with pid 74
2024-04-22 03:33:20,957 INFO spawned: 'memcache' with pid 75
2024-04-22 03:33:20,960 INFO spawned: 'namespacegcworker' with pid 76
2024-04-22 03:33:20,962 INFO spawned: 'nginx' with pid 77
2024-04-22 03:33:20,964 INFO spawned: 'notificationworker' with pid 78
2024-04-22 03:33:20,967 INFO spawned: 'pushgateway' with pid 79
2024-04-22 03:33:20,968 INFO spawned: 'queuecleanupworker' with pid 80
2024-04-22 03:33:21,051 INFO spawned: 'quotaregistrysizeworker' with pid 81
2024-04-22 03:33:21,053 INFO spawned: 'quotatotalworker' with pid 83
2024-04-22 03:33:21,055 INFO spawned: 'reconciliationworker' with pid 88
2024-04-22 03:33:21,058 INFO spawned: 'repositoryactioncounter' with pid 89
2024-04-22 03:33:21,060 INFO spawned: 'repositorygcworker' with pid 90
2024-04-22 03:33:21,062 INFO spawned: 'securityscanningnotificationworker' with pid 91
2024-04-22 03:33:21,152 INFO spawned: 'securityworker' with pid 92
2024-04-22 03:33:21,154 INFO spawned: 'servicekey' with pid 93
2024-04-22 03:33:21,156 INFO spawned: 'storagereplication' with pid 94
2024-04-22 03:33:21,159 INFO spawned: 'teamsyncworker' with pid 98
2024-04-22 03:33:22,652 INFO success: stdout entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,653 INFO success: autopruneworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,653 INFO success: blobuploadcleanupworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,653 INFO success: builder entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,653 INFO success: buildlogsarchiver entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,653 INFO success: chunkcleanupworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,653 INFO success: dnsmasq entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,653 INFO success: expiredappspecifictokenworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,653 INFO success: exportactionlogsworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,653 INFO success: gcworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,653 INFO success: globalpromstats entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,653 INFO success: gunicorn-registry entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,653 INFO success: gunicorn-secscan entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,653 INFO success: gunicorn-web entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,653 INFO success: logrotateworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,653 INFO success: manifestbackfillworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,654 INFO success: memcache entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,654 INFO success: namespacegcworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,654 INFO success: nginx entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,654 INFO success: notificationworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,654 INFO success: pushgateway entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,654 INFO success: queuecleanupworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,654 INFO success: quotaregistrysizeworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,654 INFO success: quotatotalworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,654 INFO success: reconciliationworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,654 INFO success: repositoryactioncounter entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,654 INFO success: repositorygcworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,654 INFO success: securityscanningnotificationworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,654 INFO success: securityworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,654 INFO success: servicekey entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,654 INFO success: storagereplication entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2024-04-22 03:33:22,654 INFO success: teamsyncworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
dnsmasq stderr | dnsmasq: started, version 2.79 cachesize 150
dnsmasq stderr | dnsmasq: compile time options: IPv6 GNU-getopt DBus no-i18n IDN2 DHCP DHCPv6 no-Lua TFTP no-conntrack ipset auth DNSSEC loop-detect inotify
dnsmasq stderr | dnsmasq: reading /etc/resolv.conf
dnsmasq stderr | dnsmasq: using nameserver 172.30.0.10#53
dnsmasq stderr | dnsmasq: read /etc/hosts - 7 addresses
nginx stdout | 2024/04/22 03:33:21 [alert] 103#0: setpriority(-10) failed (13: Permission denied)
nginx stdout | 2024/04/22 03:33:21 [alert] 106#0: setpriority(-10) failed (13: Permission denied)
nginx stdout | 2024/04/22 03:33:21 [alert] 107#0: setpriority(-10) failed (13: Permission denied)
nginx stdout | 2024/04/22 03:33:21 [alert] 109#0: setpriority(-10) failed (13: Permission denied)
nginx stdout | 2024/04/22 03:33:21 [alert] 115#0: setpriority(-10) failed (13: Permission denied)
nginx stdout | 2024/04/22 03:33:21 [alert] 100#0: setpriority(-10) failed (13: Permission denied)
nginx stdout | 2024/04/22 03:33:21 [alert] 112#0: setpriority(-10) failed (13: Permission denied)
nginx stdout | 2024/04/22 03:33:21 [alert] 111#0: setpriority(-10) failed (13: Permission denied)
nginx stdout | 2024/04/22 03:33:21 [alert] 108#0: setpriority(-10) failed (13: Permission denied)
nginx stdout | 2024/04/22 03:33:21 [alert] 114#0: setpriority(-10) failed (13: Permission denied)
nginx stdout | 2024/04/22 03:33:21 [alert] 101#0: setpriority(-10) failed (13: Permission denied)
nginx stdout | 2024/04/22 03:33:21 [alert] 102#0: setpriority(-10) failed (13: Permission denied)
nginx stdout | 2024/04/22 03:33:21 [alert] 99#0: setpriority(-10) failed (13: Permission denied)
nginx stdout | 2024/04/22 03:33:21 [alert] 116#0: setpriority(-10) failed (13: Permission denied)
nginx stdout | 2024/04/22 03:33:21 [alert] 110#0: setpriority(-10) failed (13: Permission denied)
nginx stdout | 2024/04/22 03:33:21 [alert] 113#0: setpriority(-10) failed (13: Permission denied)
pushgateway stderr | ts=2024-04-22T03:33:21.359Z caller=main.go:86 level=info msg="starting pushgateway" version="(version=, branch=, revision=unknown)"
pushgateway stderr | ts=2024-04-22T03:33:21.360Z caller=main.go:87 level=info build_context="(go=go1.19.13, platform=linux/amd64, user=, date=, tags=unknown)"
pushgateway stderr | ts=2024-04-22T03:33:21.651Z caller=tls_config.go:274 level=info msg="Listening on" address=[::]:9091
pushgateway stderr | ts=2024-04-22T03:33:21.651Z caller=tls_config.go:277 level=info msg="TLS is disabled." http2=false address=[::]:9091
nginx stdout | 2024/04/22 03:33:30 [crit] 103#0: *1 connect() to unix:/tmp/gunicorn_web.sock failed (2: No such file or directory) while connecting to upstream, client: 10.131.0.2, server: , request: "GET /health/instance HTTP/1.1", upstream: "http://unix:/tmp/gunicorn_web.sock:/health/instance", host: "10.131.0.31:8080"
nginx stdout | 2024/04/22 03:33:30 [crit] 103#0: *1 connect() to unix:/tmp/gunicorn_web.sock failed (2: No such file or directory) while connecting to upstream, client: 10.131.0.2, server: , request: "GET /health/instance HTTP/1.1", upstream: "http://unix:/tmp/gunicorn_web.sock:/quay-registry/static/502.html", host: "10.131.0.31:8080"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:33:30 +0000] "GET /health/instance HTTP/1.1" 502 157 "-" "kube-probe/1.28" (0.000 118 0.000 : 0.000)
expiredappspecifictokenworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
expiredappspecifictokenworker stderr |   if word_sep is not '':
securityscanningnotificationworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
securityscanningnotificationworker stderr |   if word_sep is not '':
nginx stdout | 2024/04/22 03:33:45 [crit] 106#0: *4 connect() to unix:/tmp/gunicorn_web.sock failed (2: No such file or directory) while connecting to upstream, client: 10.131.0.2, server: , request: "GET /health/instance HTTP/1.1", upstream: "http://unix:/tmp/gunicorn_web.sock:/health/instance", host: "10.131.0.31:8080"
nginx stdout | 2024/04/22 03:33:45 [crit] 106#0: *4 connect() to unix:/tmp/gunicorn_web.sock failed (2: No such file or directory) while connecting to upstream, client: 10.131.0.2, server: , request: "GET /health/instance HTTP/1.1", upstream: "http://unix:/tmp/gunicorn_web.sock:/quay-registry/static/502.html", host: "10.131.0.31:8080"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:33:45 +0000] "GET /health/instance HTTP/1.1" 502 157 "-" "kube-probe/1.28" (0.000 118 0.000 : 0.000)
repositorygcworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
repositorygcworker stderr |   if word_sep is not '':
quotatotalworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
quotatotalworker stderr |   if word_sep is not '':
chunkcleanupworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
chunkcleanupworker stderr |   if word_sep is not '':
builder stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
builder stderr |   if word_sep is not '':
repositoryactioncounter stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
repositoryactioncounter stderr |   if word_sep is not '':
quotaregistrysizeworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
quotaregistrysizeworker stderr |   if word_sep is not '':
gunicorn-web stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
gunicorn-web stderr |   if word_sep is not '':
teamsyncworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
teamsyncworker stderr |   if word_sep is not '':
expiredappspecifictokenworker stdout | 2024-04-22 03:33:53,553 [66] [DEBUG] [__main__] Starting expired app specific token GC worker
expiredappspecifictokenworker stdout | 2024-04-22 03:33:53,554 [66] [DEBUG] [__main__] Found expiration window: 1d
expiredappspecifictokenworker stdout | 2024-04-22 03:33:53,557 [66] [DEBUG] [workers.worker] Scheduling worker.
expiredappspecifictokenworker stdout | 2024-04-22 03:33:53,559 [66] [INFO] [apscheduler.scheduler] Scheduler started
expiredappspecifictokenworker stdout | 2024-04-22 03:33:53,755 [66] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
expiredappspecifictokenworker stdout | 2024-04-22 03:33:53,757 [66] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
expiredappspecifictokenworker stdout | 2024-04-22 03:33:53,761 [66] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:57:16.762836
expiredappspecifictokenworker stdout | 2024-04-22 03:33:53,856 [66] [INFO] [apscheduler.scheduler] Added job "ExpiredAppSpecificTokenWorker._gc_expired_tokens" to job store "default"
expiredappspecifictokenworker stdout | 2024-04-22 03:33:53,856 [66] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
expiredappspecifictokenworker stdout | 2024-04-22 03:33:53,856 [66] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:16.762836+00:00 (in 1402.906307 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:33:54,354 [91] [DEBUG] [__main__] Starting security scanning notification worker
securityscanningnotificationworker stdout | 2024-04-22 03:33:54,357 [91] [DEBUG] [workers.worker] Scheduling worker.
securityscanningnotificationworker stdout | 2024-04-22 03:33:54,358 [91] [INFO] [apscheduler.scheduler] Scheduler started
securityscanningnotificationworker stdout | 2024-04-22 03:33:54,551 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:33:54,551 [91] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:34:16.552337
securityscanningnotificationworker stdout | 2024-04-22 03:33:54,552 [91] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
securityscanningnotificationworker stdout | 2024-04-22 03:33:54,554 [91] [INFO] [apscheduler.scheduler] Added job "QueueWorker.poll_queue" to job store "default"
securityscanningnotificationworker stdout | 2024-04-22 03:33:54,554 [91] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:37:21.555879
securityscanningnotificationworker stdout | 2024-04-22 03:33:54,555 [91] [INFO] [apscheduler.scheduler] Added job "QueueWorker.update_queue_metrics" to job store "default"
securityscanningnotificationworker stdout | 2024-04-22 03:33:54,555 [91] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:34:02.556208
securityscanningnotificationworker stdout | 2024-04-22 03:33:54,555 [91] [INFO] [apscheduler.scheduler] Added job "QueueWorker.run_watchdog" to job store "default"
securityscanningnotificationworker stdout | 2024-04-22 03:33:54,555 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:33:54,555 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:02.556208+00:00 (in 8.000475 seconds)
buildlogsarchiver stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
buildlogsarchiver stderr |   if word_sep is not '':
globalpromstats stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
globalpromstats stderr |   if word_sep is not '':
notificationworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
notificationworker stderr |   if word_sep is not '':
gcworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
gcworker stderr |   if word_sep is not '':
logrotateworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
logrotateworker stderr |   if word_sep is not '':
autopruneworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
autopruneworker stderr |   if word_sep is not '':
exportactionlogsworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
exportactionlogsworker stderr |   if word_sep is not '':
gunicorn-secscan stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
gunicorn-secscan stderr |   if word_sep is not '':
builder stdout | 2024-04-22 03:33:56,760 [62] [DEBUG] [__main__] Building is disabled. Please enable the feature flag
repositoryactioncounter stdout | 2024-04-22 03:33:56,957 [89] [DEBUG] [workers.worker] Scheduling worker.
repositoryactioncounter stdout | 2024-04-22 03:33:56,958 [89] [INFO] [apscheduler.scheduler] Scheduler started
repositoryactioncounter stdout | 2024-04-22 03:33:57,060 [89] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositoryactioncounter stdout | 2024-04-22 03:33:57,060 [89] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:49:55.061170
repositoryactioncounter stdout | 2024-04-22 03:33:57,152 [89] [INFO] [apscheduler.scheduler] Added job "RepositoryActionCountWorker._run_counting" to job store "default"
repositoryactioncounter stdout | 2024-04-22 03:33:57,060 [89] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
repositoryactioncounter stdout | 2024-04-22 03:33:57,153 [89] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositoryactioncounter stdout | 2024-04-22 03:33:57,153 [89] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:55.061170+00:00 (in 957.907498 seconds)
servicekey stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
servicekey stderr |   if word_sep is not '':
gunicorn-web stdout | 2024-04-22 03:33:59,453 [72] [DEBUG] [app] Loading default config.
gunicorn-web stdout | 2024-04-22 03:33:59,455 [72] [DEBUG] [util.config.provider.basefileprovider] Applying config file: /quay-registry/conf/stack/config.yaml
gunicorn-web stdout | 2024-04-22 03:33:59,555 [72] [DEBUG] [app] Loaded config
gunicorn-web stdout | 2024-04-22 03:33:59,558 [72] [INFO] [util.ipresolver] Loading AWS IP ranges from disk
gunicorn-web stdout | 2024-04-22 03:33:59,656 [72] [DEBUG] [util.ipresolver] Building AWS IP ranges
blobuploadcleanupworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
blobuploadcleanupworker stderr |   if word_sep is not '':
chunkcleanupworker stdout | 2024-04-22 03:34:00,563 [64] [DEBUG] [__main__] Swift storage not detected; sleeping
nginx stdout | 2024/04/22 03:34:00 [crit] 107#0: *7 connect() to unix:/tmp/gunicorn_web.sock failed (2: No such file or directory) while connecting to upstream, client: 10.131.0.2, server: , request: "GET /health/instance HTTP/1.1", upstream: "http://unix:/tmp/gunicorn_web.sock:/health/instance", host: "10.131.0.31:8080"
nginx stdout | 2024/04/22 03:34:00 [crit] 107#0: *7 connect() to unix:/tmp/gunicorn_web.sock failed (2: No such file or directory) while connecting to upstream, client: 10.131.0.2, server: , request: "GET /health/instance HTTP/1.1", upstream: "http://unix:/tmp/gunicorn_web.sock:/quay-registry/static/502.html", host: "10.131.0.31:8080"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:34:00 +0000] "GET /health/instance HTTP/1.1" 502 157 "-" "kube-probe/1.28" (0.000 118 0.000 : 0.000)
gunicorn-web stdout | 2024-04-22 03:34:00,661 [72] [DEBUG] [util.ipresolver] Finished building AWS IP ranges
quotaregistrysizeworker stdout | 2024-04-22 03:34:01,357 [81] [DEBUG] [workers.worker] Scheduling worker.
quotaregistrysizeworker stdout | 2024-04-22 03:34:01,359 [81] [INFO] [apscheduler.scheduler] Scheduler started
quotaregistrysizeworker stdout | 2024-04-22 03:34:01,360 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:34:01,360 [81] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:34:24.361582
quotaregistrysizeworker stdout | 2024-04-22 03:34:01,363 [81] [INFO] [apscheduler.scheduler] Added job "QuotaRegistrySizeWorker._calculate_registry_size" to job store "default"
quotaregistrysizeworker stdout | 2024-04-22 03:34:01,361 [81] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
quotaregistrysizeworker stdout | 2024-04-22 03:34:01,451 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:34:01,451 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:24.361582+00:00 (in 22.910429 seconds)
repositorygcworker stdout | 2024-04-22 03:34:01,451 [90] [DEBUG] [__main__] Starting repository GC worker
repositorygcworker stdout | 2024-04-22 03:34:01,453 [90] [DEBUG] [workers.worker] Scheduling worker.
repositorygcworker stdout | 2024-04-22 03:34:01,454 [90] [INFO] [apscheduler.scheduler] Scheduler started
repositorygcworker stdout | 2024-04-22 03:34:01,551 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:34:01,551 [90] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:34:06.552482
repositorygcworker stdout | 2024-04-22 03:34:01,554 [90] [INFO] [apscheduler.scheduler] Added job "QueueWorker.poll_queue" to job store "default"
repositorygcworker stdout | 2024-04-22 03:34:01,554 [90] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:36:51.555445
repositorygcworker stdout | 2024-04-22 03:34:01,554 [90] [INFO] [apscheduler.scheduler] Added job "QueueWorker.update_queue_metrics" to job store "default"
repositorygcworker stdout | 2024-04-22 03:34:01,554 [90] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:34:13.555667
repositorygcworker stdout | 2024-04-22 03:34:01,554 [90] [INFO] [apscheduler.scheduler] Added job "QueueWorker.run_watchdog" to job store "default"
repositorygcworker stdout | 2024-04-22 03:34:01,552 [90] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
repositorygcworker stdout | 2024-04-22 03:34:01,560 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:34:01,561 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:06.552482+00:00 (in 4.991028 seconds)
queuecleanupworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
queuecleanupworker stderr |   if word_sep is not '':
securityworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
securityworker stderr |   if word_sep is not '':
gunicorn-web stdout | 2024-04-22 03:34:02,051 [72] [DEBUG] [data.database] Configuring database
gunicorn-web stdout | 2024-04-22 03:34:02,054 [72] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:34:02,055 [72] [INFO] [data.secscan_model] ===============================
gunicorn-web stdout | 2024-04-22 03:34:02,056 [72] [INFO] [data.secscan_model] Using split secscan model: `[<data.secscan_model.secscan_v4_model.V4SecurityScanner object at 0x7f90a284a730>]`
gunicorn-web stdout | 2024-04-22 03:34:02,057 [72] [INFO] [data.secscan_model] ===============================
gunicorn-web stdout | 2024-04-22 03:34:02,058 [72] [DEBUG] [data.logs_model] Configuring log model
gunicorn-web stdout | 2024-04-22 03:34:02,058 [72] [INFO] [data.logs_model] ===============================
gunicorn-web stdout | 2024-04-22 03:34:02,059 [72] [INFO] [data.logs_model] Using logs model `<data.logs_model.table_logs_model.TableLogsModel object at 0x7f90a284a970>`
gunicorn-web stdout | 2024-04-22 03:34:02,060 [72] [INFO] [data.logs_model] ===============================
teamsyncworker stdout | 2024-04-22 03:34:02,160 [98] [DEBUG] [__main__] Team syncing is disabled; sleeping
namespacegcworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
namespacegcworker stderr |   if word_sep is not '':
securityscanningnotificationworker stdout | 2024-04-22 03:34:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:34:02,751 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:34:02 UTC)" (scheduled at 2024-04-22 03:34:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:34:02,751 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:16.552337+00:00 (in 13.800838 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:34:02,752 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:34:02,754 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:35:02 UTC)" executed successfully
manifestbackfillworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
manifestbackfillworker stderr |   if word_sep is not '':
reconciliationworker stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
reconciliationworker stderr |   if word_sep is not '':
gunicorn-secscan stdout | 2024-04-22 03:34:04,052 [71] [DEBUG] [app] Loading default config.
gunicorn-secscan stdout | 2024-04-22 03:34:04,054 [71] [DEBUG] [util.config.provider.basefileprovider] Applying config file: /quay-registry/conf/stack/config.yaml
gunicorn-secscan stdout | 2024-04-22 03:34:04,152 [71] [DEBUG] [app] Loaded config
gunicorn-secscan stdout | 2024-04-22 03:34:04,154 [71] [INFO] [util.ipresolver] Loading AWS IP ranges from disk
gunicorn-secscan stdout | 2024-04-22 03:34:04,255 [71] [DEBUG] [util.ipresolver] Building AWS IP ranges
buildlogsarchiver stdout | 2024-04-22 03:34:04,853 [63] [DEBUG] [workers.worker] Scheduling worker.
buildlogsarchiver stdout | 2024-04-22 03:34:04,855 [63] [INFO] [apscheduler.scheduler] Scheduler started
buildlogsarchiver stdout | 2024-04-22 03:34:05,051 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:34:05,051 [63] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:34:17.052354
buildlogsarchiver stdout | 2024-04-22 03:34:05,052 [63] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
buildlogsarchiver stdout | 2024-04-22 03:34:05,055 [63] [INFO] [apscheduler.scheduler] Added job "ArchiveBuildLogsWorker._archive_redis_buildlogs" to job store "default"
buildlogsarchiver stdout | 2024-04-22 03:34:05,055 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:34:05,055 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:17.052354+00:00 (in 11.996536 seconds)
gunicorn-secscan stdout | 2024-04-22 03:34:05,262 [71] [DEBUG] [util.ipresolver] Finished building AWS IP ranges
storagereplication stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
storagereplication stderr |   if word_sep is not '':
notificationworker stdout | 2024-04-22 03:34:05,755 [78] [DEBUG] [workers.worker] Scheduling worker.
notificationworker stdout | 2024-04-22 03:34:05,757 [78] [INFO] [apscheduler.scheduler] Scheduler started
notificationworker stdout | 2024-04-22 03:34:05,758 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:34:05,758 [78] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:34:13.759375
notificationworker stdout | 2024-04-22 03:34:05,761 [78] [INFO] [apscheduler.scheduler] Added job "QueueWorker.poll_queue" to job store "default"
notificationworker stdout | 2024-04-22 03:34:05,761 [78] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:38:19.762160
notificationworker stdout | 2024-04-22 03:34:05,761 [78] [INFO] [apscheduler.scheduler] Added job "QueueWorker.update_queue_metrics" to job store "default"
notificationworker stdout | 2024-04-22 03:34:05,761 [78] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:34:19.762424
notificationworker stdout | 2024-04-22 03:34:05,761 [78] [INFO] [apscheduler.scheduler] Added job "QueueWorker.run_watchdog" to job store "default"
notificationworker stdout | 2024-04-22 03:34:05,759 [78] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
notificationworker stdout | 2024-04-22 03:34:05,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:34:05,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:13.759375+00:00 (in 7.996510 seconds)
gcworker stdout | 2024-04-22 03:34:05,856 [68] [DEBUG] [workers.worker] Scheduling worker.
gcworker stdout | 2024-04-22 03:34:05,856 [68] [INFO] [apscheduler.scheduler] Scheduler started
gunicorn-secscan stdout | 2024-04-22 03:34:05,862 [71] [DEBUG] [data.database] Configuring database
gunicorn-secscan stdout | 2024-04-22 03:34:05,863 [71] [INFO] [data.database] Connection pooling disabled for postgresql
gcworker stdout | 2024-04-22 03:34:05,865 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:34:05,866 [68] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
gcworker stdout | 2024-04-22 03:34:05,951 [68] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:34:14.952062
gunicorn-secscan stdout | 2024-04-22 03:34:05,951 [71] [INFO] [data.secscan_model] ===============================
gunicorn-secscan stdout | 2024-04-22 03:34:05,951 [71] [INFO] [data.secscan_model] Using split secscan model: `[<data.secscan_model.secscan_v4_model.V4SecurityScanner object at 0x7f75f962e4f0>]`
gunicorn-secscan stdout | 2024-04-22 03:34:05,952 [71] [INFO] [data.secscan_model] ===============================
gunicorn-secscan stdout | 2024-04-22 03:34:05,952 [71] [DEBUG] [data.logs_model] Configuring log model
gunicorn-secscan stdout | 2024-04-22 03:34:05,952 [71] [INFO] [data.logs_model] ===============================
gunicorn-secscan stdout | 2024-04-22 03:34:05,952 [71] [INFO] [data.logs_model] Using logs model `<data.logs_model.table_logs_model.TableLogsModel object at 0x7f75f962e700>`
gunicorn-secscan stdout | 2024-04-22 03:34:05,952 [71] [INFO] [data.logs_model] ===============================
gcworker stdout | 2024-04-22 03:34:05,953 [68] [INFO] [apscheduler.scheduler] Added job "GarbageCollectionWorker._garbage_collection_repos" to job store "default"
gcworker stdout | 2024-04-22 03:34:05,953 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:34:05,953 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:14.952062+00:00 (in 8.998490 seconds)
repositorygcworker stdout | 2024-04-22 03:34:06,553 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:34:06,554 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:34:06 UTC)" (scheduled at 2024-04-22 03:34:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:34:06,555 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:13.555667+00:00 (in 7.000568 seconds)
repositorygcworker stdout | 2024-04-22 03:34:06,555 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:34:06,559 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 34, 6, 557538), True, datetime.datetime(2024, 4, 22, 3, 34, 6, 557538), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:34:06,572 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:34:06,572 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:34:06,572 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:35:06 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:34:06,963 [93] [DEBUG] [workers.worker] Scheduling worker.
servicekey stdout | 2024-04-22 03:34:07,051 [93] [INFO] [apscheduler.scheduler] Scheduler started
logrotateworker stdout | 2024-04-22 03:34:07,052 [73] [DEBUG] [__main__] Action log rotation worker not enabled; skipping
servicekey stdout | 2024-04-22 03:34:07,052 [93] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
servicekey stdout | 2024-04-22 03:34:07,052 [93] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:38:04.053182
servicekey stdout | 2024-04-22 03:34:07,052 [93] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
servicekey stdout | 2024-04-22 03:34:07,054 [93] [INFO] [apscheduler.scheduler] Added job "ServiceKeyWorker._refresh_service_key" to job store "default"
servicekey stdout | 2024-04-22 03:34:07,054 [93] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
servicekey stdout | 2024-04-22 03:34:07,054 [93] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:04.053182+00:00 (in 236.998508 seconds)
globalpromstats stdout | 2024-04-22 03:34:07,257 [69] [DEBUG] [workers.worker] Scheduling worker.
globalpromstats stdout | 2024-04-22 03:34:07,257 [69] [INFO] [apscheduler.scheduler] Scheduler started
globalpromstats stdout | 2024-04-22 03:34:07,259 [69] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
globalpromstats stdout | 2024-04-22 03:34:07,259 [69] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
globalpromstats stdout | 2024-04-22 03:34:07,259 [69] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:54:08.260282
globalpromstats stdout | 2024-04-22 03:34:07,261 [69] [INFO] [apscheduler.scheduler] Added job "GlobalPrometheusStatsWorker._try_report_stats" to job store "default"
globalpromstats stdout | 2024-04-22 03:34:07,261 [69] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
globalpromstats stdout | 2024-04-22 03:34:07,261 [69] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:08.260282+00:00 (in 1200.998698 seconds)
autopruneworker stdout | 2024-04-22 03:34:07,262 [60] [DEBUG] [workers.worker] Scheduling worker.
autopruneworker stdout | 2024-04-22 03:34:07,262 [60] [INFO] [apscheduler.scheduler] Scheduler started
autopruneworker stdout | 2024-04-22 03:34:07,263 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:34:07,263 [60] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
autopruneworker stdout | 2024-04-22 03:34:07,263 [60] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:34:11.264267
autopruneworker stdout | 2024-04-22 03:34:07,264 [60] [INFO] [apscheduler.scheduler] Added job "AutoPruneWorker.prune" to job store "default"
autopruneworker stdout | 2024-04-22 03:34:07,359 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:34:07,360 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:11.264267+00:00 (in 3.904216 seconds)
gunicorn-secscan stdout | 2024-04-22 03:34:07,662 [71] [DEBUG] [__config__] Starting secscan gunicorn with 2 workers and gevent worker class
blobuploadcleanupworker stdout | 2024-04-22 03:34:07,966 [61] [DEBUG] [workers.worker] Scheduling worker.
blobuploadcleanupworker stdout | 2024-04-22 03:34:07,967 [61] [INFO] [apscheduler.scheduler] Scheduler started
blobuploadcleanupworker stdout | 2024-04-22 03:34:07,967 [61] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
blobuploadcleanupworker stdout | 2024-04-22 03:34:07,967 [61] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
blobuploadcleanupworker stdout | 2024-04-22 03:34:07,967 [61] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 04:11:42.968897
blobuploadcleanupworker stdout | 2024-04-22 03:34:08,051 [61] [INFO] [apscheduler.scheduler] Added job "BlobUploadCleanupWorker._try_cleanup_uploads" to job store "default"
blobuploadcleanupworker stdout | 2024-04-22 03:34:08,051 [61] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
blobuploadcleanupworker stdout | 2024-04-22 03:34:08,051 [61] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:42.968897+00:00 (in 2254.917522 seconds)
queuecleanupworker stdout | 2024-04-22 03:34:08,765 [80] [DEBUG] [workers.worker] Scheduling worker.
queuecleanupworker stdout | 2024-04-22 03:34:08,766 [80] [INFO] [apscheduler.scheduler] Scheduler started
queuecleanupworker stdout | 2024-04-22 03:34:08,766 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
queuecleanupworker stdout | 2024-04-22 03:34:08,766 [80] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
queuecleanupworker stdout | 2024-04-22 03:34:08,766 [80] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 14:53:32.767890
queuecleanupworker stdout | 2024-04-22 03:34:08,768 [80] [INFO] [apscheduler.scheduler] Added job "QueueCleanupWorker._cleanup_queue" to job store "default"
queuecleanupworker stdout | 2024-04-22 03:34:08,768 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
queuecleanupworker stdout | 2024-04-22 03:34:08,769 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 14:53:32.767890+00:00 (in 40763.998785 seconds)
namespacegcworker stdout | 2024-04-22 03:34:09,053 [76] [DEBUG] [__main__] Starting namespace GC worker
namespacegcworker stdout | 2024-04-22 03:34:09,054 [76] [DEBUG] [workers.worker] Scheduling worker.
namespacegcworker stdout | 2024-04-22 03:34:09,055 [76] [INFO] [apscheduler.scheduler] Scheduler started
namespacegcworker stdout | 2024-04-22 03:34:09,056 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:34:09,056 [76] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
namespacegcworker stdout | 2024-04-22 03:34:09,056 [76] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:34:43.057186
namespacegcworker stdout | 2024-04-22 03:34:09,057 [76] [INFO] [apscheduler.scheduler] Added job "QueueWorker.poll_queue" to job store "default"
namespacegcworker stdout | 2024-04-22 03:34:09,057 [76] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:37:38.058708
namespacegcworker stdout | 2024-04-22 03:34:09,057 [76] [INFO] [apscheduler.scheduler] Added job "QueueWorker.update_queue_metrics" to job store "default"
namespacegcworker stdout | 2024-04-22 03:34:09,057 [76] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:34:22.058978
namespacegcworker stdout | 2024-04-22 03:34:09,058 [76] [INFO] [apscheduler.scheduler] Added job "QueueWorker.run_watchdog" to job store "default"
namespacegcworker stdout | 2024-04-22 03:34:09,058 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:34:09,058 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:22.058978+00:00 (in 13.000658 seconds)
manifestbackfillworker stdout | 2024-04-22 03:34:09,068 [74] [DEBUG] [workers.worker] Scheduling worker.
manifestbackfillworker stdout | 2024-04-22 03:34:09,069 [74] [INFO] [apscheduler.scheduler] Scheduler started
manifestbackfillworker stdout | 2024-04-22 03:34:09,069 [74] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
manifestbackfillworker stdout | 2024-04-22 03:34:09,069 [74] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
manifestbackfillworker stdout | 2024-04-22 03:34:09,069 [74] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 04:26:47.070659
manifestbackfillworker stdout | 2024-04-22 03:34:09,071 [74] [INFO] [apscheduler.scheduler] Added job "ManifestBackfillWorker._backfill_manifests" to job store "default"
manifestbackfillworker stdout | 2024-04-22 03:34:09,071 [74] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
manifestbackfillworker stdout | 2024-04-22 03:34:09,071 [74] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:47.070659+00:00 (in 3157.999322 seconds)
exportactionlogsworker stdout | 2024-04-22 03:34:09,561 [67] [DEBUG] [__main__] Starting export action logs worker
exportactionlogsworker stdout | 2024-04-22 03:34:09,563 [67] [DEBUG] [workers.worker] Scheduling worker.
exportactionlogsworker stdout | 2024-04-22 03:34:09,563 [67] [INFO] [apscheduler.scheduler] Scheduler started
exportactionlogsworker stdout | 2024-04-22 03:34:09,563 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:34:09,563 [67] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
exportactionlogsworker stdout | 2024-04-22 03:34:09,563 [67] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:34:41.564959
exportactionlogsworker stdout | 2024-04-22 03:34:09,565 [67] [INFO] [apscheduler.scheduler] Added job "QueueWorker.poll_queue" to job store "default"
exportactionlogsworker stdout | 2024-04-22 03:34:09,565 [67] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:36:53.566665
exportactionlogsworker stdout | 2024-04-22 03:34:09,565 [67] [INFO] [apscheduler.scheduler] Added job "QueueWorker.update_queue_metrics" to job store "default"
exportactionlogsworker stdout | 2024-04-22 03:34:09,565 [67] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:34:39.566970
exportactionlogsworker stdout | 2024-04-22 03:34:09,566 [67] [INFO] [apscheduler.scheduler] Added job "QueueWorker.run_watchdog" to job store "default"
exportactionlogsworker stdout | 2024-04-22 03:34:09,566 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:34:09,566 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:39.566970+00:00 (in 30.000589 seconds)
storagereplication stdout | 2024-04-22 03:34:09,660 [94] [DEBUG] [__main__] Full storage replication disabled; skipping
gunicorn-web stdout | 2024-04-22 03:34:09,764 [72] [DEBUG] [__config__] Starting web gunicorn with 4 workers and gevent worker class
gunicorn-registry stderr | /app/lib/python3.9/site-packages/netaddr/strategy/__init__.py:189: SyntaxWarning: "is not" with a literal. Did you mean "!="?
gunicorn-registry stderr |   if word_sep is not '':
securityworker stdout | 2024-04-22 03:34:09,869 [92] [DEBUG] [workers.worker] Scheduling worker.
securityworker stdout | 2024-04-22 03:34:09,870 [92] [INFO] [apscheduler.scheduler] Scheduler started
securityworker stdout | 2024-04-22 03:34:09,870 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:34:09,870 [92] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
securityworker stdout | 2024-04-22 03:34:09,870 [92] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:34:35.871852
securityworker stdout | 2024-04-22 03:34:09,872 [92] [INFO] [apscheduler.scheduler] Added job "SecurityWorker._index_in_scanner" to job store "default"
securityworker stdout | 2024-04-22 03:34:09,872 [92] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 03:34:26.873109
securityworker stdout | 2024-04-22 03:34:09,872 [92] [INFO] [apscheduler.scheduler] Added job "SecurityWorker._index_recent_manifests_in_scanner" to job store "default"
securityworker stdout | 2024-04-22 03:34:09,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:34:09,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:26.873109+00:00 (in 17.000703 seconds)
gunicorn-registry stdout | 2024-04-22 03:34:10,265 [70] [DEBUG] [app] Loading default config.
gunicorn-registry stdout | 2024-04-22 03:34:10,265 [70] [DEBUG] [util.config.provider.basefileprovider] Applying config file: /quay-registry/conf/stack/config.yaml
gunicorn-registry stdout | 2024-04-22 03:34:10,273 [70] [DEBUG] [app] Loaded config
gunicorn-registry stdout | 2024-04-22 03:34:10,274 [70] [INFO] [util.ipresolver] Loading AWS IP ranges from disk
gunicorn-registry stdout | 2024-04-22 03:34:10,281 [70] [DEBUG] [util.ipresolver] Building AWS IP ranges
gunicorn-registry stdout | 2024-04-22 03:34:10,363 [70] [DEBUG] [util.ipresolver] Finished building AWS IP ranges
gunicorn-registry stdout | 2024-04-22 03:34:10,467 [70] [DEBUG] [data.database] Configuring database
gunicorn-registry stdout | 2024-04-22 03:34:10,468 [70] [INFO] [data.database] Connection pooling enabled for postgresql; stale timeout: None; max connection count: None
gunicorn-registry stdout | 2024-04-22 03:34:10,469 [70] [INFO] [data.secscan_model] ===============================
gunicorn-registry stdout | 2024-04-22 03:34:10,469 [70] [INFO] [data.secscan_model] Using split secscan model: `[<data.secscan_model.secscan_v4_model.V4SecurityScanner object at 0x7fd05e41ba00>]`
gunicorn-registry stdout | 2024-04-22 03:34:10,469 [70] [INFO] [data.secscan_model] ===============================
gunicorn-registry stdout | 2024-04-22 03:34:10,469 [70] [DEBUG] [data.logs_model] Configuring log model
gunicorn-registry stdout | 2024-04-22 03:34:10,469 [70] [INFO] [data.logs_model] ===============================
gunicorn-registry stdout | 2024-04-22 03:34:10,469 [70] [INFO] [data.logs_model] Using logs model `<data.logs_model.table_logs_model.TableLogsModel object at 0x7fd05e41bd30>`
gunicorn-registry stdout | 2024-04-22 03:34:10,469 [70] [INFO] [data.logs_model] ===============================
gunicorn-registry stdout | 2024-04-22 03:34:11,139 [70] [DEBUG] [__config__] Starting registry gunicorn with 8 workers and gevent worker class
autopruneworker stdout | 2024-04-22 03:34:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:34:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:34:11 UTC)" (scheduled at 2024-04-22 03:34:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:34:11,265 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:41.264267+00:00 (in 29.998704 seconds)
autopruneworker stdout | 2024-04-22 03:34:11,273 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713756791272, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:34:11,277 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:34:11,277 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:34:11,277 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:34:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:34:13,556 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:34:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:06.552482+00:00 (in 52.995574 seconds)
repositorygcworker stdout | 2024-04-22 03:34:13,557 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:35:13 UTC)" (scheduled at 2024-04-22 03:34:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:34:13,557 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:34:13,557 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:35:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:34:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:34:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:34:13 UTC)" (scheduled at 2024-04-22 03:34:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:34:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:34:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 34, 13, 760327), True, datetime.datetime(2024, 4, 22, 3, 34, 13, 760327), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:34:13,761 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:19.762424+00:00 (in 6.000459 seconds)
notificationworker stdout | 2024-04-22 03:34:13,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:34:13,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:34:13,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:34:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:34:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:34:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:34:14 UTC)" (scheduled at 2024-04-22 03:34:14.952062+00:00)
gcworker stdout | 2024-04-22 03:34:14,953 [68] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."removed_tag_expiration_s" FROM "user" AS "t1" LIMIT %s', [100])
gcworker stdout | 2024-04-22 03:34:14,953 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:44.952062+00:00 (in 29.998242 seconds)
gcworker stdout | 2024-04-22 03:34:14,963 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:34:14,963 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:34:14,963 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:34:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:34:15,656 [281] [DEBUG] [app] Starting request: urn:request:a1ab9b43-e4b5-4a15-ae5a-10f747bab705 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:34:15,661 [281] [DEBUG] [urllib3.connectionpool] Starting new HTTP connection (1): localhost:8080
gunicorn-registry stdout | 2024-04-22 03:34:15,678 [290] [DEBUG] [app] Starting request: urn:request:d888993e-e714-430b-a879-a438dc4720ad (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:34:15,679 [290] [DEBUG] [app] Ending request: urn:request:d888993e-e714-430b-a879-a438dc4720ad (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:d888993e-e714-430b-a879-a438dc4720ad', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:34:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.005 162 0.005)
gunicorn-registry stdout | 2024-04-22 03:34:15,680 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:34:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:34:15,680 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:34:15,682 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:34:15,683 [281] [DEBUG] [app] Starting request: urn:request:9f4ef8dc-4980-4152-b297-35f3fe094670 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:34:15,684 [281] [DEBUG] [app] Ending request: urn:request:9f4ef8dc-4980-4152-b297-35f3fe094670 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9f4ef8dc-4980-4152-b297-35f3fe094670', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:34:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.003 159 0.002)
gunicorn-web stdout | 2024-04-22 03:34:15,685 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:34:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:34:15,685 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:34:15,688 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE ((((NOT ("t1"."approval_id" IS %s) AND (("t1"."expiration_date" > %s) OR ("t1"."expiration_date" IS %s))) AND ("t1"."service" = %s)) AND (NOT (("t1"."service" = %s) AND ("t1"."expiration_date" <= %s)) OR NOT ((("t1"."service" = %s) AND ("t1"."approval_id" IS %s)) AND ("t1"."created_date" <= %s)))) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s)))', [None, datetime.datetime(2024, 4, 22, 3, 34, 15, 686768), None, 'quay', 'quay', datetime.datetime(2024, 4, 22, 3, 34, 15, 686831), 'quay', None, datetime.datetime(2024, 4, 21, 3, 34, 15, 686847), datetime.datetime(2024, 4, 15, 3, 34, 15, 686857), None])
gunicorn-web stdout | 2024-04-22 03:34:15,700 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:34:15,706 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:34:15,708 [281] [DEBUG] [app] Ending request: urn:request:a1ab9b43-e4b5-4a15-ae5a-10f747bab705 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a1ab9b43-e4b5-4a15-ae5a-10f747bab705', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:34:15,708 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:34:15,708 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:34:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:34:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.056 118 0.056)
gunicorn-web stdout | 2024-04-22 03:34:15,710 [281] [DEBUG] [app] Starting request: urn:request:3d018141-7292-449b-ad92-c52d7abb4b95 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-registry stdout | 2024-04-22 03:34:15,712 [290] [DEBUG] [app] Starting request: urn:request:b3fd0506-3fae-4b42-b7f3-4d74d2a90859 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:34:15,712 [290] [DEBUG] [app] Ending request: urn:request:b3fd0506-3fae-4b42-b7f3-4d74d2a90859 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b3fd0506-3fae-4b42-b7f3-4d74d2a90859', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:34:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:34:15,713 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:34:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:34:15,713 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:34:15,714 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:34:15,719 [278] [DEBUG] [app] Starting request: urn:request:55a0a886-14cc-474a-b461-c1694d1a23f6 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:34:15,719 [278] [DEBUG] [app] Ending request: urn:request:55a0a886-14cc-474a-b461-c1694d1a23f6 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:55a0a886-14cc-474a-b461-c1694d1a23f6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:34:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.005 159 0.005)
gunicorn-web stdout | 2024-04-22 03:34:15,720 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:34:15,720 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:34:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:34:15,721 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:34:15,728 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:34:15,737 [281] [DEBUG] [app] Ending request: urn:request:3d018141-7292-449b-ad92-c52d7abb4b95 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:3d018141-7292-449b-ad92-c52d7abb4b95', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:34:15,737 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:34:15,737 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:34:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:34:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.028 118 0.028)
securityscanningnotificationworker stdout | 2024-04-22 03:34:16,553 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:34:16,553 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:02.556208+00:00 (in 46.002292 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:34:16,554 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:35:16 UTC)" (scheduled at 2024-04-22 03:34:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:34:16,554 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:34:16,555 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 34, 16, 554179), True, datetime.datetime(2024, 4, 22, 3, 34, 16, 554179), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:34:16,566 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:34:16,566 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:34:16,566 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:35:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:34:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:34:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:34:17 UTC)" (scheduled at 2024-04-22 03:34:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:34:17,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 34, 17, 53317), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:34:17,054 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:47.052354+00:00 (in 29.997837 seconds)
buildlogsarchiver stdout | 2024-04-22 03:34:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:34:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:34:17,065 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:34:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:34:18,285 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:34:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:34:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:23.759375+00:00 (in 3.996445 seconds)
notificationworker stdout | 2024-04-22 03:34:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:35:19 UTC)" (scheduled at 2024-04-22 03:34:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:34:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:34:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:35:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:34:19,985 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:34:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:34:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:34:22 UTC)" (scheduled at 2024-04-22 03:34:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:34:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:34:22,060 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:34:22 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:34:22,060 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:43.057186+00:00 (in 20.996856 seconds)
builder stdout | 2024-04-22 03:34:23,495 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
notificationworker stdout | 2024-04-22 03:34:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:34:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:33.759375+00:00 (in 9.999447 seconds)
notificationworker stdout | 2024-04-22 03:34:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:34:33 UTC)" (scheduled at 2024-04-22 03:34:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:34:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:34:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 34, 23, 760335), True, datetime.datetime(2024, 4, 22, 3, 34, 23, 760335), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:34:23,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:34:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:34:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:34:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 03:34:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:34:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:34:24 UTC)" (scheduled at 2024-04-22 03:34:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:34:24,363 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:34:24,363 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:24.361582+00:00 (in 59.998168 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:34:24,373 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:34:24,373 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:35:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:34:25,085 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 03:34:26,457 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
securityworker stdout | 2024-04-22 03:34:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:34:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:34:26 UTC)" (scheduled at 2024-04-22 03:34:26.873109+00:00)
securityworker stdout | 2024-04-22 03:34:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:34:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:34:26,874 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:35.871852+00:00 (in 8.997267 seconds)
securityworker stdout | 2024-04-22 03:34:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:34:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:34:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:34:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:34:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:34:26,936 [92] [DEBUG] [urllib3.connectionpool] Starting new HTTP connection (1): quayregistry-clair-app.quay-enterprise.svc.cluster.local:80
securityworker stdout | 2024-04-22 03:34:26,948 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:34:26,950 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:34:26,960 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:34:26,962 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:34:26,962 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:34:26,963 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 29, 26, 950180), 1, 2])
securityworker stdout | 2024-04-22 03:34:26,965 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:34:26,965 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:34:26,965 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 29, 26, 950180), 1, 2])
securityworker stdout | 2024-04-22 03:34:26,968 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:34:26,968 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:34:26,968 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:34:26,968 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:34:26,968 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:34:26,968 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:34:26,968 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:34:26,969 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:34:26,969 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:34:26,969 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:34:56 UTC)" executed successfully
chunkcleanupworker stdout | 2024-04-22 03:34:28,485 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
teamsyncworker stdout | 2024-04-22 03:34:28,487 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:34:29,564 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:34:29,577 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:34:29,578 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:34:29,580 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:34:29,581 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:34:29,582 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:34:30,656 [282] [DEBUG] [app] Starting request: urn:request:8a8064ed-64e5-4b78-a6e7-7cc50740291d (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:34:30,658 [279] [DEBUG] [app] Starting request: urn:request:93d8624f-5c59-4ed3-9295-0441128eeb23 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:34:30,663 [282] [DEBUG] [urllib3.connectionpool] Starting new HTTP connection (1): localhost:8080
gunicorn-web stdout | 2024-04-22 03:34:30,664 [279] [DEBUG] [urllib3.connectionpool] Starting new HTTP connection (1): localhost:8080
gunicorn-registry stdout | 2024-04-22 03:34:30,665 [290] [DEBUG] [app] Starting request: urn:request:1da8c45c-ca32-4b77-aaaa-810734ada300 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:34:30,666 [290] [DEBUG] [app] Ending request: urn:request:1da8c45c-ca32-4b77-aaaa-810734ada300 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:1da8c45c-ca32-4b77-aaaa-810734ada300', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:34:30,666 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:34:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:34:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:34:30,666 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:34:30,668 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:34:30,668 [292] [DEBUG] [app] Starting request: urn:request:6eb5df7b-6fe4-4d7d-a687-32ff98f4446f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:34:30,669 [282] [DEBUG] [app] Starting request: urn:request:3f364d4a-6403-4fad-b222-55b88895481e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:34:30,670 [292] [DEBUG] [app] Ending request: urn:request:6eb5df7b-6fe4-4d7d-a687-32ff98f4446f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:6eb5df7b-6fe4-4d7d-a687-32ff98f4446f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:34:30,670 [282] [DEBUG] [app] Ending request: urn:request:3f364d4a-6403-4fad-b222-55b88895481e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3f364d4a-6403-4fad-b222-55b88895481e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:34:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.005 162 0.004)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:34:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.001)
gunicorn-registry stdout | 2024-04-22 03:34:30,670 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:34:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:34:30,670 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:34:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:34:30,670 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:34:30,671 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:34:30,672 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:34:30,674 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE ((((NOT ("t1"."approval_id" IS %s) AND (("t1"."expiration_date" > %s) OR ("t1"."expiration_date" IS %s))) AND ("t1"."service" = %s)) AND (NOT (("t1"."service" = %s) AND ("t1"."expiration_date" <= %s)) OR NOT ((("t1"."service" = %s) AND ("t1"."approval_id" IS %s)) AND ("t1"."created_date" <= %s)))) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s)))', [None, datetime.datetime(2024, 4, 22, 3, 34, 30, 672342), None, 'quay', 'quay', datetime.datetime(2024, 4, 22, 3, 34, 30, 672375), 'quay', None, datetime.datetime(2024, 4, 21, 3, 34, 30, 672394), datetime.datetime(2024, 4, 15, 3, 34, 30, 672407), None])
gunicorn-web stdout | 2024-04-22 03:34:30,674 [278] [DEBUG] [app] Starting request: urn:request:e2fca224-ada3-4029-b259-acf07265594f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:34:30,675 [278] [DEBUG] [app] Ending request: urn:request:e2fca224-ada3-4029-b259-acf07265594f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e2fca224-ada3-4029-b259-acf07265594f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:34:30,675 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:34:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:34:30,675 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:34:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:34:30,678 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE ((((NOT ("t1"."approval_id" IS %s) AND (("t1"."expiration_date" > %s) OR ("t1"."expiration_date" IS %s))) AND ("t1"."service" = %s)) AND (NOT (("t1"."service" = %s) AND ("t1"."expiration_date" <= %s)) OR NOT ((("t1"."service" = %s) AND ("t1"."approval_id" IS %s)) AND ("t1"."created_date" <= %s)))) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s)))', [None, datetime.datetime(2024, 4, 22, 3, 34, 30, 676640), None, 'quay', 'quay', datetime.datetime(2024, 4, 22, 3, 34, 30, 676681), 'quay', None, datetime.datetime(2024, 4, 21, 3, 34, 30, 676698), datetime.datetime(2024, 4, 15, 3, 34, 30, 676712), None])
gunicorn-web stdout | 2024-04-22 03:34:30,685 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:34:30,689 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:34:30,691 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:34:30,694 [282] [DEBUG] [app] Ending request: urn:request:8a8064ed-64e5-4b78-a6e7-7cc50740291d (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:8a8064ed-64e5-4b78-a6e7-7cc50740291d', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:34:30,694 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:34:30,695 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:34:30,695 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:34:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:34:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.043 118 0.043)
gunicorn-web stdout | 2024-04-22 03:34:30,697 [279] [DEBUG] [app] Ending request: urn:request:93d8624f-5c59-4ed3-9295-0441128eeb23 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:93d8624f-5c59-4ed3-9295-0441128eeb23', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:34:30,698 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:34:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.046 118 0.046)
gunicorn-web stdout | 2024-04-22 03:34:30,698 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:34:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
notificationworker stdout | 2024-04-22 03:34:30,984 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:34:32,393 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:34:32,667 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:34:32,679 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:34:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:34:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:43.759375+00:00 (in 9.999515 seconds)
notificationworker stdout | 2024-04-22 03:34:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:34:43 UTC)" (scheduled at 2024-04-22 03:34:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:34:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:34:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 34, 33, 760233), True, datetime.datetime(2024, 4, 22, 3, 34, 33, 760233), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:34:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:34:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:34:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:34:43 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 03:34:33,787 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-secscan stdout | 2024-04-22 03:34:34,175 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:34:34,177 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:34:34,178 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:34:34,972 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:34:35,088 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:34:35,297 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:34:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:34:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:56.873109+00:00 (in 21.000775 seconds)
securityworker stdout | 2024-04-22 03:34:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:05 UTC)" (scheduled at 2024-04-22 03:34:35.871852+00:00)
securityworker stdout | 2024-04-22 03:34:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:34:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:34:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:34:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:34:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:34:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:34:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:05 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:34:36,088 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:34:37,485 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:34:37,604 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:34:38,000 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:34:38,178 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:34:39,207 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
exportactionlogsworker stdout | 2024-04-22 03:34:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:34:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:34:39 UTC)" (scheduled at 2024-04-22 03:34:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:34:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:34:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:34:39 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:34:39,568 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:41.564959+00:00 (in 1.996676 seconds)
gunicorn-registry stdout | 2024-04-22 03:34:40,353 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:34:40,356 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:34:40,359 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:34:40,361 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:34:40,365 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:34:40,367 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:34:40,370 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:34:40,372 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 03:34:40,374 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
autopruneworker stdout | 2024-04-22 03:34:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:34:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:11.264267+00:00 (in 29.999455 seconds)
autopruneworker stdout | 2024-04-22 03:34:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:11 UTC)" (scheduled at 2024-04-22 03:34:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:34:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713756821271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:34:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:34:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:34:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:34:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:34:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:39.566970+00:00 (in 58.001538 seconds)
exportactionlogsworker stdout | 2024-04-22 03:34:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:35:41 UTC)" (scheduled at 2024-04-22 03:34:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:34:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:34:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 34, 41, 565701), True, datetime.datetime(2024, 4, 22, 3, 34, 41, 565701), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:34:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:34:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:34:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:35:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:34:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:34:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:22.058978+00:00 (in 39.001314 seconds)
namespacegcworker stdout | 2024-04-22 03:34:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:35:43 UTC)" (scheduled at 2024-04-22 03:34:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:34:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:34:43,059 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 34, 43, 58042), True, datetime.datetime(2024, 4, 22, 3, 34, 43, 58042), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:34:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:34:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:34:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:35:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:34:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:34:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:34:53.759375+00:00 (in 9.999532 seconds)
notificationworker stdout | 2024-04-22 03:34:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:34:53 UTC)" (scheduled at 2024-04-22 03:34:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:34:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:34:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 34, 43, 760214), True, datetime.datetime(2024, 4, 22, 3, 34, 43, 760214), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:34:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:34:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:34:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:34:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:34:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:34:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:14.952062+00:00 (in 29.999526 seconds)
gcworker stdout | 2024-04-22 03:34:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:14 UTC)" (scheduled at 2024-04-22 03:34:44.952062+00:00)
gcworker stdout | 2024-04-22 03:34:44,952 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:34:44,952 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:34:45,653 [278] [DEBUG] [app] Starting request: urn:request:3f08bbe6-dd7d-43c4-89f6-6e00c044e38c (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:34:45,653 [281] [DEBUG] [app] Starting request: urn:request:33f40d34-0162-46e3-ba10-ef9fb20c8ee2 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:34:45,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:34:45,658 [278] [DEBUG] [urllib3.connectionpool] Starting new HTTP connection (1): localhost:8080
gunicorn-registry stdout | 2024-04-22 03:34:45,659 [288] [DEBUG] [app] Starting request: urn:request:6b663a2e-f47c-4127-a981-5211108a84c8 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:34:45,660 [288] [DEBUG] [app] Ending request: urn:request:6b663a2e-f47c-4127-a981-5211108a84c8 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:6b663a2e-f47c-4127-a981-5211108a84c8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:34:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.003 162 0.003)
gunicorn-registry stdout | 2024-04-22 03:34:45,660 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:34:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:34:45,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 03:34:45,661 [291] [DEBUG] [app] Starting request: urn:request:8bfd7aac-ab06-40f6-9a69-f0f8b14d35c1 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:34:45,662 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:34:45,662 [291] [DEBUG] [app] Ending request: urn:request:8bfd7aac-ab06-40f6-9a69-f0f8b14d35c1 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:8bfd7aac-ab06-40f6-9a69-f0f8b14d35c1', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:34:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.004 162 0.004)
gunicorn-registry stdout | 2024-04-22 03:34:45,663 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:34:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:34:45,663 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:34:45,663 [282] [DEBUG] [app] Starting request: urn:request:ef02fdad-9492-4fcf-a820-79a53546e2ff (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:34:45,664 [282] [DEBUG] [app] Ending request: urn:request:ef02fdad-9492-4fcf-a820-79a53546e2ff (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:ef02fdad-9492-4fcf-a820-79a53546e2ff', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:34:45,664 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:34:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:34:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:34:45,664 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:34:45,664 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:34:45,665 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:34:45,666 [279] [DEBUG] [app] Starting request: urn:request:355b2c36-0d5b-4c64-9f7a-8de2c1b7032e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:34:45,666 [279] [DEBUG] [app] Ending request: urn:request:355b2c36-0d5b-4c64-9f7a-8de2c1b7032e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:355b2c36-0d5b-4c64-9f7a-8de2c1b7032e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:34:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:34:45,667 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:34:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:34:45,667 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:34:45,669 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE ((((NOT ("t1"."approval_id" IS %s) AND (("t1"."expiration_date" > %s) OR ("t1"."expiration_date" IS %s))) AND ("t1"."service" = %s)) AND (NOT (("t1"."service" = %s) AND ("t1"."expiration_date" <= %s)) OR NOT ((("t1"."service" = %s) AND ("t1"."approval_id" IS %s)) AND ("t1"."created_date" <= %s)))) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s)))', [None, datetime.datetime(2024, 4, 22, 3, 34, 45, 668369), None, 'quay', 'quay', datetime.datetime(2024, 4, 22, 3, 34, 45, 668395), 'quay', None, datetime.datetime(2024, 4, 21, 3, 34, 45, 668408), datetime.datetime(2024, 4, 15, 3, 34, 45, 668417), None])
gunicorn-web stdout | 2024-04-22 03:34:45,671 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:34:45,678 [281] [DEBUG] [app] Ending request: urn:request:33f40d34-0162-46e3-ba10-ef9fb20c8ee2 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:33f40d34-0162-46e3-ba10-ef9fb20c8ee2', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:34:45,678 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:34:45,679 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:34:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:34:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.027 118 0.027)
gunicorn-web stdout | 2024-04-22 03:34:45,680 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:34:45,686 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:34:45,688 [278] [DEBUG] [app] Ending request: urn:request:3f08bbe6-dd7d-43c4-89f6-6e00c044e38c (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:3f08bbe6-dd7d-43c4-89f6-6e00c044e38c', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:34:45,689 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:34:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.037 118 0.037)
gunicorn-web stdout | 2024-04-22 03:34:45,689 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:34:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
buildlogsarchiver stdout | 2024-04-22 03:34:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:34:47,053 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:17.052354+00:00 (in 29.999367 seconds)
buildlogsarchiver stdout | 2024-04-22 03:34:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:17 UTC)" (scheduled at 2024-04-22 03:34:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:34:47,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 34, 47, 53405), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:34:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:34:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:34:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:34:48,322 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:34:50,021 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
builder stdout | 2024-04-22 03:34:53,524 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
notificationworker stdout | 2024-04-22 03:34:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:34:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:03.759375+00:00 (in 9.999485 seconds)
notificationworker stdout | 2024-04-22 03:34:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:35:03 UTC)" (scheduled at 2024-04-22 03:34:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:34:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:34:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 34, 53, 760184), True, datetime.datetime(2024, 4, 22, 3, 34, 53, 760184), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:34:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:34:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:34:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:35:03 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:34:55,117 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 03:34:56,489 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
securityworker stdout | 2024-04-22 03:34:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:34:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:05.871852+00:00 (in 8.998280 seconds)
securityworker stdout | 2024-04-22 03:34:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:26 UTC)" (scheduled at 2024-04-22 03:34:56.873109+00:00)
securityworker stdout | 2024-04-22 03:34:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:34:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:34:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:34:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:34:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:34:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:34:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:34:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:34:56,882 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:34:56,892 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:34:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:34:56,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:34:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 29, 56, 881790), 1, 2])
securityworker stdout | 2024-04-22 03:34:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:34:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:34:56,899 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 29, 56, 881790), 1, 2])
securityworker stdout | 2024-04-22 03:34:56,901 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:34:56,901 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:34:56,901 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:34:56,901 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:34:56,901 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:34:56,902 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:34:56,902 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:34:56,902 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:34:56,903 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:34:56,903 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:26 UTC)" executed successfully
chunkcleanupworker stdout | 2024-04-22 03:34:58,492 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
teamsyncworker stdout | 2024-04-22 03:34:58,522 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:34:59,572 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:34:59,585 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:34:59,588 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:34:59,591 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:34:59,593 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:34:59,612 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:35:00,653 [278] [DEBUG] [app] Starting request: urn:request:2f11131e-7c65-4b39-a0da-5886a3f31bfb (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:35:00,653 [281] [DEBUG] [app] Starting request: urn:request:5bb2ab15-685f-402c-8530-c1760d520a80 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:35:00,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:35:00,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:35:00,658 [284] [DEBUG] [app] Starting request: urn:request:beeef3a7-fc71-49c8-84e2-d9a76ee3105b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:35:00,658 [289] [DEBUG] [app] Starting request: urn:request:033676f1-39fa-4c20-9650-cf1fe398cb41 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:35:00,659 [284] [DEBUG] [app] Ending request: urn:request:beeef3a7-fc71-49c8-84e2-d9a76ee3105b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:beeef3a7-fc71-49c8-84e2-d9a76ee3105b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:35:00,659 [289] [DEBUG] [app] Ending request: urn:request:033676f1-39fa-4c20-9650-cf1fe398cb41 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:033676f1-39fa-4c20-9650-cf1fe398cb41', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:35:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.003 162 0.004)
gunicorn-registry stdout | 2024-04-22 03:35:00,660 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:35:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:35:00,660 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:35:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:35:00,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:35:00,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:35:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.004 162 0.004)
gunicorn-web stdout | 2024-04-22 03:35:00,661 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:35:00,662 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:35:00,663 [282] [DEBUG] [app] Starting request: urn:request:a4cf03e0-9679-4fc7-888f-8cf0cbccd005 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:35:00,663 [282] [DEBUG] [app] Ending request: urn:request:a4cf03e0-9679-4fc7-888f-8cf0cbccd005 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a4cf03e0-9679-4fc7-888f-8cf0cbccd005', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:35:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:35:00,663 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:35:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:35:00,663 [279] [DEBUG] [app] Starting request: urn:request:5ba2e4a1-8ee1-4765-b3a4-8174a87ccd48 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:35:00,663 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:35:00,664 [279] [DEBUG] [app] Ending request: urn:request:5ba2e4a1-8ee1-4765-b3a4-8174a87ccd48 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:5ba2e4a1-8ee1-4765-b3a4-8174a87ccd48', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:35:00,664 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:35:00,664 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:35:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:35:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.001)
gunicorn-web stdout | 2024-04-22 03:35:00,664 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:35:00,664 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:35:00,670 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:35:00,670 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:35:00,678 [278] [DEBUG] [app] Ending request: urn:request:2f11131e-7c65-4b39-a0da-5886a3f31bfb (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2f11131e-7c65-4b39-a0da-5886a3f31bfb', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:35:00,678 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:35:00,678 [281] [DEBUG] [app] Ending request: urn:request:5bb2ab15-685f-402c-8530-c1760d520a80 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:5bb2ab15-685f-402c-8530-c1760d520a80', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:35:00,678 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:35:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:35:00,678 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:35:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:35:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
gunicorn-web stdout | 2024-04-22 03:35:00,678 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:35:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
notificationworker stdout | 2024-04-22 03:35:01,010 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:35:02,405 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
securityscanningnotificationworker stdout | 2024-04-22 03:35:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:35:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:16.552337+00:00 (in 13.995669 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:35:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:02 UTC)" (scheduled at 2024-04-22 03:35:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:35:02,556 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:35:02,556 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:02 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:35:02,677 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:35:02,696 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:35:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:35:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:13.759375+00:00 (in 9.999443 seconds)
notificationworker stdout | 2024-04-22 03:35:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:35:13 UTC)" (scheduled at 2024-04-22 03:35:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:35:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:35:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 35, 3, 760233), True, datetime.datetime(2024, 4, 22, 3, 35, 3, 760233), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:35:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:35:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:35:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:35:13 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 03:35:03,821 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-secscan stdout | 2024-04-22 03:35:04,183 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:35:04,186 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:35:04,188 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:35:04,978 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:35:05,125 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:35:05,334 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:35:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:35:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:26.873109+00:00 (in 21.000742 seconds)
securityworker stdout | 2024-04-22 03:35:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:35 UTC)" (scheduled at 2024-04-22 03:35:05.871852+00:00)
securityworker stdout | 2024-04-22 03:35:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:35:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:35:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:35:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:35:05,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:35:05,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:35:05,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:35 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:35:06,124 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
repositorygcworker stdout | 2024-04-22 03:35:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:35:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:13.555667+00:00 (in 7.002692 seconds)
repositorygcworker stdout | 2024-04-22 03:35:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:06 UTC)" (scheduled at 2024-04-22 03:35:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:35:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:35:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 35, 6, 553411), True, datetime.datetime(2024, 4, 22, 3, 35, 6, 553411), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:35:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:35:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:35:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:06 UTC)" executed successfully
securityworker stdout | 2024-04-22 03:35:07,522 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:35:07,619 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:35:08,037 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:35:08,189 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:35:09,225 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:35:10,364 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:35:10,369 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:35:10,371 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:35:10,374 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:35:10,376 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:35:10,380 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:35:10,382 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:35:10,385 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 03:35:10,387 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
autopruneworker stdout | 2024-04-22 03:35:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:35:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:41.264267+00:00 (in 29.999493 seconds)
autopruneworker stdout | 2024-04-22 03:35:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:41 UTC)" (scheduled at 2024-04-22 03:35:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:35:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713756851271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:35:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:35:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:35:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:35:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:35:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:06.552482+00:00 (in 52.996344 seconds)
repositorygcworker stdout | 2024-04-22 03:35:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:13 UTC)" (scheduled at 2024-04-22 03:35:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:35:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:35:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:35:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:35:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:19.762424+00:00 (in 6.002589 seconds)
notificationworker stdout | 2024-04-22 03:35:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:35:23 UTC)" (scheduled at 2024-04-22 03:35:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:35:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:35:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 35, 13, 760209), True, datetime.datetime(2024, 4, 22, 3, 35, 13, 760209), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:35:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:35:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:35:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:35:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:35:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:35:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:44.952062+00:00 (in 29.999567 seconds)
gcworker stdout | 2024-04-22 03:35:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:44 UTC)" (scheduled at 2024-04-22 03:35:14.952062+00:00)
gcworker stdout | 2024-04-22 03:35:14,952 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:35:14,952 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:35:15,653 [282] [DEBUG] [app] Starting request: urn:request:fa7a3e18-bfe2-4269-9e95-b909d8d78bec (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:35:15,653 [278] [DEBUG] [app] Starting request: urn:request:367f5d7f-66e2-4db5-aa90-40cce5d45bd5 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:35:15,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:35:15,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:35:15,656 [290] [DEBUG] [app] Starting request: urn:request:f8fa58cd-4665-4989-95b4-5514baf6f31e (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:35:15,657 [284] [DEBUG] [app] Starting request: urn:request:9c532159-adf3-4ec4-9e21-a50b803c483f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:35:15,657 [290] [DEBUG] [app] Ending request: urn:request:f8fa58cd-4665-4989-95b4-5514baf6f31e (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f8fa58cd-4665-4989-95b4-5514baf6f31e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:35:15,657 [284] [DEBUG] [app] Ending request: urn:request:9c532159-adf3-4ec4-9e21-a50b803c483f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:9c532159-adf3-4ec4-9e21-a50b803c483f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:35:15,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:35:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:35:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:35:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:35:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:35:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:35:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:35:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:35:15,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:35:15,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:35:15,660 [278] [DEBUG] [app] Starting request: urn:request:5eb61f6e-73ee-4a17-bb91-8519bf9376b5 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:35:15,660 [278] [DEBUG] [app] Ending request: urn:request:5eb61f6e-73ee-4a17-bb91-8519bf9376b5 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:5eb61f6e-73ee-4a17-bb91-8519bf9376b5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:35:15,660 [281] [DEBUG] [app] Starting request: urn:request:42a8c2f9-4632-4cf4-8a43-f7713c963966 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:35:15,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:35:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:35:15,661 [281] [DEBUG] [app] Ending request: urn:request:42a8c2f9-4632-4cf4-8a43-f7713c963966 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:42a8c2f9-4632-4cf4-8a43-f7713c963966', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:35:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:35:15,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:35:15,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:35:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:35:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:35:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:35:15,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:35:15,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:35:15,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:35:15,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:35:15,675 [278] [DEBUG] [app] Ending request: urn:request:367f5d7f-66e2-4db5-aa90-40cce5d45bd5 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:367f5d7f-66e2-4db5-aa90-40cce5d45bd5', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:35:15,675 [282] [DEBUG] [app] Ending request: urn:request:fa7a3e18-bfe2-4269-9e95-b909d8d78bec (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:fa7a3e18-bfe2-4269-9e95-b909d8d78bec', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:35:15,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:35:15,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:35:15,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:35:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:35:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:35:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:35:15,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:35:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
securityscanningnotificationworker stdout | 2024-04-22 03:35:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:35:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:02.556208+00:00 (in 46.003344 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:35:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:16 UTC)" (scheduled at 2024-04-22 03:35:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:35:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:35:16,553 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 35, 16, 553183), True, datetime.datetime(2024, 4, 22, 3, 35, 16, 553183), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:35:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:35:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:35:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:35:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:35:17,053 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:47.052354+00:00 (in 29.999209 seconds)
buildlogsarchiver stdout | 2024-04-22 03:35:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:47 UTC)" (scheduled at 2024-04-22 03:35:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:35:17,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 35, 17, 53547), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:35:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:35:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:35:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:35:18,358 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:35:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:35:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:23.759375+00:00 (in 3.996491 seconds)
notificationworker stdout | 2024-04-22 03:35:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:19 UTC)" (scheduled at 2024-04-22 03:35:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:35:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:35:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:35:20,058 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:35:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:35:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:43.057186+00:00 (in 20.997736 seconds)
namespacegcworker stdout | 2024-04-22 03:35:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:22 UTC)" (scheduled at 2024-04-22 03:35:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:35:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:35:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:22 UTC)" executed successfully
builder stdout | 2024-04-22 03:35:23,560 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
notificationworker stdout | 2024-04-22 03:35:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:35:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:33.759375+00:00 (in 9.999441 seconds)
notificationworker stdout | 2024-04-22 03:35:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:35:33 UTC)" (scheduled at 2024-04-22 03:35:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:35:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:35:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 35, 23, 760373), True, datetime.datetime(2024, 4, 22, 3, 35, 23, 760373), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:35:23,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:35:23,773 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:35:23,773 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:35:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 03:35:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:35:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:24.361582+00:00 (in 59.999499 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:35:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:24 UTC)" (scheduled at 2024-04-22 03:35:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:35:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:35:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:35:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:35:25,132 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 03:35:26,526 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
securityworker stdout | 2024-04-22 03:35:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:35:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:35.871852+00:00 (in 8.998287 seconds)
securityworker stdout | 2024-04-22 03:35:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:56 UTC)" (scheduled at 2024-04-22 03:35:26.873109+00:00)
securityworker stdout | 2024-04-22 03:35:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:35:26,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:35:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:35:26,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:35:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:35:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:35:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:35:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:35:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:35:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:35:26,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:35:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:35:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 30, 26, 881612), 1, 2])
securityworker stdout | 2024-04-22 03:35:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:35:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:35:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 30, 26, 881612), 1, 2])
securityworker stdout | 2024-04-22 03:35:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:35:26,900 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:35:26,900 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:35:26,900 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:35:26,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:35:26,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:35:26,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:35:26,901 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:35:26,901 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:35:26,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:35:56 UTC)" executed successfully
chunkcleanupworker stdout | 2024-04-22 03:35:28,527 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
teamsyncworker stdout | 2024-04-22 03:35:28,559 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:35:29,580 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:35:29,592 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:35:29,595 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:35:29,599 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:35:29,602 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:35:29,641 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:35:30,653 [278] [DEBUG] [app] Starting request: urn:request:442f7523-d5d7-431c-9106-932633a50d01 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:35:30,653 [281] [DEBUG] [app] Starting request: urn:request:d06c3a45-31a6-48df-aa59-f60175f87ce4 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:35:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:35:30,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:35:30,656 [284] [DEBUG] [app] Starting request: urn:request:85b27047-6976-4e8d-b7d0-010541018316 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:35:30,656 [292] [DEBUG] [app] Starting request: urn:request:05e9dba9-7ad3-4943-ad36-f2cd275d25fd (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:35:30,657 [284] [DEBUG] [app] Ending request: urn:request:85b27047-6976-4e8d-b7d0-010541018316 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:85b27047-6976-4e8d-b7d0-010541018316', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:35:30,657 [292] [DEBUG] [app] Ending request: urn:request:05e9dba9-7ad3-4943-ad36-f2cd275d25fd (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:05e9dba9-7ad3-4943-ad36-f2cd275d25fd', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:35:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:35:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:35:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:35:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:35:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:35:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:35:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:35:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:35:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:35:30,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:35:30,660 [278] [DEBUG] [app] Starting request: urn:request:aa99a7f1-39e3-4094-8a7f-90f8b4e9374b (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:35:30,660 [278] [DEBUG] [app] Ending request: urn:request:aa99a7f1-39e3-4094-8a7f-90f8b4e9374b (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:aa99a7f1-39e3-4094-8a7f-90f8b4e9374b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:35:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:35:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:35:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:35:30,660 [279] [DEBUG] [app] Starting request: urn:request:c000f626-af0b-46a1-bebc-5f16ab7788d2 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:35:30,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:35:30,661 [279] [DEBUG] [app] Ending request: urn:request:c000f626-af0b-46a1-bebc-5f16ab7788d2 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:c000f626-af0b-46a1-bebc-5f16ab7788d2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:35:30,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:35:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:35:30,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:35:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:35:30,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:35:30,662 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:35:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:35:30,668 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:35:30,675 [278] [DEBUG] [app] Ending request: urn:request:442f7523-d5d7-431c-9106-932633a50d01 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:442f7523-d5d7-431c-9106-932633a50d01', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:35:30,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:35:30,675 [281] [DEBUG] [app] Ending request: urn:request:d06c3a45-31a6-48df-aa59-f60175f87ce4 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:d06c3a45-31a6-48df-aa59-f60175f87ce4', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:35:30,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:35:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:35:30,675 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:35:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:35:30,676 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:35:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:35:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
notificationworker stdout | 2024-04-22 03:35:31,017 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:35:32,412 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:35:32,711 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:35:32,732 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:35:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:35:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:43.759375+00:00 (in 9.999491 seconds)
notificationworker stdout | 2024-04-22 03:35:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:35:43 UTC)" (scheduled at 2024-04-22 03:35:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:35:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:35:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 35, 33, 760272), True, datetime.datetime(2024, 4, 22, 3, 35, 33, 760272), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:35:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:35:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:35:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:35:43 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 03:35:33,858 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-secscan stdout | 2024-04-22 03:35:34,191 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:35:34,193 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:35:34,196 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:35:35,011 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:35:35,162 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:35:35,371 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:35:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:35:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:56.873109+00:00 (in 21.000770 seconds)
securityworker stdout | 2024-04-22 03:35:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:05 UTC)" (scheduled at 2024-04-22 03:35:35.871852+00:00)
securityworker stdout | 2024-04-22 03:35:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:35:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:35:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:35:35,877 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:35:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:35:35,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:35:35,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:05 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:35:36,160 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:35:37,559 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:35:37,626 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:35:38,046 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:35:38,226 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:35:39,262 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
exportactionlogsworker stdout | 2024-04-22 03:35:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:35:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:41.564959+00:00 (in 1.997542 seconds)
exportactionlogsworker stdout | 2024-04-22 03:35:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:39 UTC)" (scheduled at 2024-04-22 03:35:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:35:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:35:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:39 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 03:35:40,376 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:35:40,379 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:35:40,381 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:35:40,384 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:35:40,388 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:35:40,392 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:35:40,395 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:35:40,399 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 03:35:40,402 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
autopruneworker stdout | 2024-04-22 03:35:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:35:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:11.264267+00:00 (in 29.999400 seconds)
autopruneworker stdout | 2024-04-22 03:35:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:11 UTC)" (scheduled at 2024-04-22 03:35:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:35:41,273 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713756881272, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:35:41,277 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:35:41,277 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:35:41,277 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:35:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:35:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:39.566970+00:00 (in 58.001544 seconds)
exportactionlogsworker stdout | 2024-04-22 03:35:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:41 UTC)" (scheduled at 2024-04-22 03:35:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:35:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:35:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 35, 41, 565700), True, datetime.datetime(2024, 4, 22, 3, 35, 41, 565700), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:35:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:35:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:35:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:35:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:35:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:22.058978+00:00 (in 39.001330 seconds)
namespacegcworker stdout | 2024-04-22 03:35:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:43 UTC)" (scheduled at 2024-04-22 03:35:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:35:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:35:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 35, 43, 57910), True, datetime.datetime(2024, 4, 22, 3, 35, 43, 57910), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:35:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:35:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:35:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:36:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:35:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:35:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:35:53.759375+00:00 (in 9.999471 seconds)
notificationworker stdout | 2024-04-22 03:35:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:35:53 UTC)" (scheduled at 2024-04-22 03:35:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:35:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:35:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 35, 43, 760534), True, datetime.datetime(2024, 4, 22, 3, 35, 43, 760534), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:35:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:35:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:35:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:35:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:35:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:35:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:14.952062+00:00 (in 29.999538 seconds)
gcworker stdout | 2024-04-22 03:35:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:14 UTC)" (scheduled at 2024-04-22 03:35:44.952062+00:00)
gcworker stdout | 2024-04-22 03:35:44,952 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:35:44,952 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:35:45,653 [282] [DEBUG] [app] Starting request: urn:request:0bb6b544-0a15-4519-9513-49c060357489 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:35:45,653 [279] [DEBUG] [app] Starting request: urn:request:44fddcd8-2fdf-4a15-9bfa-2aeb0ab3a0aa (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:35:45,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:35:45,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:35:45,656 [284] [DEBUG] [app] Starting request: urn:request:b5512c1c-5137-4687-957f-eec341ed54cf (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:35:45,657 [292] [DEBUG] [app] Starting request: urn:request:836545ec-8c7f-4c3a-a305-f14f2f267e33 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:35:45,657 [284] [DEBUG] [app] Ending request: urn:request:b5512c1c-5137-4687-957f-eec341ed54cf (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b5512c1c-5137-4687-957f-eec341ed54cf', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:35:45,657 [292] [DEBUG] [app] Ending request: urn:request:836545ec-8c7f-4c3a-a305-f14f2f267e33 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:836545ec-8c7f-4c3a-a305-f14f2f267e33', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:35:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:35:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:35:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:35:45,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:35:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:35:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:35:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:35:45,658 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:35:45,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:35:45,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:35:45,660 [282] [DEBUG] [app] Starting request: urn:request:9767c05d-8d84-45d0-b406-5b5486fce3f6 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:35:45,660 [282] [DEBUG] [app] Ending request: urn:request:9767c05d-8d84-45d0-b406-5b5486fce3f6 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9767c05d-8d84-45d0-b406-5b5486fce3f6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:35:45,660 [279] [DEBUG] [app] Starting request: urn:request:da3358ff-3bef-4da9-84a4-d75c429861c0 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:35:45,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:35:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:35:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 03:35:45,661 [279] [DEBUG] [app] Ending request: urn:request:da3358ff-3bef-4da9-84a4-d75c429861c0 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:da3358ff-3bef-4da9-84a4-d75c429861c0', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:35:45,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:35:45,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:35:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:35:45,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:35:45,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:35:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:35:45,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:35:45,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:35:45,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:35:45,675 [282] [DEBUG] [app] Ending request: urn:request:0bb6b544-0a15-4519-9513-49c060357489 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:0bb6b544-0a15-4519-9513-49c060357489', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:35:45,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:35:45,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:35:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:35:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:35:45,676 [279] [DEBUG] [app] Ending request: urn:request:44fddcd8-2fdf-4a15-9bfa-2aeb0ab3a0aa (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:44fddcd8-2fdf-4a15-9bfa-2aeb0ab3a0aa', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:35:45,676 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:35:45,676 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:35:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:35:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
buildlogsarchiver stdout | 2024-04-22 03:35:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:35:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:17.052354+00:00 (in 29.999513 seconds)
buildlogsarchiver stdout | 2024-04-22 03:35:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:17 UTC)" (scheduled at 2024-04-22 03:35:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:35:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 35, 47, 53182), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:35:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:35:47,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:35:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:35:48,365 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:35:50,095 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
builder stdout | 2024-04-22 03:35:53,569 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
notificationworker stdout | 2024-04-22 03:35:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:35:53,760 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:03.759375+00:00 (in 9.999366 seconds)
notificationworker stdout | 2024-04-22 03:35:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:36:03 UTC)" (scheduled at 2024-04-22 03:35:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:35:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:35:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 35, 53, 760391), True, datetime.datetime(2024, 4, 22, 3, 35, 53, 760391), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:35:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:35:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:35:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:36:03 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:35:55,168 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 03:35:56,533 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
securityworker stdout | 2024-04-22 03:35:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:35:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:05.871852+00:00 (in 8.998269 seconds)
securityworker stdout | 2024-04-22 03:35:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:26 UTC)" (scheduled at 2024-04-22 03:35:56.873109+00:00)
securityworker stdout | 2024-04-22 03:35:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:35:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:35:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:35:56,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:35:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:35:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:35:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:35:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:35:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:35:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:35:56,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:35:56,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:35:56,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 30, 56, 881189), 1, 2])
securityworker stdout | 2024-04-22 03:35:56,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:35:56,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:35:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 30, 56, 881189), 1, 2])
securityworker stdout | 2024-04-22 03:35:56,900 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:35:56,900 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:35:56,900 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:35:56,900 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:35:56,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:35:56,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:35:56,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:35:56,901 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:35:56,901 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:35:56,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:26 UTC)" executed successfully
chunkcleanupworker stdout | 2024-04-22 03:35:58,558 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
teamsyncworker stdout | 2024-04-22 03:35:58,565 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:35:59,589 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:35:59,600 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:35:59,603 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:35:59,608 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:35:59,612 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:35:59,677 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:36:00,653 [279] [DEBUG] [app] Starting request: urn:request:bbd34d67-da70-4c3f-968b-e562ce4d238a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:36:00,653 [278] [DEBUG] [app] Starting request: urn:request:ae8314e1-1c10-4704-bed6-89eb39357cff (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:36:00,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:36:00,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:36:00,656 [284] [DEBUG] [app] Starting request: urn:request:6cd0dd64-cbe6-4e10-95b2-efbf90eef0e5 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:36:00,656 [291] [DEBUG] [app] Starting request: urn:request:28cf7d87-a1bb-4afd-9bc5-f7f3af6fa0dd (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:36:00,657 [284] [DEBUG] [app] Ending request: urn:request:6cd0dd64-cbe6-4e10-95b2-efbf90eef0e5 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:6cd0dd64-cbe6-4e10-95b2-efbf90eef0e5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:36:00,657 [291] [DEBUG] [app] Ending request: urn:request:28cf7d87-a1bb-4afd-9bc5-f7f3af6fa0dd (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:28cf7d87-a1bb-4afd-9bc5-f7f3af6fa0dd', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:36:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:36:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:36:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:36:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:36:00,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:36:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:36:00,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:36:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:36:00,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:36:00,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:36:00,660 [279] [DEBUG] [app] Starting request: urn:request:8dd64209-53b9-499b-ae05-46aac9bebfed (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:36:00,660 [279] [DEBUG] [app] Ending request: urn:request:8dd64209-53b9-499b-ae05-46aac9bebfed (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:8dd64209-53b9-499b-ae05-46aac9bebfed', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:36:00,660 [282] [DEBUG] [app] Starting request: urn:request:18603f52-02c0-48f3-a254-7c5bdacc38d3 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:36:00,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:36:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:36:00,661 [282] [DEBUG] [app] Ending request: urn:request:18603f52-02c0-48f3-a254-7c5bdacc38d3 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:18603f52-02c0-48f3-a254-7c5bdacc38d3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:36:00,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:36:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:36:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:36:00,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:36:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:36:00,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:36:00,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:36:00,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:36:00,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:36:00,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:36:00,676 [279] [DEBUG] [app] Ending request: urn:request:bbd34d67-da70-4c3f-968b-e562ce4d238a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:bbd34d67-da70-4c3f-968b-e562ce4d238a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:36:00,676 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:36:00,676 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:36:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:36:00,676 [278] [DEBUG] [app] Ending request: urn:request:ae8314e1-1c10-4704-bed6-89eb39357cff (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:ae8314e1-1c10-4704-bed6-89eb39357cff', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:36:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:36:00,676 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:36:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
gunicorn-web stdout | 2024-04-22 03:36:00,677 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:36:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
notificationworker stdout | 2024-04-22 03:36:01,053 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:36:02,423 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
securityscanningnotificationworker stdout | 2024-04-22 03:36:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:36:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:16.552337+00:00 (in 13.995620 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:36:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:02 UTC)" (scheduled at 2024-04-22 03:36:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:36:02,556 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:36:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:02 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:36:02,736 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:36:02,768 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:36:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:36:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:13.759375+00:00 (in 9.999479 seconds)
notificationworker stdout | 2024-04-22 03:36:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:36:13 UTC)" (scheduled at 2024-04-22 03:36:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:36:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:36:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 36, 3, 760140), True, datetime.datetime(2024, 4, 22, 3, 36, 3, 760140), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:36:03,780 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:36:03,780 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:36:03,780 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:36:13 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 03:36:03,894 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-secscan stdout | 2024-04-22 03:36:04,199 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:36:04,203 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:36:04,208 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:36:05,048 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:36:05,199 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:36:05,407 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:36:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:36:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:26.873109+00:00 (in 21.000728 seconds)
securityworker stdout | 2024-04-22 03:36:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:35 UTC)" (scheduled at 2024-04-22 03:36:05.871852+00:00)
securityworker stdout | 2024-04-22 03:36:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:36:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:36:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:36:05,877 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:36:05,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:36:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:36:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:35 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:36:06,197 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
repositorygcworker stdout | 2024-04-22 03:36:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:36:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:13.555667+00:00 (in 7.002705 seconds)
repositorygcworker stdout | 2024-04-22 03:36:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:06 UTC)" (scheduled at 2024-04-22 03:36:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:36:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:36:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 36, 6, 553345), True, datetime.datetime(2024, 4, 22, 3, 36, 6, 553345), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:36:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:36:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:36:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:06 UTC)" executed successfully
securityworker stdout | 2024-04-22 03:36:07,596 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:36:07,662 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:36:08,081 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:36:08,262 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:36:09,292 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:36:10,386 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:36:10,389 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:36:10,391 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:36:10,394 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:36:10,397 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:36:10,404 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:36:10,407 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:36:10,410 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 03:36:10,412 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
autopruneworker stdout | 2024-04-22 03:36:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:36:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:41.264267+00:00 (in 29.999466 seconds)
autopruneworker stdout | 2024-04-22 03:36:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:41 UTC)" (scheduled at 2024-04-22 03:36:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:36:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713756911271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:36:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:36:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:36:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:36:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:36:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:51.555445+00:00 (in 37.999285 seconds)
repositorygcworker stdout | 2024-04-22 03:36:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:13 UTC)" (scheduled at 2024-04-22 03:36:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:36:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:36:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:36:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:36:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:19.762424+00:00 (in 6.002594 seconds)
notificationworker stdout | 2024-04-22 03:36:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:36:23 UTC)" (scheduled at 2024-04-22 03:36:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:36:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:36:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 36, 13, 760099), True, datetime.datetime(2024, 4, 22, 3, 36, 13, 760099), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:36:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:36:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:36:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:36:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:36:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:36:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:44.952062+00:00 (in 29.999408 seconds)
gcworker stdout | 2024-04-22 03:36:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:44 UTC)" (scheduled at 2024-04-22 03:36:14.952062+00:00)
gcworker stdout | 2024-04-22 03:36:14,953 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:36:14,953 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:36:15,652 [281] [DEBUG] [app] Starting request: urn:request:d288aedf-f54f-4d6a-8e32-175376b715b3 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:36:15,652 [279] [DEBUG] [app] Starting request: urn:request:1b57e970-b761-4b6d-a653-964985b76656 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:36:15,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:36:15,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:36:15,656 [292] [DEBUG] [app] Starting request: urn:request:dabbc0b6-a925-4033-85ef-8a919fa92d68 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:36:15,656 [292] [DEBUG] [app] Ending request: urn:request:dabbc0b6-a925-4033-85ef-8a919fa92d68 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:dabbc0b6-a925-4033-85ef-8a919fa92d68', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:36:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:36:15,656 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:36:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:36:15,656 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 03:36:15,657 [285] [DEBUG] [app] Starting request: urn:request:bf5c7841-3b47-46bb-9afd-6b93794a1056 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:36:15,657 [285] [DEBUG] [app] Ending request: urn:request:bf5c7841-3b47-46bb-9afd-6b93794a1056 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:bf5c7841-3b47-46bb-9afd-6b93794a1056', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:36:15,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:36:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.003 162 0.003)
gunicorn-registry stdout | 2024-04-22 03:36:15,658 [285] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:36:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:36:15,658 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:36:15,659 [282] [DEBUG] [app] Starting request: urn:request:6385181d-fa15-472e-bdc2-3de5fd714740 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:36:15,659 [282] [DEBUG] [app] Ending request: urn:request:6385181d-fa15-472e-bdc2-3de5fd714740 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:6385181d-fa15-472e-bdc2-3de5fd714740', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:36:15,660 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:36:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:36:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:36:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:36:15,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:36:15,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:36:15,661 [282] [DEBUG] [app] Starting request: urn:request:10ef26db-205e-4ad5-9da5-596ccb4aa443 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:36:15,661 [282] [DEBUG] [app] Ending request: urn:request:10ef26db-205e-4ad5-9da5-596ccb4aa443 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:10ef26db-205e-4ad5-9da5-596ccb4aa443', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:36:15,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:36:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:36:15,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:36:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:36:15,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:36:15,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:36:15,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:36:15,674 [281] [DEBUG] [app] Ending request: urn:request:d288aedf-f54f-4d6a-8e32-175376b715b3 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:d288aedf-f54f-4d6a-8e32-175376b715b3', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:36:15,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:36:15,674 [279] [DEBUG] [app] Ending request: urn:request:1b57e970-b761-4b6d-a653-964985b76656 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:1b57e970-b761-4b6d-a653-964985b76656', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:36:15,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:36:15,674 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:36:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:36:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:36:15,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:36:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:36:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.023)
securityscanningnotificationworker stdout | 2024-04-22 03:36:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:36:16,553 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:02.556208+00:00 (in 46.003204 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:36:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:16 UTC)" (scheduled at 2024-04-22 03:36:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:36:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:36:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 36, 16, 553320), True, datetime.datetime(2024, 4, 22, 3, 36, 16, 553320), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:36:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:36:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:36:16,565 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:36:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:36:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:47.052354+00:00 (in 29.999453 seconds)
buildlogsarchiver stdout | 2024-04-22 03:36:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:47 UTC)" (scheduled at 2024-04-22 03:36:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:36:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 36, 17, 53249), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:36:17,067 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:36:17,068 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:36:17,068 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:36:18,402 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:36:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:36:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:23.759375+00:00 (in 3.996421 seconds)
notificationworker stdout | 2024-04-22 03:36:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:19 UTC)" (scheduled at 2024-04-22 03:36:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:36:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:36:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:36:20,131 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:36:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:36:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:43.057186+00:00 (in 20.997711 seconds)
namespacegcworker stdout | 2024-04-22 03:36:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:22 UTC)" (scheduled at 2024-04-22 03:36:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:36:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:36:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:22 UTC)" executed successfully
builder stdout | 2024-04-22 03:36:23,600 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
notificationworker stdout | 2024-04-22 03:36:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:36:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:33.759375+00:00 (in 9.999468 seconds)
notificationworker stdout | 2024-04-22 03:36:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:36:33 UTC)" (scheduled at 2024-04-22 03:36:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:36:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:36:23,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 36, 23, 760168), True, datetime.datetime(2024, 4, 22, 3, 36, 23, 760168), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:36:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:36:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:36:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:36:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 03:36:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:36:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:24.361582+00:00 (in 59.999473 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:36:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:24 UTC)" (scheduled at 2024-04-22 03:36:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:36:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:36:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:36:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:36:25,204 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 03:36:26,564 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
securityworker stdout | 2024-04-22 03:36:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:36:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:35.871852+00:00 (in 8.998210 seconds)
securityworker stdout | 2024-04-22 03:36:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:56 UTC)" (scheduled at 2024-04-22 03:36:26.873109+00:00)
securityworker stdout | 2024-04-22 03:36:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:36:26,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:36:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:36:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:36:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:36:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:36:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:36:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:36:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:36:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:36:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:36:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:36:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 31, 26, 881364), 1, 2])
securityworker stdout | 2024-04-22 03:36:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:36:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:36:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 31, 26, 881364), 1, 2])
securityworker stdout | 2024-04-22 03:36:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:36:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:36:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:36:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:36:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:36:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:36:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:36:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:36:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:36:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:36:56 UTC)" executed successfully
chunkcleanupworker stdout | 2024-04-22 03:36:28,595 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
teamsyncworker stdout | 2024-04-22 03:36:28,597 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:36:29,597 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:36:29,608 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:36:29,611 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:36:29,614 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:36:29,619 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:36:29,707 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:36:30,653 [278] [DEBUG] [app] Starting request: urn:request:e45bc62d-f40f-420f-9dc6-d1e095ecc2db (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:36:30,653 [281] [DEBUG] [app] Starting request: urn:request:14957286-1f74-4f6e-ad1e-56c4ad72a5ba (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:36:30,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:36:30,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:36:30,656 [291] [DEBUG] [app] Starting request: urn:request:743eae80-a7ec-42da-8c02-7bfaf2d10b23 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:36:30,657 [291] [DEBUG] [app] Ending request: urn:request:743eae80-a7ec-42da-8c02-7bfaf2d10b23 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:743eae80-a7ec-42da-8c02-7bfaf2d10b23', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:36:30,657 [284] [DEBUG] [app] Starting request: urn:request:71dda9e4-d4f9-48c8-8e4b-ece0e02f439a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:36:30,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:36:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:36:30,657 [284] [DEBUG] [app] Ending request: urn:request:71dda9e4-d4f9-48c8-8e4b-ece0e02f439a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:71dda9e4-d4f9-48c8-8e4b-ece0e02f439a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:36:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:36:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 03:36:30,658 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:36:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:36:30,658 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:36:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:36:30,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:36:30,660 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:36:30,660 [279] [DEBUG] [app] Starting request: urn:request:fd3b5d90-28a7-4749-842a-28298c1bc51c (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:36:30,661 [279] [DEBUG] [app] Ending request: urn:request:fd3b5d90-28a7-4749-842a-28298c1bc51c (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:fd3b5d90-28a7-4749-842a-28298c1bc51c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:36:30,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:36:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:36:30,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:36:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:36:30,661 [282] [DEBUG] [app] Starting request: urn:request:da7ca97e-06df-4486-856b-c1ea91b0cbe2 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:36:30,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:36:30,662 [282] [DEBUG] [app] Ending request: urn:request:da7ca97e-06df-4486-856b-c1ea91b0cbe2 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:da7ca97e-06df-4486-856b-c1ea91b0cbe2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:36:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:36:30,662 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:36:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:36:30,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:36:30,663 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:36:30,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:36:30,669 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:36:30,676 [281] [DEBUG] [app] Ending request: urn:request:14957286-1f74-4f6e-ad1e-56c4ad72a5ba (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:14957286-1f74-4f6e-ad1e-56c4ad72a5ba', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:36:30,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:36:30,676 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:36:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:36:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:36:30,677 [278] [DEBUG] [app] Ending request: urn:request:e45bc62d-f40f-420f-9dc6-d1e095ecc2db (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e45bc62d-f40f-420f-9dc6-d1e095ecc2db', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:36:30,677 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:36:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
gunicorn-web stdout | 2024-04-22 03:36:30,678 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:36:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
notificationworker stdout | 2024-04-22 03:36:31,089 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:36:32,456 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:36:32,768 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:36:32,803 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:36:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:36:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:43.759375+00:00 (in 9.999506 seconds)
notificationworker stdout | 2024-04-22 03:36:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:36:43 UTC)" (scheduled at 2024-04-22 03:36:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:36:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:36:33,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 36, 33, 760153), True, datetime.datetime(2024, 4, 22, 3, 36, 33, 760153), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:36:33,781 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:36:33,781 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:36:33,781 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:36:43 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 03:36:33,931 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-secscan stdout | 2024-04-22 03:36:34,208 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:36:34,210 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:36:34,214 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:36:35,084 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:36:35,206 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:36:35,415 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:36:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:36:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:56.873109+00:00 (in 21.000726 seconds)
securityworker stdout | 2024-04-22 03:36:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:05 UTC)" (scheduled at 2024-04-22 03:36:35.871852+00:00)
securityworker stdout | 2024-04-22 03:36:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:36:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:36:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:36:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:36:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:36:35,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:36:35,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:05 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:36:36,233 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:36:37,613 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:36:37,698 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:36:38,119 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:36:38,296 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:36:39,306 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
exportactionlogsworker stdout | 2024-04-22 03:36:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:36:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:41.564959+00:00 (in 1.997498 seconds)
exportactionlogsworker stdout | 2024-04-22 03:36:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:39 UTC)" (scheduled at 2024-04-22 03:36:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:36:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:36:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:39 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 03:36:40,395 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:36:40,399 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:36:40,403 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:36:40,406 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:36:40,408 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:36:40,413 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:36:40,416 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:36:40,419 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 03:36:40,421 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
autopruneworker stdout | 2024-04-22 03:36:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:36:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:11.264267+00:00 (in 29.999447 seconds)
autopruneworker stdout | 2024-04-22 03:36:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:11 UTC)" (scheduled at 2024-04-22 03:36:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:36:41,273 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713756941272, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:36:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:36:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:36:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:36:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:36:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:53.566665+00:00 (in 12.001210 seconds)
exportactionlogsworker stdout | 2024-04-22 03:36:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:41 UTC)" (scheduled at 2024-04-22 03:36:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:36:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:36:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 36, 41, 565894), True, datetime.datetime(2024, 4, 22, 3, 36, 41, 565894), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:36:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:36:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:36:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:36:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:36:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:22.058978+00:00 (in 39.001263 seconds)
namespacegcworker stdout | 2024-04-22 03:36:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:43 UTC)" (scheduled at 2024-04-22 03:36:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:36:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:36:43,059 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 36, 43, 58187), True, datetime.datetime(2024, 4, 22, 3, 36, 43, 58187), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:36:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:36:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:36:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:37:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:36:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:36:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:36:53.759375+00:00 (in 9.999503 seconds)
notificationworker stdout | 2024-04-22 03:36:43,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:36:53 UTC)" (scheduled at 2024-04-22 03:36:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:36:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:36:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 36, 43, 760108), True, datetime.datetime(2024, 4, 22, 3, 36, 43, 760108), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:36:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:36:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:36:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:36:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:36:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:36:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:14.952062+00:00 (in 29.999478 seconds)
gcworker stdout | 2024-04-22 03:36:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:14 UTC)" (scheduled at 2024-04-22 03:36:44.952062+00:00)
gcworker stdout | 2024-04-22 03:36:44,953 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:36:44,953 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:36:45,652 [282] [DEBUG] [app] Starting request: urn:request:c31b5032-4013-47f8-8fcf-52829199f92c (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:36:45,652 [281] [DEBUG] [app] Starting request: urn:request:2a39c68c-451d-494a-ac15-4a10bf459b89 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:36:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:36:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:36:45,656 [291] [DEBUG] [app] Starting request: urn:request:706924fb-f0f3-44f0-8e3a-f76aa40dcf7b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:36:45,656 [289] [DEBUG] [app] Starting request: urn:request:672c2644-0e18-4032-9d44-9bf6e4688cde (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:36:45,656 [291] [DEBUG] [app] Ending request: urn:request:706924fb-f0f3-44f0-8e3a-f76aa40dcf7b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:706924fb-f0f3-44f0-8e3a-f76aa40dcf7b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:36:45,656 [289] [DEBUG] [app] Ending request: urn:request:672c2644-0e18-4032-9d44-9bf6e4688cde (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:672c2644-0e18-4032-9d44-9bf6e4688cde', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:36:45,656 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:36:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:36:45,656 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:36:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:36:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:36:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:36:45,656 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:36:45,656 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:36:45,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:36:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:36:45,659 [279] [DEBUG] [app] Starting request: urn:request:d941b29c-75e1-4378-a444-c92dd0ae8cef (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:36:45,659 [278] [DEBUG] [app] Starting request: urn:request:100aaff9-1800-48ff-8d4e-44b443f2235d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:36:45,659 [279] [DEBUG] [app] Ending request: urn:request:d941b29c-75e1-4378-a444-c92dd0ae8cef (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d941b29c-75e1-4378-a444-c92dd0ae8cef', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:36:45,659 [278] [DEBUG] [app] Ending request: urn:request:100aaff9-1800-48ff-8d4e-44b443f2235d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:100aaff9-1800-48ff-8d4e-44b443f2235d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:36:45,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:36:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:36:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:36:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:36:45,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:36:45,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:36:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:36:45,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:36:45,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:36:45,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:36:45,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:36:45,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:36:45,674 [281] [DEBUG] [app] Ending request: urn:request:2a39c68c-451d-494a-ac15-4a10bf459b89 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2a39c68c-451d-494a-ac15-4a10bf459b89', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:36:45,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:36:45,674 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:36:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:36:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.022)
gunicorn-web stdout | 2024-04-22 03:36:45,675 [282] [DEBUG] [app] Ending request: urn:request:c31b5032-4013-47f8-8fcf-52829199f92c (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:c31b5032-4013-47f8-8fcf-52829199f92c', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:36:45,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:36:45,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:36:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:36:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.023)
buildlogsarchiver stdout | 2024-04-22 03:36:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:36:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:17.052354+00:00 (in 29.999493 seconds)
buildlogsarchiver stdout | 2024-04-22 03:36:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:17 UTC)" (scheduled at 2024-04-22 03:36:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:36:47,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 36, 47, 53253), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:36:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:36:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:36:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:36:48,432 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:36:50,168 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
repositorygcworker stdout | 2024-04-22 03:36:51,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:36:51,555 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:06.552482+00:00 (in 14.996529 seconds)
repositorygcworker stdout | 2024-04-22 03:36:51,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:41:51 UTC)" (scheduled at 2024-04-22 03:36:51.555445+00:00)
repositorygcworker stdout | 2024-04-22 03:36:51,556 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 36, 51, 556340), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 03:36:51,567 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 36, 51, 556340), True, datetime.datetime(2024, 4, 22, 3, 36, 51, 556340), 0, 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 03:36:51,570 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 36, 51, 556340), True, datetime.datetime(2024, 4, 22, 3, 36, 51, 556340), 0, 'repositorygc/%', False, datetime.datetime(2024, 4, 22, 3, 36, 51, 556340), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 03:36:51,572 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:36:51,572 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:41:51 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:36:53,093 [279] [DEBUG] [app] Starting request: urn:request:0edc3db7-1e78-4930-925b-fbb5b1a32311 (/api/v1/user/initialize) {'X-Forwarded-For': '123.123.45.4, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 03:36:53,094 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:36:53,107 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) OR ("t1"."email" = %s)) LIMIT %s OFFSET %s', ['whuquay', 'quay+test@redhat.com', 1, 0])
gunicorn-web stdout | 2024-04-22 03:36:53,109 [279] [DEBUG] [data.model.user] Email and username are unique!
gunicorn-web stdout | 2024-04-22 03:36:53,110 [279] [DEBUG] [peewee] ('INSERT INTO "user" ("uuid", "username", "email", "verified", "organization", "robot", "invoice_email", "invalid_login_attempts", "last_invalid_login", "removed_tag_expiration_s", "enabled", "maximum_queued_builds_count", "creation_date") VALUES (%s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s) RETURNING "user"."id"', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', 'whuquay', 'quay+test@redhat.com', False, False, False, False, 0, datetime.datetime(2024, 4, 22, 3, 36, 53, 110242), 1209600, True, None, datetime.datetime(2024, 4, 22, 3, 36, 53, 110248)])
gunicorn-web stdout | 2024-04-22 03:36:53,352 [279] [DEBUG] [peewee] ('UPDATE "user" SET "uuid" = %s, "username" = %s, "password_hash" = %s, "email" = %s, "verified" = %s, "organization" = %s, "robot" = %s, "invoice_email" = %s, "invalid_login_attempts" = %s, "last_invalid_login" = %s, "removed_tag_expiration_s" = %s, "enabled" = %s, "maximum_queued_builds_count" = %s, "creation_date" = %s WHERE ("user"."id" = %s)', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', 'whuquay', '$2b$12$P7Hw.K7b5oixIIFbsTJdQuZRZLFV6L5NxVblLrzSGwcxGSgtBPUHy', 'quay+test@redhat.com', True, False, False, False, 0, datetime.datetime(2024, 4, 22, 3, 36, 53, 110242), 1209600, True, None, datetime.datetime(2024, 4, 22, 3, 36, 53, 110248), 1])
gunicorn-web stdout | 2024-04-22 03:36:53,359 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 03:36:53,362 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 03:36:53,364 [279] [DEBUG] [endpoints.common] Successfully signed in as user whuquay with uuid a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 03:36:53,365 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 03:36:53,365 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 03:36:53,367 [279] [DEBUG] [peewee] ('INSERT INTO "oauthapplication" ("client_id", "secure_client_secret", "fully_migrated", "redirect_uri", "application_uri", "organization_id", "name", "description") VALUES (%s, %s, %s, %s, %s, %s, %s, %s) RETURNING "oauthapplication"."id"', ['whuquay', 'v0$$kFGIM9H7kf+Rl3MKn5Tbi+HIHVMsPRKcEDGed5rSoYNaBnhBZhbEec17PUnoXXQhTEuHnhY1P5WQ5jrz/J3UaL7fKfO6', False, '', '', 1, 'automation', 'Application token generated via /api/v1/user/initialize'])
gunicorn-web stdout | 2024-04-22 03:36:53,374 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."client_id", "t1"."secure_client_secret", "t1"."fully_migrated", "t1"."redirect_uri", "t1"."application_uri", "t1"."organization_id", "t1"."name", "t1"."description", "t1"."gravatar_email" FROM "oauthapplication" AS "t1" WHERE ("t1"."client_id" = %s) LIMIT %s OFFSET %s', ['whuquay', 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:36:53,566 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:36:53,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:39.566970+00:00 (in 45.999830 seconds)
exportactionlogsworker stdout | 2024-04-22 03:36:53,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:41:53 UTC)" (scheduled at 2024-04-22 03:36:53.566665+00:00)
exportactionlogsworker stdout | 2024-04-22 03:36:53,568 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 36, 53, 567494), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 03:36:53,577 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 36, 53, 567494), True, datetime.datetime(2024, 4, 22, 3, 36, 53, 567494), 0, 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 03:36:53,580 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 36, 53, 567494), True, datetime.datetime(2024, 4, 22, 3, 36, 53, 567494), 0, 'exportactionlogs/%', False, datetime.datetime(2024, 4, 22, 3, 36, 53, 567494), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 03:36:53,582 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:36:53,582 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:41:53 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:36:53,611 [279] [DEBUG] [peewee] ('INSERT INTO "oauthaccesstoken" ("uuid", "application_id", "authorized_user_id", "scope", "token_name", "token_code", "token_type", "expires_at", "data") VALUES (%s, %s, %s, %s, %s, %s, %s, %s, %s) RETURNING "oauthaccesstoken"."id"', ['4efe41d5-76c7-47ed-90e9-55c22c47da77', 1, 1, 'org:admin repo:admin repo:create repo:read repo:write super:user user:admin user:read', 'FUD2SYBDHOTT8HSMHW0G', '$2b$12$SzHDgJ9N3/8ZOyp8Gd4mq.M7CdxYwNQpUaUwKqU2L1lh4RimPu6l6', 'token', datetime.datetime(2024, 4, 22, 6, 6, 53, 374136), ''])
gunicorn-web stdout | 2024-04-22 03:36:53,617 [279] [DEBUG] [app] Ending request: urn:request:0edc3db7-1e78-4930-925b-fbb5b1a32311 (/api/v1/user/initialize) {'endpoint': 'web.user_initialize', 'request_id': 'urn:request:0edc3db7-1e78-4930-925b-fbb5b1a32311', 'remote_addr': '10.128.2.8', 'http_method': 'POST', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/initialize', 'path': '/api/v1/user/initialize', 'parameters': {}, 'json_body': {'username': 'whuquay', 'password': '[FILTERED]', 'email': 'quay+test@redhat.com', 'access_token': True}, 'confsha': '38f2adc2', 'user-agent': 'curl/8.4.0'}
gunicorn-web stdout | 2024-04-22 03:36:53,618 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:36:53,619 [279] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:03:36:53 +0000] "POST /api/v1/user/initialize HTTP/1.0" 200 200 "-" "curl/8.4.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:03:36:53 +0000] "POST /api/v1/user/initialize HTTP/1.1" 200 200 "-" "curl/8.4.0" (0.527 635 0.526)
builder stdout | 2024-04-22 03:36:53,622 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
notificationworker stdout | 2024-04-22 03:36:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:36:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:03.759375+00:00 (in 9.999489 seconds)
notificationworker stdout | 2024-04-22 03:36:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:37:03 UTC)" (scheduled at 2024-04-22 03:36:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:36:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:36:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 36, 53, 760227), True, datetime.datetime(2024, 4, 22, 3, 36, 53, 760227), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:36:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:36:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:36:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:37:03 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:36:55,229 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 03:36:56,599 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
securityworker stdout | 2024-04-22 03:36:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:36:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:05.871852+00:00 (in 8.998219 seconds)
securityworker stdout | 2024-04-22 03:36:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:26 UTC)" (scheduled at 2024-04-22 03:36:56.873109+00:00)
securityworker stdout | 2024-04-22 03:36:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:36:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:36:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:36:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:36:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:36:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:36:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:36:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:36:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:36:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:36:56,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:36:56,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:36:56,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 31, 56, 881484), 1, 2])
securityworker stdout | 2024-04-22 03:36:56,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:36:56,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:36:56,898 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 31, 56, 881484), 1, 2])
securityworker stdout | 2024-04-22 03:36:56,900 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:36:56,900 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:36:56,900 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:36:56,900 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:36:56,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:36:56,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:36:56,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:36:56,901 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:36:56,901 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:36:56,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:26 UTC)" executed successfully
chunkcleanupworker stdout | 2024-04-22 03:36:58,606 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
teamsyncworker stdout | 2024-04-22 03:36:58,612 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:36:59,605 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:36:59,615 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:36:59,620 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:36:59,624 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:36:59,626 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:36:59,713 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:37:00,653 [279] [DEBUG] [app] Starting request: urn:request:b55cb159-0a59-48b0-8e25-5e8b2d6293e9 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:37:00,653 [282] [DEBUG] [app] Starting request: urn:request:2d0fc917-a4f2-4b90-83bc-c9cc775ac5bb (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:37:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:37:00,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:37:00,656 [284] [DEBUG] [app] Starting request: urn:request:1e05d647-9ef8-4001-adb4-e29d0b1494d3 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:37:00,656 [292] [DEBUG] [app] Starting request: urn:request:bbf36180-1bf8-4da4-b7b9-530b12d07deb (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:37:00,656 [284] [DEBUG] [app] Ending request: urn:request:1e05d647-9ef8-4001-adb4-e29d0b1494d3 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:1e05d647-9ef8-4001-adb4-e29d0b1494d3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:37:00,656 [292] [DEBUG] [app] Ending request: urn:request:bbf36180-1bf8-4da4-b7b9-530b12d07deb (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:bbf36180-1bf8-4da4-b7b9-530b12d07deb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:37:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:37:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:37:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:37:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:37:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:37:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:37:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:37:00,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:37:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:37:00,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:37:00,659 [282] [DEBUG] [app] Starting request: urn:request:de2d37df-e8a8-4287-bc78-faf502debf0e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:37:00,659 [279] [DEBUG] [app] Starting request: urn:request:08e6a886-e563-4a6a-8ac8-72c6c7d9c7ef (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:37:00,659 [282] [DEBUG] [app] Ending request: urn:request:de2d37df-e8a8-4287-bc78-faf502debf0e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:de2d37df-e8a8-4287-bc78-faf502debf0e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:37:00,660 [279] [DEBUG] [app] Ending request: urn:request:08e6a886-e563-4a6a-8ac8-72c6c7d9c7ef (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:08e6a886-e563-4a6a-8ac8-72c6c7d9c7ef', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:37:00,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:37:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:37:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:37:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:37:00,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:37:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:37:00,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:37:00,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:37:00,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:37:00,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:37:00,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:37:00,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:37:00,674 [282] [DEBUG] [app] Ending request: urn:request:2d0fc917-a4f2-4b90-83bc-c9cc775ac5bb (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2d0fc917-a4f2-4b90-83bc-c9cc775ac5bb', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:37:00,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:37:00,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:37:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:37:00,675 [279] [DEBUG] [app] Ending request: urn:request:b55cb159-0a59-48b0-8e25-5e8b2d6293e9 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b55cb159-0a59-48b0-8e25-5e8b2d6293e9', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:37:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.023)
gunicorn-web stdout | 2024-04-22 03:37:00,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:37:00,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:37:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:37:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
notificationworker stdout | 2024-04-22 03:37:01,097 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:37:02,477 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
securityscanningnotificationworker stdout | 2024-04-22 03:37:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:37:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:16.552337+00:00 (in 13.995612 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:37:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:02 UTC)" (scheduled at 2024-04-22 03:37:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:37:02,556 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:37:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:02 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:37:02,788 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:37:02,824 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:37:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:37:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:13.759375+00:00 (in 9.999406 seconds)
notificationworker stdout | 2024-04-22 03:37:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:37:13 UTC)" (scheduled at 2024-04-22 03:37:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:37:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:37:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 37, 3, 760409), True, datetime.datetime(2024, 4, 22, 3, 37, 3, 760409), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:37:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:37:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:37:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:37:13 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 03:37:03,968 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-secscan stdout | 2024-04-22 03:37:04,216 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:37:04,218 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:37:04,221 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:37:05,122 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:37:05,241 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:37:05,442 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:37:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:37:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:26.873109+00:00 (in 21.000745 seconds)
securityworker stdout | 2024-04-22 03:37:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:35 UTC)" (scheduled at 2024-04-22 03:37:05.871852+00:00)
securityworker stdout | 2024-04-22 03:37:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:37:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:37:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:37:05,877 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:37:05,887 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:37:05,889 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:37:05,889 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:35 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:37:06,269 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
repositorygcworker stdout | 2024-04-22 03:37:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:37:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:13.555667+00:00 (in 7.002684 seconds)
repositorygcworker stdout | 2024-04-22 03:37:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:06 UTC)" (scheduled at 2024-04-22 03:37:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:37:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:37:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 37, 6, 553379), True, datetime.datetime(2024, 4, 22, 3, 37, 6, 553379), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:37:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:37:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:37:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:06 UTC)" executed successfully
securityworker stdout | 2024-04-22 03:37:07,650 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:37:07,721 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:37:08,154 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:37:08,320 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:37:09,316 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:37:10,405 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:37:10,408 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:37:10,411 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:37:10,413 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:37:10,416 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:37:10,423 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:37:10,425 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:37:10,429 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:37:10,432 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:37:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:37:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:41.264267+00:00 (in 29.999438 seconds)
autopruneworker stdout | 2024-04-22 03:37:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:41 UTC)" (scheduled at 2024-04-22 03:37:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:37:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713756971272, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:37:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:37:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:37:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:37:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:37:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:06.552482+00:00 (in 52.996307 seconds)
repositorygcworker stdout | 2024-04-22 03:37:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:13 UTC)" (scheduled at 2024-04-22 03:37:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:37:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:37:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:37:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:37:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:19.762424+00:00 (in 6.002594 seconds)
notificationworker stdout | 2024-04-22 03:37:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:37:23 UTC)" (scheduled at 2024-04-22 03:37:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:37:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:37:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 37, 13, 760213), True, datetime.datetime(2024, 4, 22, 3, 37, 13, 760213), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:37:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:37:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:37:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:37:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:37:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:37:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:44.952062+00:00 (in 29.999471 seconds)
gcworker stdout | 2024-04-22 03:37:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:44 UTC)" (scheduled at 2024-04-22 03:37:14.952062+00:00)
gcworker stdout | 2024-04-22 03:37:14,953 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:37:14,953 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:37:15,653 [279] [DEBUG] [app] Starting request: urn:request:31ad056e-f2e5-40b1-93b1-3e8b7f10b1ae (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:37:15,653 [281] [DEBUG] [app] Starting request: urn:request:6346e10a-724e-46e4-b0e8-77c27e377735 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:37:15,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:37:15,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:37:15,657 [291] [DEBUG] [app] Starting request: urn:request:59a9c0ed-9f08-429f-a9f5-74f8698ce4b2 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:37:15,657 [291] [DEBUG] [app] Ending request: urn:request:59a9c0ed-9f08-429f-a9f5-74f8698ce4b2 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:59a9c0ed-9f08-429f-a9f5-74f8698ce4b2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:37:15,657 [284] [DEBUG] [app] Starting request: urn:request:4ac5956d-cc0b-4f78-9904-28d5a1e4326e (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:37:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:37:15,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:37:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:37:15,657 [284] [DEBUG] [app] Ending request: urn:request:4ac5956d-cc0b-4f78-9904-28d5a1e4326e (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:4ac5956d-cc0b-4f78-9904-28d5a1e4326e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:37:15,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 03:37:15,658 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:37:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:37:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:37:15,658 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:37:15,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:37:15,660 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:37:15,660 [278] [DEBUG] [app] Starting request: urn:request:ee65d6fa-c56c-45be-9ef3-ccf17a4cf0cd (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:37:15,660 [278] [DEBUG] [app] Ending request: urn:request:ee65d6fa-c56c-45be-9ef3-ccf17a4cf0cd (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:ee65d6fa-c56c-45be-9ef3-ccf17a4cf0cd', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:37:15,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:37:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:37:15,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:37:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:37:15,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:37:15,661 [282] [DEBUG] [app] Starting request: urn:request:9ddde028-b37a-43c7-ab0d-2cbbf09f43d7 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:37:15,662 [282] [DEBUG] [app] Ending request: urn:request:9ddde028-b37a-43c7-ab0d-2cbbf09f43d7 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9ddde028-b37a-43c7-ab0d-2cbbf09f43d7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:37:15,662 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:37:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:37:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:37:15,662 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:37:15,663 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:37:15,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:37:15,668 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:37:15,675 [279] [DEBUG] [app] Ending request: urn:request:31ad056e-f2e5-40b1-93b1-3e8b7f10b1ae (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:31ad056e-f2e5-40b1-93b1-3e8b7f10b1ae', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:37:15,675 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:37:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:37:15,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:37:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:37:15,676 [281] [DEBUG] [app] Ending request: urn:request:6346e10a-724e-46e4-b0e8-77c27e377735 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:6346e10a-724e-46e4-b0e8-77c27e377735', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:37:15,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:37:15,677 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:37:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:37:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
securityscanningnotificationworker stdout | 2024-04-22 03:37:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:37:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:21.555879+00:00 (in 5.002953 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:37:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:16 UTC)" (scheduled at 2024-04-22 03:37:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:37:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:37:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 37, 16, 553256), True, datetime.datetime(2024, 4, 22, 3, 37, 16, 553256), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:37:16,565 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:37:16,565 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:37:16,565 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:37:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:37:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:47.052354+00:00 (in 29.999540 seconds)
buildlogsarchiver stdout | 2024-04-22 03:37:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:47 UTC)" (scheduled at 2024-04-22 03:37:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:37:17,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 37, 17, 53199), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:37:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:37:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:37:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:37:18,463 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:37:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:37:19,763 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:23.759375+00:00 (in 3.996335 seconds)
notificationworker stdout | 2024-04-22 03:37:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:19 UTC)" (scheduled at 2024-04-22 03:37:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:37:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:37:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:37:20,189 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
securityscanningnotificationworker stdout | 2024-04-22 03:37:21,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:37:21,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:02.556208+00:00 (in 40.999787 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:37:21,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:42:21 UTC)" (scheduled at 2024-04-22 03:37:21.555879+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:37:21,557 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 37, 21, 556776), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 03:37:21,567 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 37, 21, 556776), True, datetime.datetime(2024, 4, 22, 3, 37, 21, 556776), 0, 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 03:37:21,570 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 37, 21, 556776), True, datetime.datetime(2024, 4, 22, 3, 37, 21, 556776), 0, 'secscanv4/%', False, datetime.datetime(2024, 4, 22, 3, 37, 21, 556776), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 03:37:21,573 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:37:21,573 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:42:21 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:37:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:37:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:38.058708+00:00 (in 15.999206 seconds)
namespacegcworker stdout | 2024-04-22 03:37:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:22 UTC)" (scheduled at 2024-04-22 03:37:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:37:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:37:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:22 UTC)" executed successfully
builder stdout | 2024-04-22 03:37:23,651 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
notificationworker stdout | 2024-04-22 03:37:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:37:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:33.759375+00:00 (in 9.999452 seconds)
notificationworker stdout | 2024-04-22 03:37:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:37:33 UTC)" (scheduled at 2024-04-22 03:37:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:37:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:37:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 37, 23, 760323), True, datetime.datetime(2024, 4, 22, 3, 37, 23, 760323), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:37:23,777 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:37:23,778 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:37:23,778 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:37:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 03:37:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:37:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:24.361582+00:00 (in 59.999500 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:37:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:24 UTC)" (scheduled at 2024-04-22 03:37:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:37:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:37:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:37:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:37:25,266 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 03:37:26,636 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
securityworker stdout | 2024-04-22 03:37:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:37:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:35.871852+00:00 (in 8.998247 seconds)
securityworker stdout | 2024-04-22 03:37:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:56 UTC)" (scheduled at 2024-04-22 03:37:26.873109+00:00)
securityworker stdout | 2024-04-22 03:37:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:37:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:37:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:37:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:37:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:37:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:37:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:37:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:37:26,882 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:37:26,892 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:37:26,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:37:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:37:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 32, 26, 882339), 1, 2])
securityworker stdout | 2024-04-22 03:37:26,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:37:26,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:37:26,899 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 32, 26, 882339), 1, 2])
securityworker stdout | 2024-04-22 03:37:26,901 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:37:26,901 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:37:26,902 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:37:26,902 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:37:26,902 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:37:26,902 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:37:26,902 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:37:26,903 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:37:26,903 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:37:26,903 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:37:56 UTC)" executed successfully
chunkcleanupworker stdout | 2024-04-22 03:37:28,629 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
teamsyncworker stdout | 2024-04-22 03:37:28,650 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:37:29,614 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:37:29,624 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:37:29,629 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:37:29,633 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:37:29,637 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:37:29,745 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:37:30,653 [282] [DEBUG] [app] Starting request: urn:request:5e766977-4829-4427-9c0a-4d18e47df82e (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:37:30,653 [281] [DEBUG] [app] Starting request: urn:request:77ed2d7e-b381-42ca-8e44-55cafa381829 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:37:30,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:37:30,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:37:30,657 [292] [DEBUG] [app] Starting request: urn:request:25ff8e0b-2679-4cd2-9769-cfbb2acfb225 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:37:30,657 [292] [DEBUG] [app] Ending request: urn:request:25ff8e0b-2679-4cd2-9769-cfbb2acfb225 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:25ff8e0b-2679-4cd2-9769-cfbb2acfb225', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:37:30,658 [284] [DEBUG] [app] Starting request: urn:request:062da6a8-8e48-42bb-858b-506144e8a870 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:37:30,658 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:37:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:37:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:37:30,658 [284] [DEBUG] [app] Ending request: urn:request:062da6a8-8e48-42bb-858b-506144e8a870 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:062da6a8-8e48-42bb-858b-506144e8a870', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:37:30,658 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 03:37:30,658 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:37:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:37:30,658 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:37:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:37:30,660 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:37:30,660 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:37:30,661 [282] [DEBUG] [app] Starting request: urn:request:c5627bd8-9bb8-4aca-b7ec-22ad818bc132 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:37:30,662 [278] [DEBUG] [app] Starting request: urn:request:046be15b-e932-47e2-8ee2-392698f76dc0 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:37:30,662 [282] [DEBUG] [app] Ending request: urn:request:c5627bd8-9bb8-4aca-b7ec-22ad818bc132 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:c5627bd8-9bb8-4aca-b7ec-22ad818bc132', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:37:30,662 [278] [DEBUG] [app] Ending request: urn:request:046be15b-e932-47e2-8ee2-392698f76dc0 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:046be15b-e932-47e2-8ee2-392698f76dc0', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:37:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:37:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:37:30,662 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:37:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:37:30,662 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:37:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:37:30,662 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:37:30,663 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:37:30,663 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:37:30,663 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:37:30,669 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:37:30,670 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:37:30,678 [282] [DEBUG] [app] Ending request: urn:request:5e766977-4829-4427-9c0a-4d18e47df82e (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:5e766977-4829-4427-9c0a-4d18e47df82e', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:37:30,678 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:37:30,678 [281] [DEBUG] [app] Ending request: urn:request:77ed2d7e-b381-42ca-8e44-55cafa381829 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:77ed2d7e-b381-42ca-8e44-55cafa381829', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:37:30,678 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:37:30,679 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:37:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:37:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
gunicorn-web stdout | 2024-04-22 03:37:30,679 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:37:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:37:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.027 118 0.026)
notificationworker stdout | 2024-04-22 03:37:31,136 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:37:32,485 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:37:32,824 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:37:32,861 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:37:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:37:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:43.759375+00:00 (in 9.999488 seconds)
notificationworker stdout | 2024-04-22 03:37:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:37:43 UTC)" (scheduled at 2024-04-22 03:37:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:37:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:37:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 37, 33, 760298), True, datetime.datetime(2024, 4, 22, 3, 37, 33, 760298), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:37:33,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:37:33,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:37:33,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:37:43 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 03:37:34,005 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-secscan stdout | 2024-04-22 03:37:34,223 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:37:34,226 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:37:34,230 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:37:35,137 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:37:35,270 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:37:35,464 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:37:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:37:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:56.873109+00:00 (in 21.000795 seconds)
securityworker stdout | 2024-04-22 03:37:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:05 UTC)" (scheduled at 2024-04-22 03:37:35.871852+00:00)
securityworker stdout | 2024-04-22 03:37:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:37:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:37:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:37:35,877 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:37:35,887 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:37:35,889 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:37:35,889 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:05 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:37:36,300 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:37:37,687 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:37:37,755 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:37:38,058 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:37:38,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:43.057186+00:00 (in 4.998036 seconds)
namespacegcworker stdout | 2024-04-22 03:37:38,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:42:38 UTC)" (scheduled at 2024-04-22 03:37:38.058708+00:00)
namespacegcworker stdout | 2024-04-22 03:37:38,059 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 37, 38, 59372), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 03:37:38,069 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 37, 38, 59372), True, datetime.datetime(2024, 4, 22, 3, 37, 38, 59372), 0, 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 03:37:38,072 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 37, 38, 59372), True, datetime.datetime(2024, 4, 22, 3, 37, 38, 59372), 0, 'namespacegc/%', False, datetime.datetime(2024, 4, 22, 3, 37, 38, 59372), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 03:37:38,074 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:37:38,074 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:42:38 UTC)" executed successfully
manifestbackfillworker stdout | 2024-04-22 03:37:38,190 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:37:38,355 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:37:39,352 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
exportactionlogsworker stdout | 2024-04-22 03:37:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:37:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:41.564959+00:00 (in 1.997558 seconds)
exportactionlogsworker stdout | 2024-04-22 03:37:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:39 UTC)" (scheduled at 2024-04-22 03:37:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:37:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:37:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:39 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 03:37:40,414 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:37:40,420 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:37:40,423 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:37:40,426 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:37:40,429 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:37:40,433 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:37:40,438 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:37:40,441 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:37:40,443 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:37:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:37:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:11.264267+00:00 (in 29.999460 seconds)
autopruneworker stdout | 2024-04-22 03:37:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:11 UTC)" (scheduled at 2024-04-22 03:37:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:37:41,271 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757001271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:37:41,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:37:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:37:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:37:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:37:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:39.566970+00:00 (in 58.001556 seconds)
exportactionlogsworker stdout | 2024-04-22 03:37:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:41 UTC)" (scheduled at 2024-04-22 03:37:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:37:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:37:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 37, 41, 565828), True, datetime.datetime(2024, 4, 22, 3, 37, 41, 565828), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:37:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:37:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:37:41,578 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:37:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:37:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:22.058978+00:00 (in 39.001342 seconds)
namespacegcworker stdout | 2024-04-22 03:37:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:43 UTC)" (scheduled at 2024-04-22 03:37:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:37:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:37:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 37, 43, 57909), True, datetime.datetime(2024, 4, 22, 3, 37, 43, 57909), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:37:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:37:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:37:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:38:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:37:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:37:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:37:53.759375+00:00 (in 9.999458 seconds)
notificationworker stdout | 2024-04-22 03:37:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:37:53 UTC)" (scheduled at 2024-04-22 03:37:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:37:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:37:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 37, 43, 760359), True, datetime.datetime(2024, 4, 22, 3, 37, 43, 760359), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:37:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:37:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:37:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:37:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:37:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:37:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:14.952062+00:00 (in 29.999507 seconds)
gcworker stdout | 2024-04-22 03:37:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:14 UTC)" (scheduled at 2024-04-22 03:37:44.952062+00:00)
gcworker stdout | 2024-04-22 03:37:44,952 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:37:44,953 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:37:45,653 [282] [DEBUG] [app] Starting request: urn:request:be2d5411-b224-4c7f-8837-af5042cb47fd (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:37:45,653 [278] [DEBUG] [app] Starting request: urn:request:7a3179d7-eda2-4569-a27b-33f74479c13a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:37:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:37:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:37:45,656 [292] [DEBUG] [app] Starting request: urn:request:44d54805-63e0-42a4-9b92-934118ece961 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:37:45,656 [284] [DEBUG] [app] Starting request: urn:request:93417f55-9cd9-483b-9f58-c9fe50446028 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:37:45,657 [292] [DEBUG] [app] Ending request: urn:request:44d54805-63e0-42a4-9b92-934118ece961 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:44d54805-63e0-42a4-9b92-934118ece961', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:37:45,657 [284] [DEBUG] [app] Ending request: urn:request:93417f55-9cd9-483b-9f58-c9fe50446028 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:93417f55-9cd9-483b-9f58-c9fe50446028', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:37:45,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:37:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:37:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:37:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:37:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:37:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:37:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:37:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:37:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:37:45,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:37:45,660 [282] [DEBUG] [app] Starting request: urn:request:7b11a471-2918-4249-b694-a762184086bb (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:37:45,660 [282] [DEBUG] [app] Ending request: urn:request:7b11a471-2918-4249-b694-a762184086bb (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:7b11a471-2918-4249-b694-a762184086bb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:37:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:37:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:37:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:37:45,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:37:45,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:37:45,661 [279] [DEBUG] [app] Starting request: urn:request:661b1635-84a8-4136-ac38-f97b4c4e37e6 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:37:45,662 [279] [DEBUG] [app] Ending request: urn:request:661b1635-84a8-4136-ac38-f97b4c4e37e6 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:661b1635-84a8-4136-ac38-f97b4c4e37e6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:37:45,662 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:37:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:37:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:37:45,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:37:45,663 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:37:45,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:37:45,669 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:37:45,675 [282] [DEBUG] [app] Ending request: urn:request:be2d5411-b224-4c7f-8837-af5042cb47fd (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:be2d5411-b224-4c7f-8837-af5042cb47fd', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:37:45,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:37:45,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:37:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:37:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:37:45,677 [278] [DEBUG] [app] Ending request: urn:request:7a3179d7-eda2-4569-a27b-33f74479c13a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:7a3179d7-eda2-4569-a27b-33f74479c13a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:37:45,678 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:37:45,678 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:37:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:37:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
buildlogsarchiver stdout | 2024-04-22 03:37:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:37:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:17.052354+00:00 (in 29.999542 seconds)
buildlogsarchiver stdout | 2024-04-22 03:37:47,052 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:17 UTC)" (scheduled at 2024-04-22 03:37:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:37:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 37, 47, 53067), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:37:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:37:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:37:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:37:48,490 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:37:50,226 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
builder stdout | 2024-04-22 03:37:53,675 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
notificationworker stdout | 2024-04-22 03:37:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:37:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:03.759375+00:00 (in 9.999456 seconds)
notificationworker stdout | 2024-04-22 03:37:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:38:03 UTC)" (scheduled at 2024-04-22 03:37:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:37:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:37:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 37, 53, 760180), True, datetime.datetime(2024, 4, 22, 3, 37, 53, 760180), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:37:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:37:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:37:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:38:03 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:37:55,274 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 03:37:56,672 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
securityworker stdout | 2024-04-22 03:37:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:37:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:05.871852+00:00 (in 8.998181 seconds)
securityworker stdout | 2024-04-22 03:37:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:26 UTC)" (scheduled at 2024-04-22 03:37:56.873109+00:00)
securityworker stdout | 2024-04-22 03:37:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:37:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:37:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:37:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:37:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:37:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:37:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:37:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:37:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:37:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:37:56,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:37:56,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:37:56,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 32, 56, 881371), 1, 2])
securityworker stdout | 2024-04-22 03:37:56,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:37:56,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:37:56,898 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 32, 56, 881371), 1, 2])
securityworker stdout | 2024-04-22 03:37:56,900 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:37:56,900 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:37:56,900 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:37:56,900 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:37:56,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:37:56,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:37:56,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:37:56,901 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:37:56,901 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:37:56,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:26 UTC)" executed successfully
chunkcleanupworker stdout | 2024-04-22 03:37:58,643 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
teamsyncworker stdout | 2024-04-22 03:37:58,673 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:37:59,624 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:37:59,632 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:37:59,636 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:37:59,640 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:37:59,647 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:37:59,754 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:38:00,653 [282] [DEBUG] [app] Starting request: urn:request:606c3805-b8f1-40aa-a819-e2da6b2dc77f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:38:00,653 [278] [DEBUG] [app] Starting request: urn:request:30aad967-e92f-4c42-aaaf-abcaa1ad71ff (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:38:00,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:38:00,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:38:00,657 [291] [DEBUG] [app] Starting request: urn:request:e86fa833-c3d1-41a8-bbba-9d6f0b69f362 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:38:00,657 [289] [DEBUG] [app] Starting request: urn:request:0f5eb6b3-a4f6-4029-b09e-8986f3b6b0db (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:38:00,657 [291] [DEBUG] [app] Ending request: urn:request:e86fa833-c3d1-41a8-bbba-9d6f0b69f362 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:e86fa833-c3d1-41a8-bbba-9d6f0b69f362', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:38:00,657 [289] [DEBUG] [app] Ending request: urn:request:0f5eb6b3-a4f6-4029-b09e-8986f3b6b0db (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:0f5eb6b3-a4f6-4029-b09e-8986f3b6b0db', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:38:00,658 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:38:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:38:00,658 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:38:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:38:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:38:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:38:00,658 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:38:00,658 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:38:00,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:38:00,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:38:00,661 [282] [DEBUG] [app] Starting request: urn:request:eb49706a-0014-461f-9860-4d1a2f84ea79 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:38:00,661 [282] [DEBUG] [app] Ending request: urn:request:eb49706a-0014-461f-9860-4d1a2f84ea79 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:eb49706a-0014-461f-9860-4d1a2f84ea79', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:38:00,661 [281] [DEBUG] [app] Starting request: urn:request:8e250ace-042c-4856-9919-8b930f74ae80 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:38:00,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:38:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:38:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:38:00,661 [281] [DEBUG] [app] Ending request: urn:request:8e250ace-042c-4856-9919-8b930f74ae80 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:8e250ace-042c-4856-9919-8b930f74ae80', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:38:00,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:38:00,662 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:38:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:38:00,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:38:00,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:38:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:38:00,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:38:00,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:38:00,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:38:00,676 [282] [DEBUG] [app] Ending request: urn:request:606c3805-b8f1-40aa-a819-e2da6b2dc77f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:606c3805-b8f1-40aa-a819-e2da6b2dc77f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:38:00,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:38:00,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:38:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:38:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:38:00,677 [278] [DEBUG] [app] Ending request: urn:request:30aad967-e92f-4c42-aaaf-abcaa1ad71ff (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:30aad967-e92f-4c42-aaaf-abcaa1ad71ff', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:38:00,677 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:38:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
gunicorn-web stdout | 2024-04-22 03:38:00,677 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:38:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
notificationworker stdout | 2024-04-22 03:38:01,158 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:38:02,521 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
securityscanningnotificationworker stdout | 2024-04-22 03:38:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:38:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:16.552337+00:00 (in 13.995673 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:38:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:02 UTC)" (scheduled at 2024-04-22 03:38:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:38:02,556 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:38:02,556 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:02 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:38:02,860 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:38:02,898 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:38:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:38:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:13.759375+00:00 (in 9.999452 seconds)
notificationworker stdout | 2024-04-22 03:38:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:38:13 UTC)" (scheduled at 2024-04-22 03:38:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:38:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:38:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 38, 3, 760333), True, datetime.datetime(2024, 4, 22, 3, 38, 3, 760333), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:38:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:38:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:38:03,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:38:13 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 03:38:04,042 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 03:38:04,053 [93] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
servicekey stdout | 2024-04-22 03:38:04,053 [93] [INFO] [apscheduler.executors.default] Running job "ServiceKeyWorker._refresh_service_key (trigger: interval[0:55:00], next run at: 2024-04-22 03:38:04 UTC)" (scheduled at 2024-04-22 03:38:04.053182+00:00)
servicekey stdout | 2024-04-22 03:38:04,054 [93] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:33:04.053182+00:00 (in 3299.998967 seconds)
servicekey stdout | 2024-04-22 03:38:04,054 [93] [DEBUG] [__main__] Starting automatic refresh of service key DqSmkDsnqQT4kX8z98Vd1K2N_NQrUiM-LrUzIWQ-hsk to new expiration 2024-04-22 05:38:04.054063
servicekey stdout | 2024-04-22 03:38:04,055 [93] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE (("t1"."kid" = %s) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s))) LIMIT %s OFFSET %s', ['DqSmkDsnqQT4kX8z98Vd1K2N_NQrUiM-LrUzIWQ-hsk', datetime.datetime(2024, 4, 15, 3, 38, 4, 54774), None, 1, 0])
servicekey stdout | 2024-04-22 03:38:04,066 [93] [DEBUG] [peewee] ('UPDATE "servicekey" SET "name" = %s, "kid" = %s, "service" = %s, "jwk" = %s, "metadata" = %s, "created_date" = %s, "expiration_date" = %s, "rotation_duration" = %s, "approval_id" = %s WHERE ("servicekey"."id" = %s)', ['https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com:443', 'DqSmkDsnqQT4kX8z98Vd1K2N_NQrUiM-LrUzIWQ-hsk', 'quay', '{"n": "yBslD6e149PD2fCkAyl_k2sShwjXRoZTDbR9aTxM8kATDI1EFad_7kKCQ1P9tQj8f9-axTqqskEjSwBb8wQoe1mAK4S6OVGkB3VWEs8DgkaIIc9NVpNkbdt9LLN1xUu-R5Jnd6NOx8sBUIQV_-U2skBKBud9QOEPQH2-1oa9ycLVX3a_l-nYwCEOaDKBcm__X1UUSKmzg31zbE1ru-Uhf3DAY_a4kZnulkyjtsAMh_3Ew8XhmAcHXqXTii5LlYtzLTMmzTZJfJ2YJ8tGiPzW9-ynbQ2oH1hF-n4sdIlgcU5TKeaAM1pmFlQ1L5uay3TIkYJ0hzpdqEVFO0QkSY4Ipw", "e": "AQAB", "kty": "RSA", "kid": "DqSmkDsnqQT4kX8z98Vd1K2N_NQrUiM-LrUzIWQ-hsk"}', '{"created_by": "CLI tool"}', datetime.datetime(2024, 4, 22, 3, 33, 19, 436611), datetime.datetime(2024, 4, 22, 5, 38, 4, 54063), None, 2, 2])
servicekey stdout | 2024-04-22 03:38:04,070 [93] [DEBUG] [__main__] Finished automatic refresh of service key DqSmkDsnqQT4kX8z98Vd1K2N_NQrUiM-LrUzIWQ-hsk with new expiration 2024-04-22 05:38:04.054063
servicekey stdout | 2024-04-22 03:38:04,070 [93] [DEBUG] [data.database] Disconnecting from database.
servicekey stdout | 2024-04-22 03:38:04,070 [93] [INFO] [apscheduler.executors.default] Job "ServiceKeyWorker._refresh_service_key (trigger: interval[0:55:00], next run at: 2024-04-22 04:33:04 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:38:04,232 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:38:04,234 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:38:04,237 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:38:05,169 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:38:05,307 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:38:05,496 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:38:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:38:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:26.873109+00:00 (in 21.000741 seconds)
securityworker stdout | 2024-04-22 03:38:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:35 UTC)" (scheduled at 2024-04-22 03:38:05.871852+00:00)
securityworker stdout | 2024-04-22 03:38:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:38:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:38:05,876 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:38:05,877 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:38:05,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:38:05,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:38:05,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:35 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:38:06,330 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
repositorygcworker stdout | 2024-04-22 03:38:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:38:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:13.555667+00:00 (in 7.002731 seconds)
repositorygcworker stdout | 2024-04-22 03:38:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:06 UTC)" (scheduled at 2024-04-22 03:38:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:38:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:38:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 38, 6, 553366), True, datetime.datetime(2024, 4, 22, 3, 38, 6, 553366), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:38:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:38:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:38:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:06 UTC)" executed successfully
securityworker stdout | 2024-04-22 03:38:07,724 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:38:07,793 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:38:08,202 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:38:08,393 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:38:09,388 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:38:10,422 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:38:10,431 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:38:10,435 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:38:10,438 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:38:10,441 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:38:10,444 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:38:10,451 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:38:10,454 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:38:10,456 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:38:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:38:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:41.264267+00:00 (in 29.999508 seconds)
autopruneworker stdout | 2024-04-22 03:38:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:41 UTC)" (scheduled at 2024-04-22 03:38:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:38:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757031271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:38:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:38:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:38:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:38:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:38:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:06.552482+00:00 (in 52.996349 seconds)
repositorygcworker stdout | 2024-04-22 03:38:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:13 UTC)" (scheduled at 2024-04-22 03:38:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:38:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:38:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:38:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:38:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:19.762160+00:00 (in 6.002280 seconds)
notificationworker stdout | 2024-04-22 03:38:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:38:23 UTC)" (scheduled at 2024-04-22 03:38:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:38:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:38:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 38, 13, 760346), True, datetime.datetime(2024, 4, 22, 3, 38, 13, 760346), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:38:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:38:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:38:13,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:38:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:38:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:38:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:44.952062+00:00 (in 29.999520 seconds)
gcworker stdout | 2024-04-22 03:38:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:44 UTC)" (scheduled at 2024-04-22 03:38:14.952062+00:00)
gcworker stdout | 2024-04-22 03:38:14,952 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:38:14,953 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:38:15,653 [278] [DEBUG] [app] Starting request: urn:request:2a6a47ac-469c-4236-8070-f3b48c6592d8 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:38:15,653 [281] [DEBUG] [app] Starting request: urn:request:9757235e-278c-400a-b7c7-ccd7c8d54ffb (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:38:15,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:38:15,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:38:15,657 [284] [DEBUG] [app] Starting request: urn:request:9f102059-dbf7-4c75-8316-aa6c1b298321 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:38:15,657 [292] [DEBUG] [app] Starting request: urn:request:7c575ef3-9741-4487-844a-5c8d0d59f1c5 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:38:15,658 [284] [DEBUG] [app] Ending request: urn:request:9f102059-dbf7-4c75-8316-aa6c1b298321 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:9f102059-dbf7-4c75-8316-aa6c1b298321', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:38:15,658 [292] [DEBUG] [app] Ending request: urn:request:7c575ef3-9741-4487-844a-5c8d0d59f1c5 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7c575ef3-9741-4487-844a-5c8d0d59f1c5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:38:15,658 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:38:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:38:15,658 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:38:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:38:15,658 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:38:15,658 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:38:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:38:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:38:15,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:38:15,660 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:38:15,661 [278] [DEBUG] [app] Starting request: urn:request:ebecba5a-28ae-40fe-af72-2ebf6846b9d9 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:38:15,661 [278] [DEBUG] [app] Ending request: urn:request:ebecba5a-28ae-40fe-af72-2ebf6846b9d9 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:ebecba5a-28ae-40fe-af72-2ebf6846b9d9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:38:15,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:38:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:38:15,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:38:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:38:15,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:38:15,662 [282] [DEBUG] [app] Starting request: urn:request:cb91aa14-b176-40f2-ae3c-016e2aed72db (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:38:15,662 [282] [DEBUG] [app] Ending request: urn:request:cb91aa14-b176-40f2-ae3c-016e2aed72db (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:cb91aa14-b176-40f2-ae3c-016e2aed72db', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:38:15,663 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:38:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:38:15,663 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:38:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:38:15,663 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:38:15,670 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:38:15,671 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:38:15,680 [281] [DEBUG] [app] Ending request: urn:request:9757235e-278c-400a-b7c7-ccd7c8d54ffb (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:9757235e-278c-400a-b7c7-ccd7c8d54ffb', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:38:15,680 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:38:15,680 [278] [DEBUG] [app] Ending request: urn:request:2a6a47ac-469c-4236-8070-f3b48c6592d8 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2a6a47ac-469c-4236-8070-f3b48c6592d8', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:38:15,680 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:38:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:38:15,680 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:38:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.028 118 0.028)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:38:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.029 118 0.029)
gunicorn-web stdout | 2024-04-22 03:38:15,681 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:38:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
securityscanningnotificationworker stdout | 2024-04-22 03:38:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:38:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:02.556208+00:00 (in 46.003329 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:38:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:16 UTC)" (scheduled at 2024-04-22 03:38:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:38:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:38:16,553 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 38, 16, 553121), True, datetime.datetime(2024, 4, 22, 3, 38, 16, 553121), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:38:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:38:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:38:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:38:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:38:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:47.052354+00:00 (in 29.999525 seconds)
buildlogsarchiver stdout | 2024-04-22 03:38:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:47 UTC)" (scheduled at 2024-04-22 03:38:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:38:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 38, 17, 53179), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:38:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:38:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:38:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:38:18,527 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:38:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:38:19,762 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:43:19 UTC)" (scheduled at 2024-04-22 03:38:19.762160+00:00)
notificationworker stdout | 2024-04-22 03:38:19,763 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 38, 19, 763164), 'notification/%'])
notificationworker stdout | 2024-04-22 03:38:19,764 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:19 UTC)" (scheduled at 2024-04-22 03:38:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:38:19,764 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:23.759375+00:00 (in 3.995005 seconds)
notificationworker stdout | 2024-04-22 03:38:19,764 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:38:19,764 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:19 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:38:19,774 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 38, 19, 763164), True, datetime.datetime(2024, 4, 22, 3, 38, 19, 763164), 0, 'notification/%'])
notificationworker stdout | 2024-04-22 03:38:19,777 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 38, 19, 763164), True, datetime.datetime(2024, 4, 22, 3, 38, 19, 763164), 0, 'notification/%', False, datetime.datetime(2024, 4, 22, 3, 38, 19, 763164), 'notification/%'])
notificationworker stdout | 2024-04-22 03:38:19,779 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:38:19,780 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:43:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:38:20,244 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:38:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:38:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:43.057186+00:00 (in 20.997707 seconds)
namespacegcworker stdout | 2024-04-22 03:38:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:22 UTC)" (scheduled at 2024-04-22 03:38:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:38:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:38:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:22 UTC)" executed successfully
builder stdout | 2024-04-22 03:38:23,682 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
notificationworker stdout | 2024-04-22 03:38:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:38:23,760 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:33.759375+00:00 (in 9.999252 seconds)
notificationworker stdout | 2024-04-22 03:38:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:38:33 UTC)" (scheduled at 2024-04-22 03:38:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:38:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:38:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 38, 23, 760571), True, datetime.datetime(2024, 4, 22, 3, 38, 23, 760571), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:38:23,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:38:23,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:38:23,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:38:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 03:38:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:38:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:24.361582+00:00 (in 59.999527 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:38:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:24 UTC)" (scheduled at 2024-04-22 03:38:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:38:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:38:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:38:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:38:25,310 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 03:38:26,710 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
securityworker stdout | 2024-04-22 03:38:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:38:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:35.871852+00:00 (in 8.998274 seconds)
securityworker stdout | 2024-04-22 03:38:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:56 UTC)" (scheduled at 2024-04-22 03:38:26.873109+00:00)
securityworker stdout | 2024-04-22 03:38:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:38:26,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:38:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:38:26,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:38:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:38:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:38:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:38:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:38:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:38:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:38:26,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:38:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:38:26,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 33, 26, 881451), 1, 2])
securityworker stdout | 2024-04-22 03:38:26,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:38:26,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:38:26,898 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 33, 26, 881451), 1, 2])
securityworker stdout | 2024-04-22 03:38:26,900 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:38:26,900 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:38:26,900 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:38:26,901 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:38:26,901 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:38:26,901 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:38:26,901 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:38:26,902 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:38:26,902 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:38:26,902 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:38:56 UTC)" executed successfully
chunkcleanupworker stdout | 2024-04-22 03:38:28,657 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
teamsyncworker stdout | 2024-04-22 03:38:28,708 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:38:29,634 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:38:29,644 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:38:29,647 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:38:29,652 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:38:29,656 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:38:29,762 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:38:30,653 [278] [DEBUG] [app] Starting request: urn:request:9dbeea7b-abe6-44e9-875f-f93e72b42797 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:38:30,653 [279] [DEBUG] [app] Starting request: urn:request:efa12b0a-dfee-484f-92e4-741832a8a0e2 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:38:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:38:30,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:38:30,656 [284] [DEBUG] [app] Starting request: urn:request:e307d164-b613-453c-b3b6-49efc82facd2 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:38:30,656 [291] [DEBUG] [app] Starting request: urn:request:3e3f66c9-d2d9-4abb-b60b-764768543e50 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:38:30,656 [284] [DEBUG] [app] Ending request: urn:request:e307d164-b613-453c-b3b6-49efc82facd2 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:e307d164-b613-453c-b3b6-49efc82facd2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:38:30,657 [291] [DEBUG] [app] Ending request: urn:request:3e3f66c9-d2d9-4abb-b60b-764768543e50 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:3e3f66c9-d2d9-4abb-b60b-764768543e50', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:38:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:38:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:38:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:38:30,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:38:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:38:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:38:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:38:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:38:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:38:30,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:38:30,659 [278] [DEBUG] [app] Starting request: urn:request:3a97330e-b3c4-43c2-afc4-7dc0b6781ddd (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:38:30,660 [278] [DEBUG] [app] Ending request: urn:request:3a97330e-b3c4-43c2-afc4-7dc0b6781ddd (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3a97330e-b3c4-43c2-afc4-7dc0b6781ddd', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:38:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:38:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:38:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:38:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:38:30,660 [282] [DEBUG] [app] Starting request: urn:request:4f1cc91e-e13c-44f5-838d-06079ab9cc3a (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:38:30,661 [282] [DEBUG] [app] Ending request: urn:request:4f1cc91e-e13c-44f5-838d-06079ab9cc3a (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:4f1cc91e-e13c-44f5-838d-06079ab9cc3a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:38:30,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:38:30,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:38:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:38:30,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:38:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:38:30,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:38:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:38:30,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:38:30,675 [278] [DEBUG] [app] Ending request: urn:request:9dbeea7b-abe6-44e9-875f-f93e72b42797 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:9dbeea7b-abe6-44e9-875f-f93e72b42797', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:38:30,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:38:30,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:38:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:38:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:38:30,676 [279] [DEBUG] [app] Ending request: urn:request:efa12b0a-dfee-484f-92e4-741832a8a0e2 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:efa12b0a-dfee-484f-92e4-741832a8a0e2', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:38:30,676 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:38:30,677 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:38:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:38:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
notificationworker stdout | 2024-04-22 03:38:31,187 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:38:32,558 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:38:32,897 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:38:32,933 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:38:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:38:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:43.759375+00:00 (in 9.999419 seconds)
notificationworker stdout | 2024-04-22 03:38:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:38:43 UTC)" (scheduled at 2024-04-22 03:38:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:38:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:38:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 38, 33, 760412), True, datetime.datetime(2024, 4, 22, 3, 38, 33, 760412), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:38:33,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:38:33,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:38:33,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:38:43 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 03:38:34,078 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-secscan stdout | 2024-04-22 03:38:34,242 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:38:34,246 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:38:34,249 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:38:35,205 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:38:35,344 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:38:35,516 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:38:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:38:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:56.873109+00:00 (in 21.000778 seconds)
securityworker stdout | 2024-04-22 03:38:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:05 UTC)" (scheduled at 2024-04-22 03:38:35.871852+00:00)
securityworker stdout | 2024-04-22 03:38:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:38:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:38:35,874 [92] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: quayregistry-clair-app.quay-enterprise.svc.cluster.local
securityworker stdout | 2024-04-22 03:38:35,883 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:38:35,884 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:38:35,893 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:38:35,895 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:38:35,895 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:05 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:38:36,345 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:38:37,761 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:38:37,830 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:38:38,238 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:38:38,430 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:38:39,425 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
exportactionlogsworker stdout | 2024-04-22 03:38:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:38:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:41.564959+00:00 (in 1.997534 seconds)
exportactionlogsworker stdout | 2024-04-22 03:38:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:39 UTC)" (scheduled at 2024-04-22 03:38:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:38:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:38:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:39 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 03:38:40,431 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:38:40,439 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:38:40,445 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:38:40,448 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:38:40,452 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:38:40,456 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:38:40,459 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:38:40,463 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:38:40,466 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:38:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:38:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:11.264267+00:00 (in 29.999519 seconds)
autopruneworker stdout | 2024-04-22 03:38:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:11 UTC)" (scheduled at 2024-04-22 03:38:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:38:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757061271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:38:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:38:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:38:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:38:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:38:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:39.566970+00:00 (in 58.001496 seconds)
exportactionlogsworker stdout | 2024-04-22 03:38:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:41 UTC)" (scheduled at 2024-04-22 03:38:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:38:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:38:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 38, 41, 565915), True, datetime.datetime(2024, 4, 22, 3, 38, 41, 565915), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:38:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:38:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:38:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:38:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:38:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:22.058978+00:00 (in 39.001254 seconds)
namespacegcworker stdout | 2024-04-22 03:38:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:43 UTC)" (scheduled at 2024-04-22 03:38:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:38:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:38:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 38, 43, 57998), True, datetime.datetime(2024, 4, 22, 3, 38, 43, 57998), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:38:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:38:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:38:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:39:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:38:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:38:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:38:53.759375+00:00 (in 9.999481 seconds)
notificationworker stdout | 2024-04-22 03:38:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:38:53 UTC)" (scheduled at 2024-04-22 03:38:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:38:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:38:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 38, 43, 760289), True, datetime.datetime(2024, 4, 22, 3, 38, 43, 760289), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:38:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:38:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:38:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:38:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:38:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:38:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:14.952062+00:00 (in 29.999554 seconds)
gcworker stdout | 2024-04-22 03:38:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:14 UTC)" (scheduled at 2024-04-22 03:38:44.952062+00:00)
gcworker stdout | 2024-04-22 03:38:44,952 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:38:44,952 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:38:45,653 [278] [DEBUG] [app] Starting request: urn:request:b4f34a70-ab49-4e89-aff3-ab7c50fb8e29 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:38:45,653 [281] [DEBUG] [app] Starting request: urn:request:2eb8367a-a014-43dc-8489-c25686f355bb (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:38:45,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:38:45,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:38:45,656 [290] [DEBUG] [app] Starting request: urn:request:bdc8b05a-0b0f-47f4-9f9c-0eeb8587be65 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:38:45,657 [284] [DEBUG] [app] Starting request: urn:request:a6ba26fd-e10d-4ae8-8658-10e5479f9251 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:38:45,657 [290] [DEBUG] [app] Ending request: urn:request:bdc8b05a-0b0f-47f4-9f9c-0eeb8587be65 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:bdc8b05a-0b0f-47f4-9f9c-0eeb8587be65', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:38:45,657 [284] [DEBUG] [app] Ending request: urn:request:a6ba26fd-e10d-4ae8-8658-10e5479f9251 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:a6ba26fd-e10d-4ae8-8658-10e5479f9251', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:38:45,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:38:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:38:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:38:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:38:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:38:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:38:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:38:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:38:45,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:38:45,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:38:45,660 [282] [DEBUG] [app] Starting request: urn:request:fc4853b3-53c9-440e-bf72-6b6edd055938 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:38:45,661 [282] [DEBUG] [app] Ending request: urn:request:fc4853b3-53c9-440e-bf72-6b6edd055938 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:fc4853b3-53c9-440e-bf72-6b6edd055938', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:38:45,661 [278] [DEBUG] [app] Starting request: urn:request:ff5f0fb7-de16-4067-b19f-97ab77ed8217 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:38:45,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:38:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:38:45,661 [278] [DEBUG] [app] Ending request: urn:request:ff5f0fb7-de16-4067-b19f-97ab77ed8217 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:ff5f0fb7-de16-4067-b19f-97ab77ed8217', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:38:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:38:45,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:38:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:38:45,662 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:38:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:38:45,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:38:45,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:38:45,662 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:38:45,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:38:45,669 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:38:45,676 [278] [DEBUG] [app] Ending request: urn:request:b4f34a70-ab49-4e89-aff3-ab7c50fb8e29 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b4f34a70-ab49-4e89-aff3-ab7c50fb8e29', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:38:45,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:38:45,677 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:38:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:38:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
gunicorn-web stdout | 2024-04-22 03:38:45,677 [281] [DEBUG] [app] Ending request: urn:request:2eb8367a-a014-43dc-8489-c25686f355bb (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2eb8367a-a014-43dc-8489-c25686f355bb', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:38:45,677 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:38:45,678 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:38:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:38:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
buildlogsarchiver stdout | 2024-04-22 03:38:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:38:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:17.052354+00:00 (in 29.999526 seconds)
buildlogsarchiver stdout | 2024-04-22 03:38:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:17 UTC)" (scheduled at 2024-04-22 03:38:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:38:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 38, 47, 53180), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:38:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:38:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:38:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:38:48,565 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:38:50,281 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
builder stdout | 2024-04-22 03:38:53,718 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
notificationworker stdout | 2024-04-22 03:38:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:38:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:03.759375+00:00 (in 9.999491 seconds)
notificationworker stdout | 2024-04-22 03:38:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:39:03 UTC)" (scheduled at 2024-04-22 03:38:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:38:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:38:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 38, 53, 760343), True, datetime.datetime(2024, 4, 22, 3, 38, 53, 760343), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:38:53,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:38:53,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:38:53,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:39:03 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:38:55,346 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 03:38:56,732 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
securityworker stdout | 2024-04-22 03:38:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:38:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:05.871852+00:00 (in 8.998290 seconds)
securityworker stdout | 2024-04-22 03:38:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:26 UTC)" (scheduled at 2024-04-22 03:38:56.873109+00:00)
securityworker stdout | 2024-04-22 03:38:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:38:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:38:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:38:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:38:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:38:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:38:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:38:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:38:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:38:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:38:56,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:38:56,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:38:56,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 33, 56, 880864), 1, 2])
securityworker stdout | 2024-04-22 03:38:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:38:56,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:38:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 33, 56, 880864), 1, 2])
securityworker stdout | 2024-04-22 03:38:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:38:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:38:56,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:38:56,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:38:56,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:38:56,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:38:56,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:38:56,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:38:56,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:38:56,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:26 UTC)" executed successfully
chunkcleanupworker stdout | 2024-04-22 03:38:58,693 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
teamsyncworker stdout | 2024-04-22 03:38:58,745 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:38:59,643 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:38:59,653 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:38:59,657 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:38:59,661 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:38:59,663 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:38:59,796 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:39:00,653 [278] [DEBUG] [app] Starting request: urn:request:60bc0680-6088-41b7-9349-99782c1c2049 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:39:00,653 [279] [DEBUG] [app] Starting request: urn:request:bacb75e6-71b2-4116-ba8e-4557bceba194 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:39:00,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:39:00,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:39:00,656 [291] [DEBUG] [app] Starting request: urn:request:0c6c2377-4de5-4bdc-8b06-b51e5e185cb2 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:39:00,656 [291] [DEBUG] [app] Ending request: urn:request:0c6c2377-4de5-4bdc-8b06-b51e5e185cb2 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:0c6c2377-4de5-4bdc-8b06-b51e5e185cb2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:39:00,656 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:39:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:39:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:39:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 03:39:00,657 [286] [DEBUG] [app] Starting request: urn:request:e752ead9-addb-4ce4-9f56-a1bf9dfbba9f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:39:00,658 [286] [DEBUG] [app] Ending request: urn:request:e752ead9-addb-4ce4-9f56-a1bf9dfbba9f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:e752ead9-addb-4ce4-9f56-a1bf9dfbba9f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:39:00,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:39:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.003 162 0.003)
gunicorn-registry stdout | 2024-04-22 03:39:00,658 [286] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:39:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:39:00,658 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:39:00,659 [278] [DEBUG] [app] Starting request: urn:request:c6b58473-de3b-42c5-9b14-875521e01859 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:39:00,659 [278] [DEBUG] [app] Ending request: urn:request:c6b58473-de3b-42c5-9b14-875521e01859 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:c6b58473-de3b-42c5-9b14-875521e01859', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:39:00,659 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:39:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:39:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:39:00,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:39:00,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:39:00,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:39:00,661 [282] [DEBUG] [app] Starting request: urn:request:b3a0a355-65c9-440f-97ca-5bd264f40a75 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:39:00,661 [282] [DEBUG] [app] Ending request: urn:request:b3a0a355-65c9-440f-97ca-5bd264f40a75 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b3a0a355-65c9-440f-97ca-5bd264f40a75', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:39:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 03:39:00,662 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:39:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:39:00,662 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:39:00,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:39:00,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:39:00,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:39:00,674 [278] [DEBUG] [app] Ending request: urn:request:60bc0680-6088-41b7-9349-99782c1c2049 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:60bc0680-6088-41b7-9349-99782c1c2049', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:39:00,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:39:00,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:39:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:39:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 03:39:00,675 [279] [DEBUG] [app] Ending request: urn:request:bacb75e6-71b2-4116-ba8e-4557bceba194 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:bacb75e6-71b2-4116-ba8e-4557bceba194', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:39:00,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:39:00,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:39:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:39:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
notificationworker stdout | 2024-04-22 03:39:01,195 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:39:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:39:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:16.552337+00:00 (in 13.995615 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:39:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:02 UTC)" (scheduled at 2024-04-22 03:39:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:39:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:39:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:39:02,568 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:39:02,929 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:39:02,962 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:39:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:39:03,760 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:13.759375+00:00 (in 9.999375 seconds)
notificationworker stdout | 2024-04-22 03:39:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:39:13 UTC)" (scheduled at 2024-04-22 03:39:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:39:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:39:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 39, 3, 760504), True, datetime.datetime(2024, 4, 22, 3, 39, 3, 760504), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:39:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:39:03,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:39:03,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:39:13 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 03:39:04,114 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-secscan stdout | 2024-04-22 03:39:04,249 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:39:04,252 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:39:04,255 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:39:05,242 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:39:05,353 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:39:05,552 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:39:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:39:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:26.873109+00:00 (in 21.000771 seconds)
securityworker stdout | 2024-04-22 03:39:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:35 UTC)" (scheduled at 2024-04-22 03:39:05.871852+00:00)
securityworker stdout | 2024-04-22 03:39:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:39:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:39:05,874 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:39:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:39:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:39:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:39:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:35 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:39:06,377 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
repositorygcworker stdout | 2024-04-22 03:39:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:39:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:13.555667+00:00 (in 7.002693 seconds)
repositorygcworker stdout | 2024-04-22 03:39:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:06 UTC)" (scheduled at 2024-04-22 03:39:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:39:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:39:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 39, 6, 553345), True, datetime.datetime(2024, 4, 22, 3, 39, 6, 553345), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:39:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:39:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:39:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:06 UTC)" executed successfully
securityworker stdout | 2024-04-22 03:39:07,798 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:39:07,865 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:39:08,273 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:39:08,439 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:39:09,457 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:39:10,439 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:39:10,452 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:39:10,455 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:39:10,459 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:39:10,461 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:39:10,467 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:39:10,470 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:39:10,473 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:39:10,475 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:39:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:39:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:41.264267+00:00 (in 29.999505 seconds)
autopruneworker stdout | 2024-04-22 03:39:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:41 UTC)" (scheduled at 2024-04-22 03:39:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:39:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757091271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:39:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:39:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:39:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:39:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:39:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:06.552482+00:00 (in 52.996341 seconds)
repositorygcworker stdout | 2024-04-22 03:39:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:13 UTC)" (scheduled at 2024-04-22 03:39:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:39:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:39:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:39:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:39:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:19.762424+00:00 (in 6.002512 seconds)
notificationworker stdout | 2024-04-22 03:39:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:39:23 UTC)" (scheduled at 2024-04-22 03:39:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:39:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:39:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 39, 13, 760191), True, datetime.datetime(2024, 4, 22, 3, 39, 13, 760191), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:39:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:39:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:39:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:39:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:39:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:39:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:44.952062+00:00 (in 29.999441 seconds)
gcworker stdout | 2024-04-22 03:39:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:44 UTC)" (scheduled at 2024-04-22 03:39:14.952062+00:00)
gcworker stdout | 2024-04-22 03:39:14,952 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:39:14,952 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:39:15,653 [282] [DEBUG] [app] Starting request: urn:request:af7d9d73-91eb-43f1-a303-4a99f1cd42bd (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:39:15,653 [281] [DEBUG] [app] Starting request: urn:request:07d59a58-3fb2-46a5-afbd-52285ca7007b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:39:15,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:39:15,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:39:15,656 [289] [DEBUG] [app] Starting request: urn:request:0121c33c-2bf4-4ed9-a147-c93b2504fe9d (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:39:15,656 [291] [DEBUG] [app] Starting request: urn:request:5598dbd1-6aa3-488c-a279-52e43317139a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:39:15,656 [289] [DEBUG] [app] Ending request: urn:request:0121c33c-2bf4-4ed9-a147-c93b2504fe9d (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:0121c33c-2bf4-4ed9-a147-c93b2504fe9d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:39:15,656 [291] [DEBUG] [app] Ending request: urn:request:5598dbd1-6aa3-488c-a279-52e43317139a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5598dbd1-6aa3-488c-a279-52e43317139a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:39:15,656 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:39:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:39:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:39:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:39:15,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:39:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:39:15,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:39:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:39:15,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:39:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:39:15,659 [281] [DEBUG] [app] Starting request: urn:request:3f21ccc1-a6c8-4f7e-a850-e8f9686a1a92 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:39:15,659 [281] [DEBUG] [app] Ending request: urn:request:3f21ccc1-a6c8-4f7e-a850-e8f9686a1a92 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3f21ccc1-a6c8-4f7e-a850-e8f9686a1a92', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:39:15,659 [278] [DEBUG] [app] Starting request: urn:request:d096d9fc-fdb5-407f-8d5c-feac37a0e51c (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:39:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:39:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:39:15,660 [278] [DEBUG] [app] Ending request: urn:request:d096d9fc-fdb5-407f-8d5c-feac37a0e51c (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d096d9fc-fdb5-407f-8d5c-feac37a0e51c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:39:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:39:15,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:39:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.001)
gunicorn-web stdout | 2024-04-22 03:39:15,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:39:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:39:15,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:39:15,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:39:15,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:39:15,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:39:15,670 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:39:15,674 [281] [DEBUG] [app] Ending request: urn:request:07d59a58-3fb2-46a5-afbd-52285ca7007b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:07d59a58-3fb2-46a5-afbd-52285ca7007b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:39:15,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:39:15,674 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:39:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:39:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 03:39:15,677 [282] [DEBUG] [app] Ending request: urn:request:af7d9d73-91eb-43f1-a303-4a99f1cd42bd (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:af7d9d73-91eb-43f1-a303-4a99f1cd42bd', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:39:15,677 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:39:15,678 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:39:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:39:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.026)
securityscanningnotificationworker stdout | 2024-04-22 03:39:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:39:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:02.556208+00:00 (in 46.003270 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:39:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:16 UTC)" (scheduled at 2024-04-22 03:39:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:39:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:39:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 39, 16, 553188), True, datetime.datetime(2024, 4, 22, 3, 39, 16, 553188), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:39:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:39:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:39:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:39:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:39:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:47.052354+00:00 (in 29.999445 seconds)
buildlogsarchiver stdout | 2024-04-22 03:39:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:47 UTC)" (scheduled at 2024-04-22 03:39:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:39:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 39, 17, 53286), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:39:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:39:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:39:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:39:18,601 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:39:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:39:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:23.759375+00:00 (in 3.996458 seconds)
notificationworker stdout | 2024-04-22 03:39:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:19 UTC)" (scheduled at 2024-04-22 03:39:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:39:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:39:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:39:20,288 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:39:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:39:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:43.057186+00:00 (in 20.997680 seconds)
namespacegcworker stdout | 2024-04-22 03:39:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:22 UTC)" (scheduled at 2024-04-22 03:39:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:39:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:39:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:22 UTC)" executed successfully
builder stdout | 2024-04-22 03:39:23,754 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
notificationworker stdout | 2024-04-22 03:39:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:39:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:33.759375+00:00 (in 9.999497 seconds)
notificationworker stdout | 2024-04-22 03:39:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:39:33 UTC)" (scheduled at 2024-04-22 03:39:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:39:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:39:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 39, 23, 760335), True, datetime.datetime(2024, 4, 22, 3, 39, 23, 760335), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:39:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:39:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:39:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:39:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 03:39:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:39:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:24.361582+00:00 (in 59.999499 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:39:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:24 UTC)" (scheduled at 2024-04-22 03:39:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:39:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:39:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:39:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:39:25,360 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 03:39:26,768 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
securityworker stdout | 2024-04-22 03:39:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:39:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:35.871852+00:00 (in 8.998215 seconds)
securityworker stdout | 2024-04-22 03:39:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:56 UTC)" (scheduled at 2024-04-22 03:39:26.873109+00:00)
securityworker stdout | 2024-04-22 03:39:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:39:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:39:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:39:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:39:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:39:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:39:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:39:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:39:26,882 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:39:26,892 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:39:26,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:39:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:39:26,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 34, 26, 881899), 1, 2])
securityworker stdout | 2024-04-22 03:39:26,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:39:26,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:39:26,898 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 34, 26, 881899), 1, 2])
securityworker stdout | 2024-04-22 03:39:26,900 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:39:26,900 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:39:26,900 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:39:26,900 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:39:26,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:39:26,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:39:26,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:39:26,901 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:39:26,901 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:39:26,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:39:56 UTC)" executed successfully
chunkcleanupworker stdout | 2024-04-22 03:39:28,718 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
teamsyncworker stdout | 2024-04-22 03:39:28,753 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:39:29,650 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:39:29,662 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:39:29,664 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:39:29,667 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:39:29,669 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:39:29,817 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:39:30,653 [281] [DEBUG] [app] Starting request: urn:request:b3cb6a99-8e09-4fce-a133-2040c0c8b338 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:39:30,653 [278] [DEBUG] [app] Starting request: urn:request:a977f235-7910-4190-86fd-24c72e930aa7 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:39:30,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:39:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:39:30,656 [284] [DEBUG] [app] Starting request: urn:request:60656de9-ea0d-4282-bd9e-31ff36723a2c (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:39:30,656 [292] [DEBUG] [app] Starting request: urn:request:48dc9613-c6d3-4c84-8ef7-aebeea94ded9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:39:30,656 [284] [DEBUG] [app] Ending request: urn:request:60656de9-ea0d-4282-bd9e-31ff36723a2c (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:60656de9-ea0d-4282-bd9e-31ff36723a2c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:39:30,657 [292] [DEBUG] [app] Ending request: urn:request:48dc9613-c6d3-4c84-8ef7-aebeea94ded9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:48dc9613-c6d3-4c84-8ef7-aebeea94ded9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:39:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:39:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:39:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:39:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:39:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:39:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:39:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:39:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:39:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:39:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:39:30,659 [281] [DEBUG] [app] Starting request: urn:request:e2609e18-cba6-40f1-9a6b-590821852caf (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:39:30,659 [281] [DEBUG] [app] Ending request: urn:request:e2609e18-cba6-40f1-9a6b-590821852caf (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e2609e18-cba6-40f1-9a6b-590821852caf', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:39:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:39:30,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:39:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:39:30,660 [282] [DEBUG] [app] Starting request: urn:request:2e5cb652-ac39-49cb-8c77-d678284992cf (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:39:30,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:39:30,660 [282] [DEBUG] [app] Ending request: urn:request:2e5cb652-ac39-49cb-8c77-d678284992cf (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:2e5cb652-ac39-49cb-8c77-d678284992cf', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:39:30,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:39:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:39:30,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:39:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:39:30,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:39:30,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:39:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:39:30,670 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:39:30,675 [278] [DEBUG] [app] Ending request: urn:request:a977f235-7910-4190-86fd-24c72e930aa7 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a977f235-7910-4190-86fd-24c72e930aa7', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:39:30,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:39:30,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:39:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:39:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:39:30,678 [281] [DEBUG] [app] Ending request: urn:request:b3cb6a99-8e09-4fce-a133-2040c0c8b338 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b3cb6a99-8e09-4fce-a133-2040c0c8b338', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:39:30,678 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:39:30,678 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:39:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:39:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
notificationworker stdout | 2024-04-22 03:39:31,226 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:39:32,603 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:39:32,936 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:39:32,998 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:39:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:39:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:43.759375+00:00 (in 9.999509 seconds)
notificationworker stdout | 2024-04-22 03:39:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:39:43 UTC)" (scheduled at 2024-04-22 03:39:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:39:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:39:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 39, 33, 760287), True, datetime.datetime(2024, 4, 22, 3, 39, 33, 760287), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:39:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:39:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:39:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:39:43 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 03:39:34,150 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-secscan stdout | 2024-04-22 03:39:34,257 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:39:34,259 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:39:34,262 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:39:35,264 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:39:35,378 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:39:35,589 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:39:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:39:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:56.873109+00:00 (in 21.000713 seconds)
securityworker stdout | 2024-04-22 03:39:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:05 UTC)" (scheduled at 2024-04-22 03:39:35.871852+00:00)
securityworker stdout | 2024-04-22 03:39:35,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:39:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:39:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:39:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:39:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:39:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:39:35,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:05 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:39:36,383 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:39:37,810 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:39:37,883 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:39:38,303 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:39:38,447 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:39:39,493 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
exportactionlogsworker stdout | 2024-04-22 03:39:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:39:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:41.564959+00:00 (in 1.997448 seconds)
exportactionlogsworker stdout | 2024-04-22 03:39:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:39 UTC)" (scheduled at 2024-04-22 03:39:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:39:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:39:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:39 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 03:39:40,450 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:39:40,462 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:39:40,465 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:39:40,469 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:39:40,473 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:39:40,476 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:39:40,478 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:39:40,482 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:39:40,485 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:39:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:39:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:11.264267+00:00 (in 29.999470 seconds)
autopruneworker stdout | 2024-04-22 03:39:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:11 UTC)" (scheduled at 2024-04-22 03:39:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:39:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757121272, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:39:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:39:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:39:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:39:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:39:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:39.566970+00:00 (in 58.001546 seconds)
exportactionlogsworker stdout | 2024-04-22 03:39:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:41 UTC)" (scheduled at 2024-04-22 03:39:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:39:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:39:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 39, 41, 565776), True, datetime.datetime(2024, 4, 22, 3, 39, 41, 565776), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:39:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:39:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:39:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:39:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:39:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:22.058978+00:00 (in 39.001333 seconds)
namespacegcworker stdout | 2024-04-22 03:39:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:43 UTC)" (scheduled at 2024-04-22 03:39:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:39:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:39:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 39, 43, 57900), True, datetime.datetime(2024, 4, 22, 3, 39, 43, 57900), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:39:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:39:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:39:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:40:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:39:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:39:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:39:53.759375+00:00 (in 9.999523 seconds)
notificationworker stdout | 2024-04-22 03:39:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:39:53 UTC)" (scheduled at 2024-04-22 03:39:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:39:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:39:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 39, 43, 760248), True, datetime.datetime(2024, 4, 22, 3, 39, 43, 760248), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:39:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:39:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:39:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:39:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:39:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:39:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:14.952062+00:00 (in 29.999468 seconds)
gcworker stdout | 2024-04-22 03:39:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:14 UTC)" (scheduled at 2024-04-22 03:39:44.952062+00:00)
gcworker stdout | 2024-04-22 03:39:44,952 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:39:44,953 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:39:45,652 [278] [DEBUG] [app] Starting request: urn:request:9df00f11-9d0c-481b-9606-2db1f0476d03 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:39:45,652 [282] [DEBUG] [app] Starting request: urn:request:e73fb46b-e459-46aa-b19f-efbd72b421c9 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:39:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:39:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:39:45,656 [284] [DEBUG] [app] Starting request: urn:request:7e6ff98a-717d-4913-93ab-5fb21cb00bd9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:39:45,656 [292] [DEBUG] [app] Starting request: urn:request:cf317e15-b523-4ba5-89b0-e87b941f649c (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:39:45,656 [284] [DEBUG] [app] Ending request: urn:request:7e6ff98a-717d-4913-93ab-5fb21cb00bd9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7e6ff98a-717d-4913-93ab-5fb21cb00bd9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:39:45,656 [292] [DEBUG] [app] Ending request: urn:request:cf317e15-b523-4ba5-89b0-e87b941f649c (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:cf317e15-b523-4ba5-89b0-e87b941f649c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:39:45,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:39:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:39:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:39:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:39:45,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:39:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:39:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:39:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:39:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:39:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:39:45,659 [278] [DEBUG] [app] Starting request: urn:request:001f005b-bea7-4c12-a88e-d11deaeb652e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:39:45,659 [281] [DEBUG] [app] Starting request: urn:request:a3fbf655-b186-48d6-b996-cd7c0ac6ad43 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:39:45,659 [278] [DEBUG] [app] Ending request: urn:request:001f005b-bea7-4c12-a88e-d11deaeb652e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:001f005b-bea7-4c12-a88e-d11deaeb652e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:39:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:39:45,660 [281] [DEBUG] [app] Ending request: urn:request:a3fbf655-b186-48d6-b996-cd7c0ac6ad43 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a3fbf655-b186-48d6-b996-cd7c0ac6ad43', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:39:45,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:39:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:39:45,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:39:45,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:39:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:39:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:39:45,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:39:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:39:45,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:39:45,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:39:45,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:39:45,674 [282] [DEBUG] [app] Ending request: urn:request:e73fb46b-e459-46aa-b19f-efbd72b421c9 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e73fb46b-e459-46aa-b19f-efbd72b421c9', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:39:45,674 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:39:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.022)
gunicorn-web stdout | 2024-04-22 03:39:45,674 [278] [DEBUG] [app] Ending request: urn:request:9df00f11-9d0c-481b-9606-2db1f0476d03 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:9df00f11-9d0c-481b-9606-2db1f0476d03', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:39:45,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:39:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:39:45,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:39:45,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:39:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:39:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
buildlogsarchiver stdout | 2024-04-22 03:39:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:39:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:17.052354+00:00 (in 29.999495 seconds)
buildlogsarchiver stdout | 2024-04-22 03:39:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:17 UTC)" (scheduled at 2024-04-22 03:39:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:39:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 39, 47, 53221), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:39:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:39:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:39:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:39:48,638 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:39:50,325 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:39:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:39:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:03.759375+00:00 (in 9.999471 seconds)
notificationworker stdout | 2024-04-22 03:39:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:40:03 UTC)" (scheduled at 2024-04-22 03:39:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:39:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:39:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 39, 53, 760231), True, datetime.datetime(2024, 4, 22, 3, 39, 53, 760231), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:39:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:39:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:39:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:40:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:39:53,787 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:39:55,396 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 03:39:56,804 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
securityworker stdout | 2024-04-22 03:39:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:39:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:05.871852+00:00 (in 8.998261 seconds)
securityworker stdout | 2024-04-22 03:39:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:26 UTC)" (scheduled at 2024-04-22 03:39:56.873109+00:00)
securityworker stdout | 2024-04-22 03:39:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:39:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:39:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:39:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:39:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:39:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:39:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:39:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:39:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:39:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:39:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:39:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:39:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 34, 56, 881073), 1, 2])
securityworker stdout | 2024-04-22 03:39:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:39:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:39:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 34, 56, 881073), 1, 2])
securityworker stdout | 2024-04-22 03:39:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:39:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:39:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:39:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:39:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:39:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:39:56,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:39:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:39:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:39:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:26 UTC)" executed successfully
chunkcleanupworker stdout | 2024-04-22 03:39:58,755 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
teamsyncworker stdout | 2024-04-22 03:39:58,784 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:39:59,658 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:39:59,669 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:39:59,672 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:39:59,676 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:39:59,678 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:39:59,852 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:40:00,652 [278] [DEBUG] [app] Starting request: urn:request:4f0c18c0-dde7-4a01-be1f-dcc1296fe97f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:40:00,652 [282] [DEBUG] [app] Starting request: urn:request:bef75971-7f86-42a5-b50e-de13248dbb85 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:40:00,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:40:00,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:40:00,656 [292] [DEBUG] [app] Starting request: urn:request:e0333e0b-409e-44f2-a57c-5c2cb16e5433 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:40:00,656 [292] [DEBUG] [app] Ending request: urn:request:e0333e0b-409e-44f2-a57c-5c2cb16e5433 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:e0333e0b-409e-44f2-a57c-5c2cb16e5433', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:40:00,656 [284] [DEBUG] [app] Starting request: urn:request:fea122a6-4300-40a8-afbe-20cc2c09359e (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:40:00,657 [284] [DEBUG] [app] Ending request: urn:request:fea122a6-4300-40a8-afbe-20cc2c09359e (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:fea122a6-4300-40a8-afbe-20cc2c09359e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:40:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:40:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:40:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:40:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:40:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:40:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:40:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
gunicorn-web stdout | 2024-04-22 03:40:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:40:00,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:40:00,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:40:00,659 [281] [DEBUG] [app] Starting request: urn:request:57d45423-a9d7-446e-a8ae-1f168e5099c2 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:40:00,660 [281] [DEBUG] [app] Ending request: urn:request:57d45423-a9d7-446e-a8ae-1f168e5099c2 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:57d45423-a9d7-446e-a8ae-1f168e5099c2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:40:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:40:00,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:40:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:40:00,660 [278] [DEBUG] [app] Starting request: urn:request:3fc4be08-bb5a-4aca-af5c-e451e1c0ec58 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:40:00,661 [278] [DEBUG] [app] Ending request: urn:request:3fc4be08-bb5a-4aca-af5c-e451e1c0ec58 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3fc4be08-bb5a-4aca-af5c-e451e1c0ec58', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:40:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:40:00,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:40:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:40:00,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:40:00,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:40:00,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:40:00,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:40:00,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:40:00,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:40:00,676 [278] [DEBUG] [app] Ending request: urn:request:4f0c18c0-dde7-4a01-be1f-dcc1296fe97f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:4f0c18c0-dde7-4a01-be1f-dcc1296fe97f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:40:00,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:40:00,676 [282] [DEBUG] [app] Ending request: urn:request:bef75971-7f86-42a5-b50e-de13248dbb85 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:bef75971-7f86-42a5-b50e-de13248dbb85', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:40:00,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:40:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:40:00,676 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:40:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:40:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
gunicorn-web stdout | 2024-04-22 03:40:00,677 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:40:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
notificationworker stdout | 2024-04-22 03:40:01,260 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:40:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:40:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:16.552337+00:00 (in 13.995624 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:40:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:02 UTC)" (scheduled at 2024-04-22 03:40:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:40:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:40:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:40:02,640 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:40:02,954 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:40:03,034 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:40:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:40:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:13.759375+00:00 (in 9.999430 seconds)
notificationworker stdout | 2024-04-22 03:40:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:40:13 UTC)" (scheduled at 2024-04-22 03:40:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:40:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:40:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 40, 3, 760469), True, datetime.datetime(2024, 4, 22, 3, 40, 3, 760469), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:40:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:40:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:40:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:40:13 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 03:40:04,186 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-secscan stdout | 2024-04-22 03:40:04,264 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:40:04,267 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:40:04,269 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:40:05,281 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:40:05,415 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:40:05,622 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:40:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:40:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:26.873109+00:00 (in 21.000752 seconds)
securityworker stdout | 2024-04-22 03:40:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:35 UTC)" (scheduled at 2024-04-22 03:40:05.871852+00:00)
securityworker stdout | 2024-04-22 03:40:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:40:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:40:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:40:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:40:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:40:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:40:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:35 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:40:06,419 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
repositorygcworker stdout | 2024-04-22 03:40:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:40:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:13.555667+00:00 (in 7.002719 seconds)
repositorygcworker stdout | 2024-04-22 03:40:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:06 UTC)" (scheduled at 2024-04-22 03:40:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:40:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:40:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 40, 6, 553321), True, datetime.datetime(2024, 4, 22, 3, 40, 6, 553321), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:40:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:40:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:40:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:06 UTC)" executed successfully
securityworker stdout | 2024-04-22 03:40:07,847 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:40:07,912 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:40:08,337 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:40:08,483 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:40:09,500 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:40:10,461 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:40:10,471 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:40:10,473 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:40:10,479 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:40:10,484 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:40:10,486 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:40:10,489 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:40:10,491 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:40:10,494 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:40:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:40:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:41.264267+00:00 (in 29.999490 seconds)
autopruneworker stdout | 2024-04-22 03:40:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:41 UTC)" (scheduled at 2024-04-22 03:40:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:40:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757151271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:40:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:40:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:40:11,277 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:40:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:40:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:06.552482+00:00 (in 52.996366 seconds)
repositorygcworker stdout | 2024-04-22 03:40:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:13 UTC)" (scheduled at 2024-04-22 03:40:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:40:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:40:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:40:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:40:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:19.762424+00:00 (in 6.002615 seconds)
notificationworker stdout | 2024-04-22 03:40:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:40:23 UTC)" (scheduled at 2024-04-22 03:40:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:40:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:40:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 40, 13, 760090), True, datetime.datetime(2024, 4, 22, 3, 40, 13, 760090), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:40:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:40:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:40:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:40:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:40:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:40:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:44.952062+00:00 (in 29.999483 seconds)
gcworker stdout | 2024-04-22 03:40:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:44 UTC)" (scheduled at 2024-04-22 03:40:14.952062+00:00)
gcworker stdout | 2024-04-22 03:40:14,953 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:40:14,953 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:40:15,653 [278] [DEBUG] [app] Starting request: urn:request:61db2a97-9e04-4e34-b5c7-00bc21284677 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:40:15,653 [282] [DEBUG] [app] Starting request: urn:request:4601a33c-2a33-43e9-b337-322c0c60863c (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:40:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:40:15,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:40:15,656 [284] [DEBUG] [app] Starting request: urn:request:34a0112f-50c5-47e4-8375-f553da6d950f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:40:15,656 [292] [DEBUG] [app] Starting request: urn:request:ee2da710-f8d9-463d-903d-2dc16ce9a786 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:40:15,656 [284] [DEBUG] [app] Ending request: urn:request:34a0112f-50c5-47e4-8375-f553da6d950f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:34a0112f-50c5-47e4-8375-f553da6d950f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:40:15,656 [292] [DEBUG] [app] Ending request: urn:request:ee2da710-f8d9-463d-903d-2dc16ce9a786 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:ee2da710-f8d9-463d-903d-2dc16ce9a786', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:40:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:40:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:40:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:40:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:40:15,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:40:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:40:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:40:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:40:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:40:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:40:15,659 [282] [DEBUG] [app] Starting request: urn:request:dc29004c-aeff-4edb-8796-70c4b7c5c499 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:40:15,659 [282] [DEBUG] [app] Ending request: urn:request:dc29004c-aeff-4edb-8796-70c4b7c5c499 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:dc29004c-aeff-4edb-8796-70c4b7c5c499', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:40:15,659 [279] [DEBUG] [app] Starting request: urn:request:2c3864c5-6e21-4e4f-9ffb-e00a7607ae2d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:40:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:40:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:40:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:40:15,660 [279] [DEBUG] [app] Ending request: urn:request:2c3864c5-6e21-4e4f-9ffb-e00a7607ae2d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:2c3864c5-6e21-4e4f-9ffb-e00a7607ae2d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:40:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:40:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:40:15,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:40:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:40:15,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:40:15,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:40:15,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:40:15,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:40:15,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:40:15,674 [278] [DEBUG] [app] Ending request: urn:request:61db2a97-9e04-4e34-b5c7-00bc21284677 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:61db2a97-9e04-4e34-b5c7-00bc21284677', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:40:15,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:40:15,674 [282] [DEBUG] [app] Ending request: urn:request:4601a33c-2a33-43e9-b337-322c0c60863c (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:4601a33c-2a33-43e9-b337-322c0c60863c', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:40:15,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:40:15,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:40:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:40:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:40:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:40:15,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:40:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
securityscanningnotificationworker stdout | 2024-04-22 03:40:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:40:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:02.556208+00:00 (in 46.003294 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:40:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:16 UTC)" (scheduled at 2024-04-22 03:40:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:40:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:40:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 40, 16, 553296), True, datetime.datetime(2024, 4, 22, 3, 40, 16, 553296), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:40:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:40:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:40:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:40:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:40:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:47.052354+00:00 (in 29.999466 seconds)
buildlogsarchiver stdout | 2024-04-22 03:40:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:47 UTC)" (scheduled at 2024-04-22 03:40:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:40:17,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 40, 17, 53267), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:40:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:40:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:40:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:40:18,673 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:40:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:40:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:23.759375+00:00 (in 3.996430 seconds)
notificationworker stdout | 2024-04-22 03:40:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:19 UTC)" (scheduled at 2024-04-22 03:40:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:40:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:40:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:40:20,362 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:40:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:40:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:43.057186+00:00 (in 20.997722 seconds)
namespacegcworker stdout | 2024-04-22 03:40:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:22 UTC)" (scheduled at 2024-04-22 03:40:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:40:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:40:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:40:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:40:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:33.759375+00:00 (in 9.999446 seconds)
notificationworker stdout | 2024-04-22 03:40:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:40:33 UTC)" (scheduled at 2024-04-22 03:40:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:40:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:40:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 40, 23, 760396), True, datetime.datetime(2024, 4, 22, 3, 40, 23, 760396), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:40:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:40:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:40:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:40:33 UTC)" executed successfully
builder stdout | 2024-04-22 03:40:23,815 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
quotaregistrysizeworker stdout | 2024-04-22 03:40:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:40:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:24.361582+00:00 (in 59.999477 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:40:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:24 UTC)" (scheduled at 2024-04-22 03:40:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:40:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:40:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:40:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:40:25,418 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 03:40:26,839 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
securityworker stdout | 2024-04-22 03:40:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:40:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:35.871852+00:00 (in 8.998288 seconds)
securityworker stdout | 2024-04-22 03:40:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:56 UTC)" (scheduled at 2024-04-22 03:40:26.873109+00:00)
securityworker stdout | 2024-04-22 03:40:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:40:26,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:40:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:40:26,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:40:26,876 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:40:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:40:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:40:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:40:26,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:40:26,889 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:40:26,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:40:26,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:40:26,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 35, 26, 880387), 1, 2])
securityworker stdout | 2024-04-22 03:40:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:40:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:40:26,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 35, 26, 880387), 1, 2])
securityworker stdout | 2024-04-22 03:40:26,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:40:26,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:40:26,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:40:26,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:40:26,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:40:26,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:40:26,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:40:26,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:40:26,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:40:26,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:40:56 UTC)" executed successfully
chunkcleanupworker stdout | 2024-04-22 03:40:28,793 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
teamsyncworker stdout | 2024-04-22 03:40:28,814 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:40:29,666 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:40:29,676 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:40:29,678 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:40:29,682 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:40:29,686 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:40:29,873 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:40:30,653 [278] [DEBUG] [app] Starting request: urn:request:8d7a26e2-4c58-4475-9c2e-05992336a7d1 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:40:30,653 [282] [DEBUG] [app] Starting request: urn:request:dcc1dce7-889e-4762-988f-1c327b076c62 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:40:30,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:40:30,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:40:30,656 [291] [DEBUG] [app] Starting request: urn:request:f765916b-cf38-4d72-a9b6-225c190bcb7e (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:40:30,656 [292] [DEBUG] [app] Starting request: urn:request:5a291ceb-4b27-4ff5-94b2-b0045ec8d08a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:40:30,657 [292] [DEBUG] [app] Ending request: urn:request:5a291ceb-4b27-4ff5-94b2-b0045ec8d08a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5a291ceb-4b27-4ff5-94b2-b0045ec8d08a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:40:30,657 [291] [DEBUG] [app] Ending request: urn:request:f765916b-cf38-4d72-a9b6-225c190bcb7e (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f765916b-cf38-4d72-a9b6-225c190bcb7e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:40:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:40:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:40:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:40:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:40:30,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:40:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:40:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:40:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:40:30,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:40:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:40:30,660 [278] [DEBUG] [app] Starting request: urn:request:3e6a4022-cf4c-4887-938f-c7c1e2871c56 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:40:30,660 [279] [DEBUG] [app] Starting request: urn:request:91371efb-9040-4ec4-93fe-bfc1d062327d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:40:30,660 [278] [DEBUG] [app] Ending request: urn:request:3e6a4022-cf4c-4887-938f-c7c1e2871c56 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3e6a4022-cf4c-4887-938f-c7c1e2871c56', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:40:30,660 [279] [DEBUG] [app] Ending request: urn:request:91371efb-9040-4ec4-93fe-bfc1d062327d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:91371efb-9040-4ec4-93fe-bfc1d062327d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:40:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:40:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:40:30,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:40:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:40:30,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:40:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:40:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:40:30,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:40:30,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:40:30,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:40:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:40:30,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:40:30,674 [278] [DEBUG] [app] Ending request: urn:request:8d7a26e2-4c58-4475-9c2e-05992336a7d1 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:8d7a26e2-4c58-4475-9c2e-05992336a7d1', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:40:30,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:40:30,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:40:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:40:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:40:30,678 [282] [DEBUG] [app] Ending request: urn:request:dcc1dce7-889e-4762-988f-1c327b076c62 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:dcc1dce7-889e-4762-988f-1c327b076c62', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:40:30,678 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:40:30,679 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:40:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:40:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.027 118 0.027)
notificationworker stdout | 2024-04-22 03:40:31,280 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:40:32,664 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:40:32,985 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:40:33,070 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:40:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:40:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:43.759375+00:00 (in 9.999426 seconds)
notificationworker stdout | 2024-04-22 03:40:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:40:43 UTC)" (scheduled at 2024-04-22 03:40:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:40:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:40:33,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 40, 33, 760225), True, datetime.datetime(2024, 4, 22, 3, 40, 33, 760225), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:40:33,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:40:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:40:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:40:43 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 03:40:34,214 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-secscan stdout | 2024-04-22 03:40:34,272 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:40:34,274 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:40:34,277 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:40:35,317 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:40:35,443 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:40:35,658 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:40:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:40:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:56.873109+00:00 (in 21.000821 seconds)
securityworker stdout | 2024-04-22 03:40:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:05 UTC)" (scheduled at 2024-04-22 03:40:35.871852+00:00)
securityworker stdout | 2024-04-22 03:40:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:40:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:40:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:40:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:40:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:40:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:40:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:05 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:40:36,446 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:40:37,878 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:40:37,935 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:40:38,363 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:40:38,489 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:40:39,536 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
exportactionlogsworker stdout | 2024-04-22 03:40:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:40:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:41.564959+00:00 (in 1.997481 seconds)
exportactionlogsworker stdout | 2024-04-22 03:40:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:39 UTC)" (scheduled at 2024-04-22 03:40:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:40:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:40:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:39 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 03:40:40,471 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:40:40,480 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:40:40,482 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:40:40,490 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:40:40,493 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:40:40,496 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:40:40,499 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:40:40,501 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:40:40,505 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:40:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:40:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:11.264267+00:00 (in 29.999459 seconds)
autopruneworker stdout | 2024-04-22 03:40:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:11 UTC)" (scheduled at 2024-04-22 03:40:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:40:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757181271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:40:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:40:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:40:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:40:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:40:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:39.566970+00:00 (in 58.001464 seconds)
exportactionlogsworker stdout | 2024-04-22 03:40:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:41 UTC)" (scheduled at 2024-04-22 03:40:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:40:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:40:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 40, 41, 565838), True, datetime.datetime(2024, 4, 22, 3, 40, 41, 565838), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:40:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:40:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:40:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:40:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:40:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:22.058978+00:00 (in 39.001290 seconds)
namespacegcworker stdout | 2024-04-22 03:40:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:43 UTC)" (scheduled at 2024-04-22 03:40:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:40:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:40:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 40, 43, 58024), True, datetime.datetime(2024, 4, 22, 3, 40, 43, 58024), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:40:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:40:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:40:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:41:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:40:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:40:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:40:53.759375+00:00 (in 9.999471 seconds)
notificationworker stdout | 2024-04-22 03:40:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:40:53 UTC)" (scheduled at 2024-04-22 03:40:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:40:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:40:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 40, 43, 760347), True, datetime.datetime(2024, 4, 22, 3, 40, 43, 760347), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:40:43,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:40:43,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:40:43,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:40:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:40:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:40:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:14.952062+00:00 (in 29.999506 seconds)
gcworker stdout | 2024-04-22 03:40:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:14 UTC)" (scheduled at 2024-04-22 03:40:44.952062+00:00)
gcworker stdout | 2024-04-22 03:40:44,952 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:40:44,953 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:40:45,653 [281] [DEBUG] [app] Starting request: urn:request:484049e8-56e4-46e9-8d48-d096a18715ff (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:40:45,653 [278] [DEBUG] [app] Starting request: urn:request:bb625eee-a914-4a8c-9c2b-ab395543cdd4 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:40:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:40:45,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:40:45,656 [284] [DEBUG] [app] Starting request: urn:request:7f7bb892-38e0-4c9b-b998-a91bd704c9ef (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:40:45,656 [284] [DEBUG] [app] Ending request: urn:request:7f7bb892-38e0-4c9b-b998-a91bd704c9ef (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7f7bb892-38e0-4c9b-b998-a91bd704c9ef', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:40:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:40:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:40:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:40:45,657 [291] [DEBUG] [app] Starting request: urn:request:8d81c495-7fd5-4974-abb8-2454d4c5d40a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:40:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 03:40:45,657 [291] [DEBUG] [app] Ending request: urn:request:8d81c495-7fd5-4974-abb8-2454d4c5d40a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:8d81c495-7fd5-4974-abb8-2454d4c5d40a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:40:45,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:40:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:40:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:40:45,658 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:40:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:40:45,660 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:40:45,660 [279] [DEBUG] [app] Starting request: urn:request:928c8be9-a47c-4882-9d2b-92fb0bcf93d4 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:40:45,660 [279] [DEBUG] [app] Ending request: urn:request:928c8be9-a47c-4882-9d2b-92fb0bcf93d4 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:928c8be9-a47c-4882-9d2b-92fb0bcf93d4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:40:45,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:40:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:40:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 03:40:45,661 [278] [DEBUG] [app] Starting request: urn:request:d6e97484-a35c-4a67-bda5-c6a9d13da125 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:40:45,661 [278] [DEBUG] [app] Ending request: urn:request:d6e97484-a35c-4a67-bda5-c6a9d13da125 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d6e97484-a35c-4a67-bda5-c6a9d13da125', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:40:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:40:45,662 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:40:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:40:45,662 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:40:45,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:40:45,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:40:45,662 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:40:45,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:40:45,669 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:40:45,676 [278] [DEBUG] [app] Ending request: urn:request:bb625eee-a914-4a8c-9c2b-ab395543cdd4 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:bb625eee-a914-4a8c-9c2b-ab395543cdd4', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:40:45,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:40:45,677 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:40:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:40:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
gunicorn-web stdout | 2024-04-22 03:40:45,677 [281] [DEBUG] [app] Ending request: urn:request:484049e8-56e4-46e9-8d48-d096a18715ff (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:484049e8-56e4-46e9-8d48-d096a18715ff', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:40:45,678 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:40:45,678 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:40:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:40:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
buildlogsarchiver stdout | 2024-04-22 03:40:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:40:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:17.052354+00:00 (in 29.999524 seconds)
buildlogsarchiver stdout | 2024-04-22 03:40:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:17 UTC)" (scheduled at 2024-04-22 03:40:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:40:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 40, 47, 53160), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:40:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:40:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:40:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:40:48,711 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:40:50,378 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:40:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:40:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:03.759375+00:00 (in 9.999463 seconds)
notificationworker stdout | 2024-04-22 03:40:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:41:03 UTC)" (scheduled at 2024-04-22 03:40:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:40:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:40:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 40, 53, 760205), True, datetime.datetime(2024, 4, 22, 3, 40, 53, 760205), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:40:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:40:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:40:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:41:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:40:53,852 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:40:55,433 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:40:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:40:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:05.871852+00:00 (in 8.998287 seconds)
securityworker stdout | 2024-04-22 03:40:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:26 UTC)" (scheduled at 2024-04-22 03:40:56.873109+00:00)
securityworker stdout | 2024-04-22 03:40:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:40:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
repositorygcworker stdout | 2024-04-22 03:40:56,876 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
securityworker stdout | 2024-04-22 03:40:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:40:56,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:40:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:40:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:40:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:40:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:40:56,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:40:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:40:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:40:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:40:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 35, 56, 880609), 1, 2])
securityworker stdout | 2024-04-22 03:40:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:40:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:40:56,900 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 35, 56, 880609), 1, 2])
securityworker stdout | 2024-04-22 03:40:56,902 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:40:56,902 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:40:56,902 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:40:56,902 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:40:56,902 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:40:56,902 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:40:56,902 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:40:56,903 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:40:56,903 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:40:56,903 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:26 UTC)" executed successfully
chunkcleanupworker stdout | 2024-04-22 03:40:58,800 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
teamsyncworker stdout | 2024-04-22 03:40:58,823 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:40:59,674 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:40:59,684 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:40:59,686 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:40:59,690 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:40:59,693 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:40:59,889 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:41:00,653 [282] [DEBUG] [app] Starting request: urn:request:02fdfead-33e1-4a9b-ab39-1d788216f540 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:41:00,653 [281] [DEBUG] [app] Starting request: urn:request:3291090b-c453-4bfd-9594-2e0097a1af2a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:41:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:41:00,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:41:00,656 [284] [DEBUG] [app] Starting request: urn:request:61d1bb34-a10d-46a5-8151-3c249c0367ea (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:41:00,656 [291] [DEBUG] [app] Starting request: urn:request:f6b0e04c-76db-4f5e-b2f6-5e37d43850f7 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:41:00,656 [284] [DEBUG] [app] Ending request: urn:request:61d1bb34-a10d-46a5-8151-3c249c0367ea (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:61d1bb34-a10d-46a5-8151-3c249c0367ea', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:41:00,656 [291] [DEBUG] [app] Ending request: urn:request:f6b0e04c-76db-4f5e-b2f6-5e37d43850f7 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f6b0e04c-76db-4f5e-b2f6-5e37d43850f7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:41:00,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:41:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:41:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:41:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:41:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:41:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-web stdout | 2024-04-22 03:41:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:41:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:41:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:41:00,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:41:00,659 [278] [DEBUG] [app] Starting request: urn:request:f71821c1-a45f-4a1a-983f-cd5dcb46e4fb (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:41:00,660 [278] [DEBUG] [app] Ending request: urn:request:f71821c1-a45f-4a1a-983f-cd5dcb46e4fb (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:f71821c1-a45f-4a1a-983f-cd5dcb46e4fb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:41:00,660 [282] [DEBUG] [app] Starting request: urn:request:2ccfc660-915a-48fd-a8e3-e10072ff8d0e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:41:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:41:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:41:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:41:00,660 [282] [DEBUG] [app] Ending request: urn:request:2ccfc660-915a-48fd-a8e3-e10072ff8d0e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:2ccfc660-915a-48fd-a8e3-e10072ff8d0e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:41:00,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:41:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:41:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:41:00,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:41:00,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:41:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:41:00,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:41:00,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:41:00,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:41:00,675 [281] [DEBUG] [app] Ending request: urn:request:3291090b-c453-4bfd-9594-2e0097a1af2a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:3291090b-c453-4bfd-9594-2e0097a1af2a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:41:00,676 [282] [DEBUG] [app] Ending request: urn:request:02fdfead-33e1-4a9b-ab39-1d788216f540 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:02fdfead-33e1-4a9b-ab39-1d788216f540', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:41:00,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:41:00,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:41:00,676 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:41:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:41:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:41:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:41:00,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:41:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
notificationworker stdout | 2024-04-22 03:41:01,297 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:41:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:41:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:16.552337+00:00 (in 13.995678 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:41:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:02 UTC)" (scheduled at 2024-04-22 03:41:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:41:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:41:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:41:02,671 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:41:02,995 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:41:03,107 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:41:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:41:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:13.759375+00:00 (in 9.999443 seconds)
notificationworker stdout | 2024-04-22 03:41:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:41:13 UTC)" (scheduled at 2024-04-22 03:41:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:41:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:41:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 41, 3, 760425), True, datetime.datetime(2024, 4, 22, 3, 41, 3, 760425), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:41:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:41:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:41:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:41:13 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 03:41:04,251 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-secscan stdout | 2024-04-22 03:41:04,278 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:41:04,282 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:41:04,285 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:41:05,350 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:41:05,453 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:41:05,665 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:41:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:41:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:26.873109+00:00 (in 21.000759 seconds)
securityworker stdout | 2024-04-22 03:41:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:35 UTC)" (scheduled at 2024-04-22 03:41:05.871852+00:00)
securityworker stdout | 2024-04-22 03:41:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:41:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:41:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:41:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:41:05,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:41:05,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:41:05,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:35 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:41:06,456 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
repositorygcworker stdout | 2024-04-22 03:41:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:41:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:13.555667+00:00 (in 7.002752 seconds)
repositorygcworker stdout | 2024-04-22 03:41:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:06 UTC)" (scheduled at 2024-04-22 03:41:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:41:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:41:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 41, 6, 553269), True, datetime.datetime(2024, 4, 22, 3, 41, 6, 553269), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:41:06,568 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:41:06,568 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:41:06,568 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:06 UTC)" executed successfully
securityworker stdout | 2024-04-22 03:41:07,888 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:41:07,956 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:41:08,381 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:41:08,496 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:41:09,566 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:41:10,480 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:41:10,489 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:41:10,493 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:41:10,499 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:41:10,503 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:41:10,506 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:41:10,511 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:41:10,515 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:41:10,519 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:41:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:41:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:41.264267+00:00 (in 29.999511 seconds)
autopruneworker stdout | 2024-04-22 03:41:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:41 UTC)" (scheduled at 2024-04-22 03:41:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:41:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757211271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:41:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:41:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:41:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:41:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:41:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:51.555445+00:00 (in 37.999316 seconds)
repositorygcworker stdout | 2024-04-22 03:41:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:13 UTC)" (scheduled at 2024-04-22 03:41:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:41:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:41:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:41:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:41:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:19.762424+00:00 (in 6.002574 seconds)
notificationworker stdout | 2024-04-22 03:41:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:41:23 UTC)" (scheduled at 2024-04-22 03:41:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:41:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:41:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 41, 13, 760103), True, datetime.datetime(2024, 4, 22, 3, 41, 13, 760103), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:41:13,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:41:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:41:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:41:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:41:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:41:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:44.952062+00:00 (in 29.999507 seconds)
gcworker stdout | 2024-04-22 03:41:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:44 UTC)" (scheduled at 2024-04-22 03:41:14.952062+00:00)
gcworker stdout | 2024-04-22 03:41:14,953 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:41:14,953 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:41:15,653 [278] [DEBUG] [app] Starting request: urn:request:6dfdacd0-5ee0-4c5d-a7e9-a7bbc89324ce (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:41:15,653 [281] [DEBUG] [app] Starting request: urn:request:6ef781a3-c917-4399-b63c-49491c7a8e8b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:41:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:41:15,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:41:15,656 [291] [DEBUG] [app] Starting request: urn:request:bcdcc2d8-aff1-4c75-abc5-4ad24819bf25 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:41:15,656 [285] [DEBUG] [app] Starting request: urn:request:d1825a50-4cad-4693-928d-dcaa593ed938 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:41:15,657 [291] [DEBUG] [app] Ending request: urn:request:bcdcc2d8-aff1-4c75-abc5-4ad24819bf25 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:bcdcc2d8-aff1-4c75-abc5-4ad24819bf25', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:41:15,657 [285] [DEBUG] [app] Ending request: urn:request:d1825a50-4cad-4693-928d-dcaa593ed938 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:d1825a50-4cad-4693-928d-dcaa593ed938', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:41:15,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:41:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:41:15,657 [285] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:41:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:41:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:41:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:41:15,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:41:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:41:15,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:41:15,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:41:15,660 [279] [DEBUG] [app] Starting request: urn:request:819f8418-94ae-4c60-963c-3b5f41b21622 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:41:15,660 [279] [DEBUG] [app] Ending request: urn:request:819f8418-94ae-4c60-963c-3b5f41b21622 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:819f8418-94ae-4c60-963c-3b5f41b21622', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:41:15,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:41:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:41:15,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:41:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:41:15,661 [282] [DEBUG] [app] Starting request: urn:request:33c1b634-b3bf-4176-9d86-6c01866ee416 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:41:15,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:41:15,661 [282] [DEBUG] [app] Ending request: urn:request:33c1b634-b3bf-4176-9d86-6c01866ee416 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:33c1b634-b3bf-4176-9d86-6c01866ee416', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:41:15,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:41:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:41:15,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:41:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:41:15,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:41:15,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:41:15,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:41:15,675 [281] [DEBUG] [app] Ending request: urn:request:6ef781a3-c917-4399-b63c-49491c7a8e8b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:6ef781a3-c917-4399-b63c-49491c7a8e8b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:41:15,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:41:15,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:41:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:41:15,675 [278] [DEBUG] [app] Ending request: urn:request:6dfdacd0-5ee0-4c5d-a7e9-a7bbc89324ce (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:6dfdacd0-5ee0-4c5d-a7e9-a7bbc89324ce', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:41:15,676 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:41:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:41:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:41:15,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:41:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
securityscanningnotificationworker stdout | 2024-04-22 03:41:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:41:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:02.556208+00:00 (in 46.003343 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:41:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:16 UTC)" (scheduled at 2024-04-22 03:41:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:41:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:41:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 41, 16, 553339), True, datetime.datetime(2024, 4, 22, 3, 41, 16, 553339), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:41:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:41:16,565 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:41:16,565 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:41:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:41:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:47.052354+00:00 (in 29.999394 seconds)
buildlogsarchiver stdout | 2024-04-22 03:41:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:47 UTC)" (scheduled at 2024-04-22 03:41:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:41:17,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 41, 17, 53397), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:41:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:41:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:41:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:41:18,747 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:41:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:41:19,763 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:23.759375+00:00 (in 3.996384 seconds)
notificationworker stdout | 2024-04-22 03:41:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:19 UTC)" (scheduled at 2024-04-22 03:41:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:41:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:41:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:41:20,415 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:41:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:41:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:43.057186+00:00 (in 20.997676 seconds)
namespacegcworker stdout | 2024-04-22 03:41:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:22 UTC)" (scheduled at 2024-04-22 03:41:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:41:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:41:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:41:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:41:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:33.759375+00:00 (in 9.999448 seconds)
notificationworker stdout | 2024-04-22 03:41:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:41:33 UTC)" (scheduled at 2024-04-22 03:41:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:41:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:41:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 41, 23, 760401), True, datetime.datetime(2024, 4, 22, 3, 41, 23, 760401), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:41:23,773 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:41:23,773 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:41:23,773 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:41:33 UTC)" executed successfully
builder stdout | 2024-04-22 03:41:23,887 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
quotaregistrysizeworker stdout | 2024-04-22 03:41:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:41:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:24.361582+00:00 (in 59.999529 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:41:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:24 UTC)" (scheduled at 2024-04-22 03:41:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:41:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:41:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:41:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:41:25,456 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:41:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:41:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:35.871852+00:00 (in 8.998221 seconds)
securityworker stdout | 2024-04-22 03:41:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:56 UTC)" (scheduled at 2024-04-22 03:41:26.873109+00:00)
securityworker stdout | 2024-04-22 03:41:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:41:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:41:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:41:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:41:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:41:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:41:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:41:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:41:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:41:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:41:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:41:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:41:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 36, 26, 881160), 1, 2])
securityworker stdout | 2024-04-22 03:41:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:41:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:41:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 36, 26, 881160), 1, 2])
securityworker stdout | 2024-04-22 03:41:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:41:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:41:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:41:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:41:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:41:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:41:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:41:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:41:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:41:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:41:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:41:26,904 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
chunkcleanupworker stdout | 2024-04-22 03:41:28,837 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
teamsyncworker stdout | 2024-04-22 03:41:28,859 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:41:29,682 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:41:29,691 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:41:29,693 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:41:29,697 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:41:29,699 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:41:29,925 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:41:30,653 [282] [DEBUG] [app] Starting request: urn:request:7e94fdd8-d0d1-4ab7-8511-0fa265476065 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:41:30,653 [281] [DEBUG] [app] Starting request: urn:request:a096df9a-8135-41ee-9f3c-cf66ce49e5ab (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:41:30,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:41:30,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:41:30,656 [292] [DEBUG] [app] Starting request: urn:request:bef83bda-8910-4831-89fa-a8742ad2d7d2 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:41:30,656 [284] [DEBUG] [app] Starting request: urn:request:dedb1c4b-b7a9-4b56-a946-23a5acc89c28 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:41:30,656 [292] [DEBUG] [app] Ending request: urn:request:bef83bda-8910-4831-89fa-a8742ad2d7d2 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:bef83bda-8910-4831-89fa-a8742ad2d7d2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:41:30,656 [284] [DEBUG] [app] Ending request: urn:request:dedb1c4b-b7a9-4b56-a946-23a5acc89c28 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:dedb1c4b-b7a9-4b56-a946-23a5acc89c28', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:41:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:41:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:41:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:41:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:41:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:41:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:41:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:41:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:41:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:41:30,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:41:30,659 [282] [DEBUG] [app] Starting request: urn:request:5992da2b-e2b6-41b3-b7c1-63109263f777 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:41:30,659 [282] [DEBUG] [app] Ending request: urn:request:5992da2b-e2b6-41b3-b7c1-63109263f777 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:5992da2b-e2b6-41b3-b7c1-63109263f777', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:41:30,659 [278] [DEBUG] [app] Starting request: urn:request:6f3a98e0-cbc7-4000-a944-9b41ebb11062 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:41:30,660 [278] [DEBUG] [app] Ending request: urn:request:6f3a98e0-cbc7-4000-a944-9b41ebb11062 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:6f3a98e0-cbc7-4000-a944-9b41ebb11062', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:41:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:41:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:41:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:41:30,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:41:30,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:41:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:41:30,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:41:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:41:30,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:41:30,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:41:30,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:41:30,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:41:30,674 [281] [DEBUG] [app] Ending request: urn:request:a096df9a-8135-41ee-9f3c-cf66ce49e5ab (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a096df9a-8135-41ee-9f3c-cf66ce49e5ab', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:41:30,674 [282] [DEBUG] [app] Ending request: urn:request:7e94fdd8-d0d1-4ab7-8511-0fa265476065 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:7e94fdd8-d0d1-4ab7-8511-0fa265476065', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:41:30,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:41:30,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:41:30,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:41:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:41:30,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:41:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:41:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:41:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
notificationworker stdout | 2024-04-22 03:41:31,333 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:41:32,707 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:41:33,020 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:41:33,119 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:41:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:41:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:43.759375+00:00 (in 9.999436 seconds)
notificationworker stdout | 2024-04-22 03:41:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:41:43 UTC)" (scheduled at 2024-04-22 03:41:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:41:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:41:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 41, 33, 760229), True, datetime.datetime(2024, 4, 22, 3, 41, 33, 760229), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:41:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:41:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:41:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:41:43 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 03:41:34,258 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-secscan stdout | 2024-04-22 03:41:34,284 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:41:34,289 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:41:34,291 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:41:35,377 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:41:35,469 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:41:35,701 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:41:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:41:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:56.873109+00:00 (in 21.000830 seconds)
securityworker stdout | 2024-04-22 03:41:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:05 UTC)" (scheduled at 2024-04-22 03:41:35.871852+00:00)
securityworker stdout | 2024-04-22 03:41:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:41:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:41:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:41:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:41:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:41:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:41:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:05 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:41:36,486 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:41:37,925 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:41:37,962 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:41:38,419 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:41:38,505 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
exportactionlogsworker stdout | 2024-04-22 03:41:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:41:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:41.564959+00:00 (in 1.997454 seconds)
exportactionlogsworker stdout | 2024-04-22 03:41:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:39 UTC)" (scheduled at 2024-04-22 03:41:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:41:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:41:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:41:39,603 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:41:40,489 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:41:40,502 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:41:40,505 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:41:40,507 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:41:40,511 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:41:40,514 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:41:40,519 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:41:40,524 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:41:40,530 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:41:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:41:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:11.264267+00:00 (in 29.999411 seconds)
autopruneworker stdout | 2024-04-22 03:41:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:11 UTC)" (scheduled at 2024-04-22 03:41:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:41:41,273 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757241272, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:41:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:41:41,277 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:41:41,277 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:41:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:41:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:53.566665+00:00 (in 12.001265 seconds)
exportactionlogsworker stdout | 2024-04-22 03:41:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:41 UTC)" (scheduled at 2024-04-22 03:41:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:41:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:41:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 41, 41, 565635), True, datetime.datetime(2024, 4, 22, 3, 41, 41, 565635), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:41:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:41:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:41:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:41:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:41:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:22.058978+00:00 (in 39.001300 seconds)
namespacegcworker stdout | 2024-04-22 03:41:43,058 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:43 UTC)" (scheduled at 2024-04-22 03:41:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:41:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:41:43,059 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 41, 43, 58273), True, datetime.datetime(2024, 4, 22, 3, 41, 43, 58273), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:41:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:41:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:41:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:42:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:41:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:41:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:41:53.759375+00:00 (in 9.999459 seconds)
notificationworker stdout | 2024-04-22 03:41:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:41:53 UTC)" (scheduled at 2024-04-22 03:41:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:41:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:41:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 41, 43, 760172), True, datetime.datetime(2024, 4, 22, 3, 41, 43, 760172), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:41:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:41:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:41:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:41:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:41:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:41:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:14.952062+00:00 (in 29.999469 seconds)
gcworker stdout | 2024-04-22 03:41:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:14 UTC)" (scheduled at 2024-04-22 03:41:44.952062+00:00)
gcworker stdout | 2024-04-22 03:41:44,952 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:41:44,952 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:41:45,653 [281] [DEBUG] [app] Starting request: urn:request:b2fc70fe-a288-497e-9dc7-b91e746f867c (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:41:45,653 [282] [DEBUG] [app] Starting request: urn:request:a1c83423-d484-4846-873d-d3c4ec8e8116 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:41:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:41:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:41:45,656 [285] [DEBUG] [app] Starting request: urn:request:4b1d6291-fecc-45b3-ab6a-31e52ff0d700 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:41:45,656 [291] [DEBUG] [app] Starting request: urn:request:a691e516-47a0-48ad-9be1-5c886953cbe8 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:41:45,656 [285] [DEBUG] [app] Ending request: urn:request:4b1d6291-fecc-45b3-ab6a-31e52ff0d700 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:4b1d6291-fecc-45b3-ab6a-31e52ff0d700', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:41:45,656 [291] [DEBUG] [app] Ending request: urn:request:a691e516-47a0-48ad-9be1-5c886953cbe8 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:a691e516-47a0-48ad-9be1-5c886953cbe8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:41:45,657 [285] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:41:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:41:45,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:41:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:41:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:41:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:41:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:41:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:41:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:41:45,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:41:45,659 [282] [DEBUG] [app] Starting request: urn:request:81dc4e33-a467-4cd1-8627-2451bb848c56 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:41:45,660 [282] [DEBUG] [app] Ending request: urn:request:81dc4e33-a467-4cd1-8627-2451bb848c56 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:81dc4e33-a467-4cd1-8627-2451bb848c56', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:41:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:41:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:41:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:41:45,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:41:45,661 [278] [DEBUG] [app] Starting request: urn:request:74936a76-3f1e-417b-a6d5-1b9e44390e36 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:41:45,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:41:45,661 [278] [DEBUG] [app] Ending request: urn:request:74936a76-3f1e-417b-a6d5-1b9e44390e36 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:74936a76-3f1e-417b-a6d5-1b9e44390e36', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:41:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:41:45,662 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:41:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:41:45,662 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:41:45,662 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:41:45,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:41:45,668 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:41:45,675 [282] [DEBUG] [app] Ending request: urn:request:a1c83423-d484-4846-873d-d3c4ec8e8116 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a1c83423-d484-4846-873d-d3c4ec8e8116', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:41:45,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:41:45,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:41:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:41:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:41:45,676 [281] [DEBUG] [app] Ending request: urn:request:b2fc70fe-a288-497e-9dc7-b91e746f867c (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b2fc70fe-a288-497e-9dc7-b91e746f867c', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:41:45,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:41:45,677 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:41:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:41:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
buildlogsarchiver stdout | 2024-04-22 03:41:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:41:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:17.052354+00:00 (in 29.999468 seconds)
buildlogsarchiver stdout | 2024-04-22 03:41:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:17 UTC)" (scheduled at 2024-04-22 03:41:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:41:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 41, 47, 53214), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:41:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:41:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:41:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:41:48,785 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:41:50,451 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
repositorygcworker stdout | 2024-04-22 03:41:51,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:41:51,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:06.552482+00:00 (in 14.996483 seconds)
repositorygcworker stdout | 2024-04-22 03:41:51,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:46:51 UTC)" (scheduled at 2024-04-22 03:41:51.555445+00:00)
repositorygcworker stdout | 2024-04-22 03:41:51,556 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 41, 51, 556374), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 03:41:51,567 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 41, 51, 556374), True, datetime.datetime(2024, 4, 22, 3, 41, 51, 556374), 0, 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 03:41:51,569 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 41, 51, 556374), True, datetime.datetime(2024, 4, 22, 3, 41, 51, 556374), 0, 'repositorygc/%', False, datetime.datetime(2024, 4, 22, 3, 41, 51, 556374), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 03:41:51,571 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:41:51,572 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:46:51 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:41:53,566 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:41:53,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:39.566970+00:00 (in 45.999812 seconds)
exportactionlogsworker stdout | 2024-04-22 03:41:53,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:46:53 UTC)" (scheduled at 2024-04-22 03:41:53.566665+00:00)
exportactionlogsworker stdout | 2024-04-22 03:41:53,568 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 41, 53, 567413), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 03:41:53,577 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 41, 53, 567413), True, datetime.datetime(2024, 4, 22, 3, 41, 53, 567413), 0, 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 03:41:53,580 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 41, 53, 567413), True, datetime.datetime(2024, 4, 22, 3, 41, 53, 567413), 0, 'exportactionlogs/%', False, datetime.datetime(2024, 4, 22, 3, 41, 53, 567413), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 03:41:53,582 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:41:53,582 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:46:53 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:41:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:41:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:03.759375+00:00 (in 9.999471 seconds)
notificationworker stdout | 2024-04-22 03:41:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:42:03 UTC)" (scheduled at 2024-04-22 03:41:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:41:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:41:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 41, 53, 760219), True, datetime.datetime(2024, 4, 22, 3, 41, 53, 760219), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:41:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:41:53,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:41:53,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:42:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:41:53,915 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:41:55,492 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:41:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:41:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:05.871852+00:00 (in 8.998248 seconds)
securityworker stdout | 2024-04-22 03:41:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:26 UTC)" (scheduled at 2024-04-22 03:41:56.873109+00:00)
securityworker stdout | 2024-04-22 03:41:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:41:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:41:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:41:56,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:41:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:41:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:41:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:41:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:41:56,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:41:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:41:56,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:41:56,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:41:56,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 36, 56, 880635), 1, 2])
securityworker stdout | 2024-04-22 03:41:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:41:56,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:41:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 36, 56, 880635), 1, 2])
securityworker stdout | 2024-04-22 03:41:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:41:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:41:56,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:41:56,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:41:56,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:41:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:41:56,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:41:56,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:41:56,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:41:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:41:56,940 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:41:58,867 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:41:58,870 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:41:59,689 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:41:59,699 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:41:59,702 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:41:59,705 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:41:59,707 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:41:59,933 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:42:00,653 [281] [DEBUG] [app] Starting request: urn:request:0d5d54f7-2abb-45eb-80e9-a3439018d7ec (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:42:00,653 [278] [DEBUG] [app] Starting request: urn:request:ecad7209-966a-473c-b357-aea03f6b7584 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:42:00,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:42:00,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:42:00,656 [291] [DEBUG] [app] Starting request: urn:request:cf847bad-bc49-4a58-960b-4e7cb64e7048 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:42:00,657 [291] [DEBUG] [app] Ending request: urn:request:cf847bad-bc49-4a58-960b-4e7cb64e7048 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:cf847bad-bc49-4a58-960b-4e7cb64e7048', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:42:00,657 [292] [DEBUG] [app] Starting request: urn:request:0c2bee4b-bd99-4c76-8f14-8d820152db53 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:42:00,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:42:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:42:00,657 [292] [DEBUG] [app] Ending request: urn:request:0c2bee4b-bd99-4c76-8f14-8d820152db53 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:0c2bee4b-bd99-4c76-8f14-8d820152db53', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:42:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:42:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:42:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:42:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:42:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:42:00,658 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:42:00,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:42:00,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:42:00,660 [279] [DEBUG] [app] Starting request: urn:request:2da88cb4-db05-4c98-975b-ce03cefe7154 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:42:00,660 [279] [DEBUG] [app] Ending request: urn:request:2da88cb4-db05-4c98-975b-ce03cefe7154 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:2da88cb4-db05-4c98-975b-ce03cefe7154', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:42:00,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:42:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:42:00,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:42:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 03:42:00,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:42:00,661 [282] [DEBUG] [app] Starting request: urn:request:3b703a39-7db9-4252-8676-38a2f77200a7 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:42:00,661 [282] [DEBUG] [app] Ending request: urn:request:3b703a39-7db9-4252-8676-38a2f77200a7 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3b703a39-7db9-4252-8676-38a2f77200a7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:42:00,662 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:42:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:42:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:42:00,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:42:00,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:42:00,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:42:00,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:42:00,675 [281] [DEBUG] [app] Ending request: urn:request:0d5d54f7-2abb-45eb-80e9-a3439018d7ec (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:0d5d54f7-2abb-45eb-80e9-a3439018d7ec', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:42:00,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:42:00,676 [278] [DEBUG] [app] Ending request: urn:request:ecad7209-966a-473c-b357-aea03f6b7584 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:ecad7209-966a-473c-b357-aea03f6b7584', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:42:00,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:42:00,676 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:42:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:42:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:42:00,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:42:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:42:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
notificationworker stdout | 2024-04-22 03:42:01,340 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:42:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:42:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:16.552337+00:00 (in 13.995671 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:42:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:02 UTC)" (scheduled at 2024-04-22 03:42:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:42:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:42:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:42:02,713 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:42:03,026 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:42:03,129 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:42:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:42:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:13.759375+00:00 (in 9.999459 seconds)
notificationworker stdout | 2024-04-22 03:42:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:42:13 UTC)" (scheduled at 2024-04-22 03:42:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:42:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:42:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 42, 3, 760332), True, datetime.datetime(2024, 4, 22, 3, 42, 3, 760332), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:42:03,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:42:03,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:42:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:42:13 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:42:04,294 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
logrotateworker stdout | 2024-04-22 03:42:04,297 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-secscan stdout | 2024-04-22 03:42:04,300 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:42:04,302 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:42:05,383 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:42:05,505 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:42:05,738 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:42:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:42:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:26.873109+00:00 (in 21.000752 seconds)
securityworker stdout | 2024-04-22 03:42:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:35 UTC)" (scheduled at 2024-04-22 03:42:05.871852+00:00)
securityworker stdout | 2024-04-22 03:42:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:42:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:42:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:42:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:42:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:42:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:42:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:35 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:42:06,520 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
repositorygcworker stdout | 2024-04-22 03:42:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:42:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:13.555667+00:00 (in 7.002679 seconds)
repositorygcworker stdout | 2024-04-22 03:42:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:06 UTC)" (scheduled at 2024-04-22 03:42:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:42:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:42:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 42, 6, 553382), True, datetime.datetime(2024, 4, 22, 3, 42, 6, 553382), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:42:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:42:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:42:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:06 UTC)" executed successfully
securityworker stdout | 2024-04-22 03:42:07,952 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:42:07,996 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:42:08,430 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:42:08,541 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:42:09,615 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:42:10,498 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:42:10,510 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:42:10,513 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:42:10,517 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:42:10,521 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:42:10,523 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:42:10,526 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:42:10,535 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:42:10,538 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:42:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:42:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:41.264267+00:00 (in 29.999522 seconds)
autopruneworker stdout | 2024-04-22 03:42:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:41 UTC)" (scheduled at 2024-04-22 03:42:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:42:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757271271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:42:11,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:42:11,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:42:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:42:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:42:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:06.552482+00:00 (in 52.996320 seconds)
repositorygcworker stdout | 2024-04-22 03:42:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:13 UTC)" (scheduled at 2024-04-22 03:42:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:42:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:42:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:42:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:42:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:19.762424+00:00 (in 6.002491 seconds)
notificationworker stdout | 2024-04-22 03:42:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:42:23 UTC)" (scheduled at 2024-04-22 03:42:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:42:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:42:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 42, 13, 760255), True, datetime.datetime(2024, 4, 22, 3, 42, 13, 760255), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:42:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:42:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:42:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:42:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:42:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:42:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:44.952062+00:00 (in 29.999543 seconds)
gcworker stdout | 2024-04-22 03:42:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:44 UTC)" (scheduled at 2024-04-22 03:42:14.952062+00:00)
gcworker stdout | 2024-04-22 03:42:14,952 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:42:14,952 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:42:15,653 [278] [DEBUG] [app] Starting request: urn:request:84a6f032-9312-49e0-ab74-3edc56c13f00 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:42:15,653 [282] [DEBUG] [app] Starting request: urn:request:bbc0332d-e694-448d-9f10-086b2a42f5fb (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:42:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:42:15,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:42:15,656 [291] [DEBUG] [app] Starting request: urn:request:f1f46b5c-bc50-4b31-8528-0de3afdb778b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:42:15,656 [289] [DEBUG] [app] Starting request: urn:request:43f6cc7c-dab7-4cad-ae80-2d58649872e2 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:42:15,656 [291] [DEBUG] [app] Ending request: urn:request:f1f46b5c-bc50-4b31-8528-0de3afdb778b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f1f46b5c-bc50-4b31-8528-0de3afdb778b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:42:15,656 [289] [DEBUG] [app] Ending request: urn:request:43f6cc7c-dab7-4cad-ae80-2d58649872e2 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:43f6cc7c-dab7-4cad-ae80-2d58649872e2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:42:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:42:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:42:15,656 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:42:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:42:15,656 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:42:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:42:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:42:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:42:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:42:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:42:15,659 [282] [DEBUG] [app] Starting request: urn:request:f3e46124-30bf-4ce2-b3fe-308eaa2b309d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:42:15,659 [282] [DEBUG] [app] Ending request: urn:request:f3e46124-30bf-4ce2-b3fe-308eaa2b309d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:f3e46124-30bf-4ce2-b3fe-308eaa2b309d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:42:15,659 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:42:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:42:15,659 [281] [DEBUG] [app] Starting request: urn:request:a004fc4f-4c01-4579-b69b-67ec9ff0f435 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:42:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:42:15,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:42:15,660 [281] [DEBUG] [app] Ending request: urn:request:a004fc4f-4c01-4579-b69b-67ec9ff0f435 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a004fc4f-4c01-4579-b69b-67ec9ff0f435', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:42:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:42:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:42:15,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:42:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:42:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:42:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:42:15,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:42:15,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:42:15,674 [282] [DEBUG] [app] Ending request: urn:request:bbc0332d-e694-448d-9f10-086b2a42f5fb (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:bbc0332d-e694-448d-9f10-086b2a42f5fb', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:42:15,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:42:15,674 [278] [DEBUG] [app] Ending request: urn:request:84a6f032-9312-49e0-ab74-3edc56c13f00 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:84a6f032-9312-49e0-ab74-3edc56c13f00', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:42:15,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:42:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:42:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 03:42:15,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:42:15,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:42:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:42:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
securityscanningnotificationworker stdout | 2024-04-22 03:42:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:42:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:21.555879+00:00 (in 5.003003 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:42:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:16 UTC)" (scheduled at 2024-04-22 03:42:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:42:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:42:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 42, 16, 553290), True, datetime.datetime(2024, 4, 22, 3, 42, 16, 553290), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:42:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:42:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:42:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:42:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:42:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:47.052354+00:00 (in 29.999528 seconds)
buildlogsarchiver stdout | 2024-04-22 03:42:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:47 UTC)" (scheduled at 2024-04-22 03:42:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:42:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 42, 17, 53178), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:42:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:42:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:42:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:42:18,822 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:42:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:42:19,763 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:23.759375+00:00 (in 3.996355 seconds)
notificationworker stdout | 2024-04-22 03:42:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:19 UTC)" (scheduled at 2024-04-22 03:42:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:42:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:42:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:42:20,464 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
securityscanningnotificationworker stdout | 2024-04-22 03:42:21,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:42:21,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:02.556208+00:00 (in 40.999809 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:42:21,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:47:21 UTC)" (scheduled at 2024-04-22 03:42:21.555879+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:42:21,557 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 42, 21, 556770), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 03:42:21,567 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 42, 21, 556770), True, datetime.datetime(2024, 4, 22, 3, 42, 21, 556770), 0, 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 03:42:21,570 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 42, 21, 556770), True, datetime.datetime(2024, 4, 22, 3, 42, 21, 556770), 0, 'secscanv4/%', False, datetime.datetime(2024, 4, 22, 3, 42, 21, 556770), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 03:42:21,572 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:42:21,572 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:47:21 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:42:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:42:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:38.058708+00:00 (in 15.999239 seconds)
namespacegcworker stdout | 2024-04-22 03:42:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:22 UTC)" (scheduled at 2024-04-22 03:42:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:42:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:42:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:42:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:42:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:33.759375+00:00 (in 9.999400 seconds)
notificationworker stdout | 2024-04-22 03:42:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:42:33 UTC)" (scheduled at 2024-04-22 03:42:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:42:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:42:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 42, 23, 760424), True, datetime.datetime(2024, 4, 22, 3, 42, 23, 760424), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:42:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:42:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:42:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:42:33 UTC)" executed successfully
builder stdout | 2024-04-22 03:42:23,924 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
quotaregistrysizeworker stdout | 2024-04-22 03:42:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:42:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:24.361582+00:00 (in 59.999536 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:42:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:24 UTC)" (scheduled at 2024-04-22 03:42:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:42:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:42:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:42:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:42:25,527 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:42:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:42:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:35.871852+00:00 (in 8.998274 seconds)
securityworker stdout | 2024-04-22 03:42:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:56 UTC)" (scheduled at 2024-04-22 03:42:26.873109+00:00)
securityworker stdout | 2024-04-22 03:42:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:42:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:42:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:42:26,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:42:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:42:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:42:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:42:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:42:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:42:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:42:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:42:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:42:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 37, 26, 880729), 1, 2])
securityworker stdout | 2024-04-22 03:42:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:42:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:42:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 37, 26, 880729), 1, 2])
securityworker stdout | 2024-04-22 03:42:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:42:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:42:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:42:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:42:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:42:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:42:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:42:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:42:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:42:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:42:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:42:26,955 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:42:28,903 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:42:28,905 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:42:29,696 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:42:29,708 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:42:29,710 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:42:29,713 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:42:29,715 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:42:29,950 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:42:30,653 [278] [DEBUG] [app] Starting request: urn:request:6f98adbe-8f90-4376-acca-4de15fa82f66 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:42:30,653 [281] [DEBUG] [app] Starting request: urn:request:e4ffb7bf-b3d2-4632-8976-e67960c01e59 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:42:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:42:30,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:42:30,656 [284] [DEBUG] [app] Starting request: urn:request:1c3ed706-c3d9-4ed6-87bb-d399d495b91c (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:42:30,656 [291] [DEBUG] [app] Starting request: urn:request:2adcad93-4c72-4ed5-b3da-d60dd512b91b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:42:30,656 [284] [DEBUG] [app] Ending request: urn:request:1c3ed706-c3d9-4ed6-87bb-d399d495b91c (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:1c3ed706-c3d9-4ed6-87bb-d399d495b91c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:42:30,656 [291] [DEBUG] [app] Ending request: urn:request:2adcad93-4c72-4ed5-b3da-d60dd512b91b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:2adcad93-4c72-4ed5-b3da-d60dd512b91b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:42:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:42:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:42:30,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:42:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:42:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:42:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:42:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:42:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:42:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:42:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:42:30,659 [278] [DEBUG] [app] Starting request: urn:request:dd48c958-e88c-4493-9c46-9af4403d4b5e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:42:30,659 [278] [DEBUG] [app] Ending request: urn:request:dd48c958-e88c-4493-9c46-9af4403d4b5e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:dd48c958-e88c-4493-9c46-9af4403d4b5e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:42:30,659 [282] [DEBUG] [app] Starting request: urn:request:22414020-d89d-4358-a97b-258b874af754 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:42:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:42:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:42:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:42:30,660 [282] [DEBUG] [app] Ending request: urn:request:22414020-d89d-4358-a97b-258b874af754 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:22414020-d89d-4358-a97b-258b874af754', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:42:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:42:30,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:42:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:42:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:42:30,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:42:30,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:42:30,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:42:30,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:42:30,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:42:30,674 [278] [DEBUG] [app] Ending request: urn:request:6f98adbe-8f90-4376-acca-4de15fa82f66 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:6f98adbe-8f90-4376-acca-4de15fa82f66', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:42:30,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:42:30,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:42:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:42:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 03:42:30,674 [281] [DEBUG] [app] Ending request: urn:request:e4ffb7bf-b3d2-4632-8976-e67960c01e59 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e4ffb7bf-b3d2-4632-8976-e67960c01e59', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:42:30,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:42:30,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:42:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:42:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
notificationworker stdout | 2024-04-22 03:42:31,377 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:42:32,735 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:42:33,041 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:42:33,136 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:42:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:42:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:43.759375+00:00 (in 9.999456 seconds)
notificationworker stdout | 2024-04-22 03:42:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:42:43 UTC)" (scheduled at 2024-04-22 03:42:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:42:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:42:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 42, 33, 760243), True, datetime.datetime(2024, 4, 22, 3, 42, 33, 760243), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:42:33,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:42:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:42:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:42:43 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:42:34,303 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
logrotateworker stdout | 2024-04-22 03:42:34,305 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-secscan stdout | 2024-04-22 03:42:34,308 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:42:34,310 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
servicekey stdout | 2024-04-22 03:42:35,400 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:42:35,541 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:42:35,775 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:42:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:42:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:56.873109+00:00 (in 21.000770 seconds)
securityworker stdout | 2024-04-22 03:42:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:05 UTC)" (scheduled at 2024-04-22 03:42:35.871852+00:00)
securityworker stdout | 2024-04-22 03:42:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:42:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:42:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:42:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:42:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:42:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:42:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:05 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:42:36,555 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:42:37,976 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:42:38,032 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:42:38,058 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:42:38,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:43.057186+00:00 (in 4.997953 seconds)
namespacegcworker stdout | 2024-04-22 03:42:38,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:47:38 UTC)" (scheduled at 2024-04-22 03:42:38.058708+00:00)
namespacegcworker stdout | 2024-04-22 03:42:38,060 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 42, 38, 59483), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 03:42:38,070 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 42, 38, 59483), True, datetime.datetime(2024, 4, 22, 3, 42, 38, 59483), 0, 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 03:42:38,073 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 42, 38, 59483), True, datetime.datetime(2024, 4, 22, 3, 42, 38, 59483), 0, 'namespacegc/%', False, datetime.datetime(2024, 4, 22, 3, 42, 38, 59483), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 03:42:38,075 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:42:38,075 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:47:38 UTC)" executed successfully
manifestbackfillworker stdout | 2024-04-22 03:42:38,466 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:42:38,576 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
exportactionlogsworker stdout | 2024-04-22 03:42:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:42:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:41.564959+00:00 (in 1.997456 seconds)
exportactionlogsworker stdout | 2024-04-22 03:42:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:39 UTC)" (scheduled at 2024-04-22 03:42:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:42:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:42:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:42:39,648 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:42:40,510 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:42:40,520 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:42:40,523 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:42:40,525 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:42:40,529 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:42:40,532 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:42:40,534 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:42:40,544 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:42:40,548 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:42:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:42:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:11.264267+00:00 (in 29.999438 seconds)
autopruneworker stdout | 2024-04-22 03:42:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:11 UTC)" (scheduled at 2024-04-22 03:42:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:42:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757301272, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:42:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:42:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:42:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:42:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:42:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:39.566970+00:00 (in 58.001475 seconds)
exportactionlogsworker stdout | 2024-04-22 03:42:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:41 UTC)" (scheduled at 2024-04-22 03:42:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:42:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:42:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 42, 41, 565841), True, datetime.datetime(2024, 4, 22, 3, 42, 41, 565841), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:42:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:42:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:42:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:42:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:42:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:22.058978+00:00 (in 39.001305 seconds)
namespacegcworker stdout | 2024-04-22 03:42:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:43 UTC)" (scheduled at 2024-04-22 03:42:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:42:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:42:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 42, 43, 57959), True, datetime.datetime(2024, 4, 22, 3, 42, 43, 57959), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:42:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:42:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:42:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:43:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:42:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:42:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:42:53.759375+00:00 (in 9.999430 seconds)
notificationworker stdout | 2024-04-22 03:42:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:42:53 UTC)" (scheduled at 2024-04-22 03:42:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:42:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:42:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 42, 43, 760238), True, datetime.datetime(2024, 4, 22, 3, 42, 43, 760238), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:42:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:42:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:42:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:42:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:42:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:42:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:14.952062+00:00 (in 29.999560 seconds)
gcworker stdout | 2024-04-22 03:42:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:14 UTC)" (scheduled at 2024-04-22 03:42:44.952062+00:00)
gcworker stdout | 2024-04-22 03:42:44,952 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:42:44,952 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:42:45,652 [278] [DEBUG] [app] Starting request: urn:request:09a752f9-7feb-48cc-94f0-fdbda99a3222 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:42:45,652 [281] [DEBUG] [app] Starting request: urn:request:52485109-f84f-4c1a-b202-b88ceab7ed22 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:42:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:42:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:42:45,656 [290] [DEBUG] [app] Starting request: urn:request:80cea62d-facd-40d7-b2eb-830227327b4e (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:42:45,656 [286] [DEBUG] [app] Starting request: urn:request:5d8235ad-aae1-45eb-a519-e32363a6ebc1 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:42:45,656 [286] [DEBUG] [app] Ending request: urn:request:5d8235ad-aae1-45eb-a519-e32363a6ebc1 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5d8235ad-aae1-45eb-a519-e32363a6ebc1', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:42:45,656 [290] [DEBUG] [app] Ending request: urn:request:80cea62d-facd-40d7-b2eb-830227327b4e (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:80cea62d-facd-40d7-b2eb-830227327b4e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:42:45,656 [286] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:42:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:42:45,656 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:42:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:42:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:42:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:42:45,656 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:42:45,656 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:42:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:42:45,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:42:45,659 [282] [DEBUG] [app] Starting request: urn:request:9da1b29b-1b76-4142-bc0a-c66e1fbf7f05 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:42:45,659 [282] [DEBUG] [app] Ending request: urn:request:9da1b29b-1b76-4142-bc0a-c66e1fbf7f05 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9da1b29b-1b76-4142-bc0a-c66e1fbf7f05', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:42:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:42:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:42:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:42:45,660 [279] [DEBUG] [app] Starting request: urn:request:2f620a65-d86d-4b2a-989e-772a86511dd6 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:42:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:42:45,660 [279] [DEBUG] [app] Ending request: urn:request:2f620a65-d86d-4b2a-989e-772a86511dd6 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:2f620a65-d86d-4b2a-989e-772a86511dd6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:42:45,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:42:45,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:42:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:42:45,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:42:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:42:45,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:42:45,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:42:45,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:42:45,674 [278] [DEBUG] [app] Ending request: urn:request:09a752f9-7feb-48cc-94f0-fdbda99a3222 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:09a752f9-7feb-48cc-94f0-fdbda99a3222', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:42:45,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:42:45,674 [281] [DEBUG] [app] Ending request: urn:request:52485109-f84f-4c1a-b202-b88ceab7ed22 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:52485109-f84f-4c1a-b202-b88ceab7ed22', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:42:45,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:42:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:42:45,675 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:42:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.023)
gunicorn-web stdout | 2024-04-22 03:42:45,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:42:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:42:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.023)
buildlogsarchiver stdout | 2024-04-22 03:42:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:42:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:17.052354+00:00 (in 29.999485 seconds)
buildlogsarchiver stdout | 2024-04-22 03:42:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:17 UTC)" (scheduled at 2024-04-22 03:42:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:42:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 42, 47, 53253), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:42:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:42:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:42:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:42:48,859 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:42:50,480 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:42:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:42:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:03.759375+00:00 (in 9.999433 seconds)
notificationworker stdout | 2024-04-22 03:42:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:43:03 UTC)" (scheduled at 2024-04-22 03:42:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:42:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:42:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 42, 53, 760280), True, datetime.datetime(2024, 4, 22, 3, 42, 53, 760280), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:42:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:42:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:42:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:43:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:42:53,960 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:42:55,534 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:42:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:42:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:05.871852+00:00 (in 8.998210 seconds)
securityworker stdout | 2024-04-22 03:42:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:26 UTC)" (scheduled at 2024-04-22 03:42:56.873109+00:00)
securityworker stdout | 2024-04-22 03:42:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:42:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:42:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:42:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:42:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:42:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:42:56,878 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:42:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:42:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:42:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:42:56,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:42:56,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:42:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 37, 56, 881419), 1, 2])
securityworker stdout | 2024-04-22 03:42:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:42:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:42:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 37, 56, 881419), 1, 2])
securityworker stdout | 2024-04-22 03:42:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:42:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:42:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:42:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:42:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:42:56,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:42:56,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:42:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:42:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:42:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:42:56,991 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:42:58,939 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:42:58,941 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:42:59,704 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:42:59,713 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:42:59,719 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:42:59,721 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:42:59,724 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:42:59,962 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:43:00,653 [282] [DEBUG] [app] Starting request: urn:request:5f7b7390-2666-4e0d-9080-fb7e1465cce8 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:43:00,653 [281] [DEBUG] [app] Starting request: urn:request:150b8669-b1e7-42c6-9c3d-3bd8f718331d (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:43:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:43:00,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:43:00,656 [289] [DEBUG] [app] Starting request: urn:request:f984003f-725e-4185-a4af-0c20a06688f9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:43:00,656 [291] [DEBUG] [app] Starting request: urn:request:5c174044-a69f-4e08-9275-40dbf2daba76 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:43:00,656 [289] [DEBUG] [app] Ending request: urn:request:f984003f-725e-4185-a4af-0c20a06688f9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f984003f-725e-4185-a4af-0c20a06688f9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:43:00,656 [291] [DEBUG] [app] Ending request: urn:request:5c174044-a69f-4e08-9275-40dbf2daba76 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5c174044-a69f-4e08-9275-40dbf2daba76', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:43:00,656 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:43:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:43:00,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:43:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:43:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:43:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:43:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:43:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:43:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:43:00,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:43:00,660 [278] [DEBUG] [app] Starting request: urn:request:e1d8c5d3-56df-4610-9bfb-135e0698c6b8 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:43:00,660 [279] [DEBUG] [app] Starting request: urn:request:b09ed606-8ed7-4c86-bc4f-e8175d9e3920 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:43:00,660 [278] [DEBUG] [app] Ending request: urn:request:e1d8c5d3-56df-4610-9bfb-135e0698c6b8 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e1d8c5d3-56df-4610-9bfb-135e0698c6b8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:43:00,660 [279] [DEBUG] [app] Ending request: urn:request:b09ed606-8ed7-4c86-bc4f-e8175d9e3920 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b09ed606-8ed7-4c86-bc4f-e8175d9e3920', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:43:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:43:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:43:00,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:43:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:43:00,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:43:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:43:00,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:43:00,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:43:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:43:00,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:43:00,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:43:00,668 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:43:00,676 [282] [DEBUG] [app] Ending request: urn:request:5f7b7390-2666-4e0d-9080-fb7e1465cce8 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:5f7b7390-2666-4e0d-9080-fb7e1465cce8', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:43:00,676 [281] [DEBUG] [app] Ending request: urn:request:150b8669-b1e7-42c6-9c3d-3bd8f718331d (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:150b8669-b1e7-42c6-9c3d-3bd8f718331d', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:43:00,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:43:00,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:43:00,677 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:43:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:43:00,677 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:43:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:43:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:43:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
notificationworker stdout | 2024-04-22 03:43:01,410 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:43:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:43:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:16.552337+00:00 (in 13.995603 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:43:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:02 UTC)" (scheduled at 2024-04-22 03:43:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:43:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:43:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:43:02,770 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:43:03,069 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:43:03,158 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:43:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:43:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:13.759375+00:00 (in 9.999525 seconds)
notificationworker stdout | 2024-04-22 03:43:03,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:43:13 UTC)" (scheduled at 2024-04-22 03:43:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:43:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:43:03,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 43, 3, 760120), True, datetime.datetime(2024, 4, 22, 3, 43, 3, 760120), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:43:03,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:43:03,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:43:03,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:43:13 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:43:04,311 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:43:04,316 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:43:04,318 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:43:04,328 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 03:43:05,413 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:43:05,577 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:43:05,812 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:43:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:43:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:26.873109+00:00 (in 21.000766 seconds)
securityworker stdout | 2024-04-22 03:43:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:35 UTC)" (scheduled at 2024-04-22 03:43:05.871852+00:00)
securityworker stdout | 2024-04-22 03:43:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:43:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:43:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:43:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:43:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:43:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:43:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:35 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:43:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:43:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:13.555667+00:00 (in 7.002688 seconds)
repositorygcworker stdout | 2024-04-22 03:43:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:06 UTC)" (scheduled at 2024-04-22 03:43:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:43:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:43:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 43, 6, 553345), True, datetime.datetime(2024, 4, 22, 3, 43, 6, 553345), 0, 'repositorygc/%', 50, 1, 0])
blobuploadcleanupworker stdout | 2024-04-22 03:43:06,562 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
repositorygcworker stdout | 2024-04-22 03:43:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:43:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:43:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:06 UTC)" executed successfully
securityworker stdout | 2024-04-22 03:43:08,005 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:43:08,049 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:43:08,474 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:43:08,611 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:43:09,684 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:43:10,522 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:43:10,531 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:43:10,534 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:43:10,537 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:43:10,542 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:43:10,544 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:43:10,547 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:43:10,553 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:43:10,558 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:43:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:43:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:41.264267+00:00 (in 29.999403 seconds)
autopruneworker stdout | 2024-04-22 03:43:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:41 UTC)" (scheduled at 2024-04-22 03:43:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:43:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757331271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:43:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:43:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:43:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:43:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:43:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:06.552482+00:00 (in 52.996292 seconds)
repositorygcworker stdout | 2024-04-22 03:43:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:13 UTC)" (scheduled at 2024-04-22 03:43:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:43:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:43:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:43:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:43:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:19.762160+00:00 (in 6.002329 seconds)
notificationworker stdout | 2024-04-22 03:43:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:43:23 UTC)" (scheduled at 2024-04-22 03:43:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:43:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:43:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 43, 13, 760097), True, datetime.datetime(2024, 4, 22, 3, 43, 13, 760097), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:43:13,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:43:13,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:43:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:43:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:43:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:43:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:44.952062+00:00 (in 29.999510 seconds)
gcworker stdout | 2024-04-22 03:43:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:44 UTC)" (scheduled at 2024-04-22 03:43:14.952062+00:00)
gcworker stdout | 2024-04-22 03:43:14,952 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:43:14,952 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:43:15,653 [278] [DEBUG] [app] Starting request: urn:request:b5bcd5cb-4ffb-403e-92e9-2b9837bcd288 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:43:15,653 [282] [DEBUG] [app] Starting request: urn:request:a46565c2-9470-4b18-aac4-057c1be15131 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:43:15,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:43:15,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:43:15,656 [284] [DEBUG] [app] Starting request: urn:request:e4df9379-e246-42f2-8440-f389f6b74265 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:43:15,657 [292] [DEBUG] [app] Starting request: urn:request:45d9e7da-5aad-4dd0-bc54-68297ff43785 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:43:15,657 [284] [DEBUG] [app] Ending request: urn:request:e4df9379-e246-42f2-8440-f389f6b74265 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:e4df9379-e246-42f2-8440-f389f6b74265', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:43:15,657 [292] [DEBUG] [app] Ending request: urn:request:45d9e7da-5aad-4dd0-bc54-68297ff43785 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:45d9e7da-5aad-4dd0-bc54-68297ff43785', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:43:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:43:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:43:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:43:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:43:15,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:43:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:43:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:43:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:43:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:43:15,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:43:15,660 [282] [DEBUG] [app] Starting request: urn:request:2971fa37-b452-4e0d-8075-b922803ea37a (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:43:15,660 [282] [DEBUG] [app] Ending request: urn:request:2971fa37-b452-4e0d-8075-b922803ea37a (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:2971fa37-b452-4e0d-8075-b922803ea37a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:43:15,660 [279] [DEBUG] [app] Starting request: urn:request:1cfbab1b-2cda-4fdb-9ef3-016af74b1aa7 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:43:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:43:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:43:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:43:15,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:43:15,660 [279] [DEBUG] [app] Ending request: urn:request:1cfbab1b-2cda-4fdb-9ef3-016af74b1aa7 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1cfbab1b-2cda-4fdb-9ef3-016af74b1aa7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:43:15,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:43:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:43:15,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:43:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:43:15,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:43:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:43:15,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:43:15,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:43:15,674 [282] [DEBUG] [app] Ending request: urn:request:a46565c2-9470-4b18-aac4-057c1be15131 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a46565c2-9470-4b18-aac4-057c1be15131', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:43:15,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:43:15,675 [278] [DEBUG] [app] Ending request: urn:request:b5bcd5cb-4ffb-403e-92e9-2b9837bcd288 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b5bcd5cb-4ffb-403e-92e9-2b9837bcd288', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:43:15,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:43:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:43:15,675 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:43:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:43:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:43:15,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:43:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
securityscanningnotificationworker stdout | 2024-04-22 03:43:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:43:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:02.556208+00:00 (in 46.003258 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:43:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:16 UTC)" (scheduled at 2024-04-22 03:43:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:43:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:43:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 43, 16, 553215), True, datetime.datetime(2024, 4, 22, 3, 43, 16, 553215), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:43:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:43:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:43:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:43:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:43:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:47.052354+00:00 (in 29.999501 seconds)
buildlogsarchiver stdout | 2024-04-22 03:43:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:47 UTC)" (scheduled at 2024-04-22 03:43:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:43:17,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 43, 17, 53269), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:43:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:43:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:43:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:43:18,895 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:43:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:43:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:23.759375+00:00 (in 3.996640 seconds)
notificationworker stdout | 2024-04-22 03:43:19,762 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:48:19 UTC)" (scheduled at 2024-04-22 03:43:19.762160+00:00)
notificationworker stdout | 2024-04-22 03:43:19,763 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 43, 19, 763026), 'notification/%'])
notificationworker stdout | 2024-04-22 03:43:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:19 UTC)" (scheduled at 2024-04-22 03:43:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:43:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:43:19,764 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:19 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:43:19,774 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 43, 19, 763026), True, datetime.datetime(2024, 4, 22, 3, 43, 19, 763026), 0, 'notification/%'])
notificationworker stdout | 2024-04-22 03:43:19,777 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 43, 19, 763026), True, datetime.datetime(2024, 4, 22, 3, 43, 19, 763026), 0, 'notification/%', False, datetime.datetime(2024, 4, 22, 3, 43, 19, 763026), 'notification/%'])
notificationworker stdout | 2024-04-22 03:43:19,779 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:43:19,779 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:48:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:43:20,518 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:43:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:43:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:43.057186+00:00 (in 20.997677 seconds)
namespacegcworker stdout | 2024-04-22 03:43:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:22 UTC)" (scheduled at 2024-04-22 03:43:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:43:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:43:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:43:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:43:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:33.759375+00:00 (in 9.999437 seconds)
notificationworker stdout | 2024-04-22 03:43:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:43:33 UTC)" (scheduled at 2024-04-22 03:43:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:43:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:43:23,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 43, 23, 760209), True, datetime.datetime(2024, 4, 22, 3, 43, 23, 760209), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:43:23,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:43:23,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:43:23,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:43:33 UTC)" executed successfully
builder stdout | 2024-04-22 03:43:23,996 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
quotaregistrysizeworker stdout | 2024-04-22 03:43:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:43:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:24.361582+00:00 (in 59.999527 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:43:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:24 UTC)" (scheduled at 2024-04-22 03:43:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:43:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:43:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:43:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:43:25,570 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:43:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:43:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:35.871852+00:00 (in 8.998287 seconds)
securityworker stdout | 2024-04-22 03:43:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:56 UTC)" (scheduled at 2024-04-22 03:43:26.873109+00:00)
securityworker stdout | 2024-04-22 03:43:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:43:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:43:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:43:26,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:43:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:43:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:43:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:43:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:43:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:43:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:43:26,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:43:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:43:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 38, 26, 881639), 1, 2])
securityworker stdout | 2024-04-22 03:43:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:43:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:43:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 38, 26, 881639), 1, 2])
securityworker stdout | 2024-04-22 03:43:26,900 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:43:26,900 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:43:26,900 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:43:26,900 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:43:26,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:43:26,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:43:26,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:43:26,901 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:43:26,901 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:43:26,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:43:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:43:27,024 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:43:28,957 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:43:28,960 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:43:29,711 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:43:29,721 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:43:29,724 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:43:29,728 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:43:29,731 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:43:29,999 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:43:30,653 [281] [DEBUG] [app] Starting request: urn:request:a1736362-79ef-4d44-b92a-fc77f186bc5c (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:43:30,653 [278] [DEBUG] [app] Starting request: urn:request:105e32b9-1b0c-44e0-9406-8b73209e3866 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:43:30,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:43:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:43:30,656 [292] [DEBUG] [app] Starting request: urn:request:fd7470d1-c03e-4cc7-a594-0184a7a1691e (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:43:30,656 [284] [DEBUG] [app] Starting request: urn:request:5fb24357-4740-449f-8476-84dfdd534f05 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:43:30,656 [292] [DEBUG] [app] Ending request: urn:request:fd7470d1-c03e-4cc7-a594-0184a7a1691e (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:fd7470d1-c03e-4cc7-a594-0184a7a1691e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:43:30,656 [284] [DEBUG] [app] Ending request: urn:request:5fb24357-4740-449f-8476-84dfdd534f05 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5fb24357-4740-449f-8476-84dfdd534f05', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:43:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:43:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:43:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:43:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:43:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:43:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:43:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:43:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:43:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:43:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:43:30,659 [278] [DEBUG] [app] Starting request: urn:request:3dc8a9aa-5438-4c7a-b91f-529d3f6ce84d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:43:30,659 [278] [DEBUG] [app] Ending request: urn:request:3dc8a9aa-5438-4c7a-b91f-529d3f6ce84d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3dc8a9aa-5438-4c7a-b91f-529d3f6ce84d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:43:30,660 [279] [DEBUG] [app] Starting request: urn:request:bb508455-3524-463b-9226-4218a5b8a82d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:43:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:43:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:43:30,660 [279] [DEBUG] [app] Ending request: urn:request:bb508455-3524-463b-9226-4218a5b8a82d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:bb508455-3524-463b-9226-4218a5b8a82d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:43:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:43:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:43:30,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:43:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:43:30,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:43:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:43:30,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:43:30,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:43:30,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:43:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:43:30,674 [281] [DEBUG] [app] Ending request: urn:request:a1736362-79ef-4d44-b92a-fc77f186bc5c (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a1736362-79ef-4d44-b92a-fc77f186bc5c', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:43:30,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:43:30,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:43:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:43:30,675 [278] [DEBUG] [app] Ending request: urn:request:105e32b9-1b0c-44e0-9406-8b73209e3866 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:105e32b9-1b0c-44e0-9406-8b73209e3866', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:43:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:43:30,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:43:30,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:43:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:43:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
notificationworker stdout | 2024-04-22 03:43:31,446 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:43:32,778 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:43:33,107 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:43:33,194 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:43:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:43:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:43.759375+00:00 (in 9.999473 seconds)
notificationworker stdout | 2024-04-22 03:43:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:43:43 UTC)" (scheduled at 2024-04-22 03:43:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:43:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:43:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 43, 33, 760425), True, datetime.datetime(2024, 4, 22, 3, 43, 33, 760425), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:43:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:43:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:43:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:43:43 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:43:34,320 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:43:34,323 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:43:34,326 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:43:34,361 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 03:43:35,432 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:43:35,613 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:43:35,843 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:43:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:43:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:56.873109+00:00 (in 21.000819 seconds)
securityworker stdout | 2024-04-22 03:43:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:05 UTC)" (scheduled at 2024-04-22 03:43:35.871852+00:00)
securityworker stdout | 2024-04-22 03:43:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:43:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:43:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:43:35,877 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:43:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:43:35,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:43:35,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:05 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:43:36,602 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:43:38,044 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:43:38,061 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:43:38,510 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:43:38,626 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
exportactionlogsworker stdout | 2024-04-22 03:43:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:43:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:41.564959+00:00 (in 1.997485 seconds)
exportactionlogsworker stdout | 2024-04-22 03:43:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:39 UTC)" (scheduled at 2024-04-22 03:43:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:43:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:43:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:43:39,724 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:43:40,534 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:43:40,543 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:43:40,546 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:43:40,551 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:43:40,554 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:43:40,558 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:43:40,561 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:43:40,565 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:43:40,568 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:43:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:43:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:11.264267+00:00 (in 29.999402 seconds)
autopruneworker stdout | 2024-04-22 03:43:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:11 UTC)" (scheduled at 2024-04-22 03:43:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:43:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757361271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:43:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:43:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:43:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:43:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:43:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:39.566970+00:00 (in 58.001521 seconds)
exportactionlogsworker stdout | 2024-04-22 03:43:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:41 UTC)" (scheduled at 2024-04-22 03:43:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:43:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:43:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 43, 41, 565707), True, datetime.datetime(2024, 4, 22, 3, 43, 41, 565707), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:43:41,586 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:43:41,586 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:43:41,586 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:43:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:43:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:22.058978+00:00 (in 39.001310 seconds)
namespacegcworker stdout | 2024-04-22 03:43:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:43 UTC)" (scheduled at 2024-04-22 03:43:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:43:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:43:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 43, 43, 57988), True, datetime.datetime(2024, 4, 22, 3, 43, 43, 57988), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:43:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:43:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:43:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:44:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:43:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:43:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:43:53.759375+00:00 (in 9.999459 seconds)
notificationworker stdout | 2024-04-22 03:43:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:43:53 UTC)" (scheduled at 2024-04-22 03:43:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:43:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:43:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 43, 43, 760203), True, datetime.datetime(2024, 4, 22, 3, 43, 43, 760203), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:43:43,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:43:43,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:43:43,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:43:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:43:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:43:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:14.952062+00:00 (in 29.999546 seconds)
gcworker stdout | 2024-04-22 03:43:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:14 UTC)" (scheduled at 2024-04-22 03:43:44.952062+00:00)
gcworker stdout | 2024-04-22 03:43:44,952 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:43:44,952 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:43:45,653 [278] [DEBUG] [app] Starting request: urn:request:635c7e31-36db-4fa8-8d0a-182b6a4111ef (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:43:45,653 [279] [DEBUG] [app] Starting request: urn:request:e1a28a67-1638-4959-8238-4f65f55a22c3 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:43:45,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:43:45,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:43:45,657 [284] [DEBUG] [app] Starting request: urn:request:05c8edfd-752c-4deb-8d16-1ba2bb2b006b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:43:45,657 [288] [DEBUG] [app] Starting request: urn:request:6638a23a-36db-472e-bbfb-564f04dd9bd0 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:43:45,658 [284] [DEBUG] [app] Ending request: urn:request:05c8edfd-752c-4deb-8d16-1ba2bb2b006b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:05c8edfd-752c-4deb-8d16-1ba2bb2b006b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:43:45,658 [288] [DEBUG] [app] Ending request: urn:request:6638a23a-36db-472e-bbfb-564f04dd9bd0 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:6638a23a-36db-472e-bbfb-564f04dd9bd0', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:43:45,658 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:43:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:43:45,658 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:43:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:43:45,659 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:43:45,659 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:43:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:43:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
gunicorn-web stdout | 2024-04-22 03:43:45,660 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:43:45,661 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:43:45,662 [278] [DEBUG] [app] Starting request: urn:request:1178c58f-7ae1-4630-a078-ffbf4ac23cf9 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:43:45,662 [279] [DEBUG] [app] Starting request: urn:request:1c0eabd3-3aa8-45e5-84ae-f748f2eb7cee (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:43:45,662 [278] [DEBUG] [app] Ending request: urn:request:1178c58f-7ae1-4630-a078-ffbf4ac23cf9 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1178c58f-7ae1-4630-a078-ffbf4ac23cf9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:43:45,662 [279] [DEBUG] [app] Ending request: urn:request:1c0eabd3-3aa8-45e5-84ae-f748f2eb7cee (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1c0eabd3-3aa8-45e5-84ae-f748f2eb7cee', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:43:45,663 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:43:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:43:45,663 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:43:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:43:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:43:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.001)
gunicorn-web stdout | 2024-04-22 03:43:45,663 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:43:45,663 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:43:45,663 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:43:45,664 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:43:45,670 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:43:45,671 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:43:45,679 [278] [DEBUG] [app] Ending request: urn:request:635c7e31-36db-4fa8-8d0a-182b6a4111ef (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:635c7e31-36db-4fa8-8d0a-182b6a4111ef', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:43:45,679 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:43:45,680 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:43:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:43:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.028 118 0.028)
gunicorn-web stdout | 2024-04-22 03:43:45,682 [279] [DEBUG] [app] Ending request: urn:request:e1a28a67-1638-4959-8238-4f65f55a22c3 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e1a28a67-1638-4959-8238-4f65f55a22c3', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:43:45,682 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:43:45,683 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:43:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:43:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.030 118 0.031)
buildlogsarchiver stdout | 2024-04-22 03:43:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:43:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:17.052354+00:00 (in 29.999509 seconds)
buildlogsarchiver stdout | 2024-04-22 03:43:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:17 UTC)" (scheduled at 2024-04-22 03:43:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:43:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 43, 47, 53240), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:43:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:43:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:43:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:43:48,931 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:43:50,543 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:43:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:43:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:03.759375+00:00 (in 9.999465 seconds)
notificationworker stdout | 2024-04-22 03:43:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:44:03 UTC)" (scheduled at 2024-04-22 03:43:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:43:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:43:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 43, 53, 760404), True, datetime.datetime(2024, 4, 22, 3, 43, 53, 760404), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:43:53,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:43:53,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:43:53,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:44:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:43:54,017 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:43:55,606 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:43:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:43:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:05.871852+00:00 (in 8.998224 seconds)
securityworker stdout | 2024-04-22 03:43:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:26 UTC)" (scheduled at 2024-04-22 03:43:56.873109+00:00)
securityworker stdout | 2024-04-22 03:43:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:43:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:43:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:43:56,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:43:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:43:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:43:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:43:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:43:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:43:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:43:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:43:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:43:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 38, 56, 881092), 1, 2])
securityworker stdout | 2024-04-22 03:43:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:43:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:43:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 38, 56, 881092), 1, 2])
securityworker stdout | 2024-04-22 03:43:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:43:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:43:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:43:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:43:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:43:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:43:56,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:43:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:43:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:43:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:43:57,059 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:43:58,995 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:43:58,999 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:43:59,720 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:43:59,728 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:43:59,732 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:43:59,735 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:43:59,738 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:44:00,036 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:44:00,653 [281] [DEBUG] [app] Starting request: urn:request:123c6b13-e7f9-4518-a556-8ef863814e21 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:44:00,653 [282] [DEBUG] [app] Starting request: urn:request:fa06c627-c1a4-4a85-86a0-0075bb5234cd (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:44:00,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:44:00,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:44:00,657 [284] [DEBUG] [app] Starting request: urn:request:bdcc9d3f-2c40-41a2-8bd6-027312a2a3a1 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:44:00,657 [292] [DEBUG] [app] Starting request: urn:request:f5e6b651-2e9c-4348-91d6-1380527b1b58 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:44:00,657 [284] [DEBUG] [app] Ending request: urn:request:bdcc9d3f-2c40-41a2-8bd6-027312a2a3a1 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:bdcc9d3f-2c40-41a2-8bd6-027312a2a3a1', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:44:00,657 [292] [DEBUG] [app] Ending request: urn:request:f5e6b651-2e9c-4348-91d6-1380527b1b58 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f5e6b651-2e9c-4348-91d6-1380527b1b58', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:44:00,658 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:44:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:44:00,658 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:44:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:44:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:44:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:44:00,658 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:44:00,658 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:44:00,660 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:44:00,660 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:44:00,661 [281] [DEBUG] [app] Starting request: urn:request:65d6ce06-84ff-465b-bbb9-3507ceea89be (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:44:00,661 [279] [DEBUG] [app] Starting request: urn:request:f90d38e3-59a2-4adb-9255-2b023344dd3d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:44:00,661 [281] [DEBUG] [app] Ending request: urn:request:65d6ce06-84ff-465b-bbb9-3507ceea89be (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:65d6ce06-84ff-465b-bbb9-3507ceea89be', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:44:00,662 [279] [DEBUG] [app] Ending request: urn:request:f90d38e3-59a2-4adb-9255-2b023344dd3d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:f90d38e3-59a2-4adb-9255-2b023344dd3d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:44:00,662 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:44:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:44:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:44:00,662 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:44:00,662 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:44:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:44:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:44:00,662 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:44:00,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:44:00,663 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:44:00,669 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:44:00,669 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:44:00,677 [282] [DEBUG] [app] Ending request: urn:request:fa06c627-c1a4-4a85-86a0-0075bb5234cd (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:fa06c627-c1a4-4a85-86a0-0075bb5234cd', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:44:00,677 [281] [DEBUG] [app] Ending request: urn:request:123c6b13-e7f9-4518-a556-8ef863814e21 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:123c6b13-e7f9-4518-a556-8ef863814e21', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:44:00,678 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:44:00,678 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:44:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:44:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
gunicorn-web stdout | 2024-04-22 03:44:00,678 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:44:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:44:00,678 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:44:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
notificationworker stdout | 2024-04-22 03:44:01,482 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:44:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:44:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:16.552337+00:00 (in 13.995646 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:44:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:02 UTC)" (scheduled at 2024-04-22 03:44:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:44:02,556 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:44:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:44:02,815 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:44:03,131 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:44:03,229 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:44:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:44:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:13.759375+00:00 (in 9.999502 seconds)
notificationworker stdout | 2024-04-22 03:44:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:44:13 UTC)" (scheduled at 2024-04-22 03:44:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:44:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:44:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 44, 3, 760210), True, datetime.datetime(2024, 4, 22, 3, 44, 3, 760210), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:44:03,775 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:44:03,775 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:44:03,775 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:44:13 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:44:04,329 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:44:04,333 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:44:04,336 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:44:04,367 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 03:44:05,457 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:44:05,649 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
securityworker stdout | 2024-04-22 03:44:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:44:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:26.873109+00:00 (in 21.000786 seconds)
securityworker stdout | 2024-04-22 03:44:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:35 UTC)" (scheduled at 2024-04-22 03:44:05.871852+00:00)
securityworker stdout | 2024-04-22 03:44:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:44:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:44:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:44:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
globalpromstats stdout | 2024-04-22 03:44:05,878 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:44:05,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:44:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:44:05,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:35 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:44:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:44:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:13.555667+00:00 (in 7.002647 seconds)
repositorygcworker stdout | 2024-04-22 03:44:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:06 UTC)" (scheduled at 2024-04-22 03:44:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:44:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:44:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 44, 6, 553436), True, datetime.datetime(2024, 4, 22, 3, 44, 6, 553436), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:44:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:44:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:44:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:06 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:44:06,639 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:44:08,080 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:44:08,097 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:44:08,546 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:44:08,663 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:44:09,761 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:44:10,546 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:44:10,555 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:44:10,558 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:44:10,561 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:44:10,565 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:44:10,569 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:44:10,571 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:44:10,574 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:44:10,576 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:44:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:44:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:41.264267+00:00 (in 29.999542 seconds)
autopruneworker stdout | 2024-04-22 03:44:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:41 UTC)" (scheduled at 2024-04-22 03:44:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:44:11,271 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757391271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:44:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:44:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:44:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:44:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:44:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:06.552482+00:00 (in 52.996291 seconds)
repositorygcworker stdout | 2024-04-22 03:44:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:13 UTC)" (scheduled at 2024-04-22 03:44:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:44:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:44:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:44:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:44:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:19.762424+00:00 (in 6.002535 seconds)
notificationworker stdout | 2024-04-22 03:44:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:44:23 UTC)" (scheduled at 2024-04-22 03:44:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:44:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:44:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 44, 13, 760359), True, datetime.datetime(2024, 4, 22, 3, 44, 13, 760359), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:44:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:44:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:44:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:44:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:44:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:44:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:44.952062+00:00 (in 29.999553 seconds)
gcworker stdout | 2024-04-22 03:44:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:44 UTC)" (scheduled at 2024-04-22 03:44:14.952062+00:00)
gcworker stdout | 2024-04-22 03:44:14,952 [68] [DEBUG] [__main__] No GC policies found
gcworker stdout | 2024-04-22 03:44:14,952 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:44:15,652 [282] [DEBUG] [app] Starting request: urn:request:26dd0844-fce1-488e-b904-e8164baa5cf4 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:44:15,652 [281] [DEBUG] [app] Starting request: urn:request:4bb79d24-be81-4159-b2df-cc1407a11789 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:44:15,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:44:15,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:44:15,656 [284] [DEBUG] [app] Starting request: urn:request:e10e4438-483a-4a8e-a78d-4e3db14708ab (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:44:15,656 [292] [DEBUG] [app] Starting request: urn:request:64b38c85-89a2-4b06-ae66-87c3ff3d7b8b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:44:15,656 [284] [DEBUG] [app] Ending request: urn:request:e10e4438-483a-4a8e-a78d-4e3db14708ab (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:e10e4438-483a-4a8e-a78d-4e3db14708ab', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:44:15,656 [292] [DEBUG] [app] Ending request: urn:request:64b38c85-89a2-4b06-ae66-87c3ff3d7b8b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:64b38c85-89a2-4b06-ae66-87c3ff3d7b8b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:44:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:44:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:44:15,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:44:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:44:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:44:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-web stdout | 2024-04-22 03:44:15,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:44:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:44:15,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:44:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:44:15,660 [282] [DEBUG] [app] Starting request: urn:request:db68d21d-467d-408d-a4e8-42fc0a35eeea (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:44:15,660 [281] [DEBUG] [app] Starting request: urn:request:06d8a85c-7c15-4c3f-83b3-cca2b54f7b6f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:44:15,660 [282] [DEBUG] [app] Ending request: urn:request:db68d21d-467d-408d-a4e8-42fc0a35eeea (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:db68d21d-467d-408d-a4e8-42fc0a35eeea', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:44:15,660 [281] [DEBUG] [app] Ending request: urn:request:06d8a85c-7c15-4c3f-83b3-cca2b54f7b6f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:06d8a85c-7c15-4c3f-83b3-cca2b54f7b6f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:44:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:44:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:44:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:44:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:44:15,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:44:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:44:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:44:15,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:44:15,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:44:15,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:44:15,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:44:15,668 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:44:15,675 [282] [DEBUG] [app] Ending request: urn:request:26dd0844-fce1-488e-b904-e8164baa5cf4 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:26dd0844-fce1-488e-b904-e8164baa5cf4', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:44:15,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:44:15,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:44:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:44:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:44:15,676 [281] [DEBUG] [app] Ending request: urn:request:4bb79d24-be81-4159-b2df-cc1407a11789 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:4bb79d24-be81-4159-b2df-cc1407a11789', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:44:15,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:44:15,677 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:44:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:44:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.026)
securityscanningnotificationworker stdout | 2024-04-22 03:44:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:44:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:02.556208+00:00 (in 46.003232 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:44:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:16 UTC)" (scheduled at 2024-04-22 03:44:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:44:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:44:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 44, 16, 553391), True, datetime.datetime(2024, 4, 22, 3, 44, 16, 553391), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:44:16,565 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:44:16,565 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:44:16,565 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:44:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:44:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:47.052354+00:00 (in 29.999475 seconds)
buildlogsarchiver stdout | 2024-04-22 03:44:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:47 UTC)" (scheduled at 2024-04-22 03:44:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:44:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 44, 17, 53245), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:44:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:44:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:44:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:44:18,968 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:44:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:44:19,763 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:23.759375+00:00 (in 3.996391 seconds)
notificationworker stdout | 2024-04-22 03:44:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:19 UTC)" (scheduled at 2024-04-22 03:44:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:44:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:44:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:44:20,558 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:44:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:44:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:43.057186+00:00 (in 20.997716 seconds)
namespacegcworker stdout | 2024-04-22 03:44:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:22 UTC)" (scheduled at 2024-04-22 03:44:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:44:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:44:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:44:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:44:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:33.759375+00:00 (in 9.999523 seconds)
notificationworker stdout | 2024-04-22 03:44:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:44:33 UTC)" (scheduled at 2024-04-22 03:44:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:44:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:44:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 44, 23, 760250), True, datetime.datetime(2024, 4, 22, 3, 44, 23, 760250), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:44:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:44:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:44:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:44:33 UTC)" executed successfully
builder stdout | 2024-04-22 03:44:24,054 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
quotaregistrysizeworker stdout | 2024-04-22 03:44:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:44:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:24.361582+00:00 (in 59.999474 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:44:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:24 UTC)" (scheduled at 2024-04-22 03:44:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:44:24,363 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:44:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:44:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:44:25,642 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:44:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:44:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:35.871852+00:00 (in 8.998252 seconds)
securityworker stdout | 2024-04-22 03:44:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:56 UTC)" (scheduled at 2024-04-22 03:44:26.873109+00:00)
securityworker stdout | 2024-04-22 03:44:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:44:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:44:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:44:26,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:44:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:44:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:44:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:44:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:44:26,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:44:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:44:26,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:44:26,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:44:26,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 39, 26, 880690), 1, 2])
securityworker stdout | 2024-04-22 03:44:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:44:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:44:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 39, 26, 880690), 1, 2])
securityworker stdout | 2024-04-22 03:44:26,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:44:26,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:44:26,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:44:26,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:44:26,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:44:26,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:44:26,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:44:26,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:44:26,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:44:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:44:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:44:27,095 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:44:29,031 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:44:29,036 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:44:29,728 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:44:29,735 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:44:29,740 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:44:29,743 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:44:29,746 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:44:30,072 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:44:30,652 [278] [DEBUG] [app] Starting request: urn:request:c2aa374f-04d4-4dfe-811a-5e7b92e3f020 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:44:30,652 [282] [DEBUG] [app] Starting request: urn:request:68d157a5-8fae-4727-9db2-9946e7ea390d (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:44:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:44:30,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:44:30,656 [291] [DEBUG] [app] Starting request: urn:request:9e922ff3-7bf3-4771-8e10-e9b6b3ef4e40 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:44:30,656 [284] [DEBUG] [app] Starting request: urn:request:170e253c-1599-4853-9c01-d0f75ad81848 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:44:30,657 [291] [DEBUG] [app] Ending request: urn:request:9e922ff3-7bf3-4771-8e10-e9b6b3ef4e40 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:9e922ff3-7bf3-4771-8e10-e9b6b3ef4e40', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:44:30,657 [284] [DEBUG] [app] Ending request: urn:request:170e253c-1599-4853-9c01-d0f75ad81848 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:170e253c-1599-4853-9c01-d0f75ad81848', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:44:30,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:44:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:44:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:44:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:44:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:44:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:44:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:44:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:44:30,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:44:30,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:44:30,661 [278] [DEBUG] [app] Starting request: urn:request:b25472ea-c857-46e0-8583-109ac535bdc6 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:44:30,661 [278] [DEBUG] [app] Ending request: urn:request:b25472ea-c857-46e0-8583-109ac535bdc6 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b25472ea-c857-46e0-8583-109ac535bdc6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:44:30,661 [281] [DEBUG] [app] Starting request: urn:request:e6fa1c43-2875-4777-926b-c5df281ed216 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:44:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:44:30,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:44:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:44:30,661 [281] [DEBUG] [app] Ending request: urn:request:e6fa1c43-2875-4777-926b-c5df281ed216 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e6fa1c43-2875-4777-926b-c5df281ed216', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:44:30,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:44:30,662 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:44:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:44:30,662 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:44:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:44:30,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:44:30,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:44:30,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:44:30,669 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:44:30,677 [282] [DEBUG] [app] Ending request: urn:request:68d157a5-8fae-4727-9db2-9946e7ea390d (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:68d157a5-8fae-4727-9db2-9946e7ea390d', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:44:30,677 [278] [DEBUG] [app] Ending request: urn:request:c2aa374f-04d4-4dfe-811a-5e7b92e3f020 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:c2aa374f-04d4-4dfe-811a-5e7b92e3f020', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:44:30,677 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:44:30,677 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:44:30,677 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:44:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:44:30,677 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:44:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:44:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:44:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
notificationworker stdout | 2024-04-22 03:44:31,518 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:44:32,851 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:44:33,156 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:44:33,266 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:44:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:44:33,760 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:43.759375+00:00 (in 9.999391 seconds)
notificationworker stdout | 2024-04-22 03:44:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:44:43 UTC)" (scheduled at 2024-04-22 03:44:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:44:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:44:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 44, 33, 760278), True, datetime.datetime(2024, 4, 22, 3, 44, 33, 760278), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:44:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:44:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:44:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:44:43 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:44:34,339 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:44:34,341 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:44:34,344 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:44:34,373 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 03:44:35,493 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:44:35,685 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
securityworker stdout | 2024-04-22 03:44:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:44:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:56.873109+00:00 (in 21.000811 seconds)
securityworker stdout | 2024-04-22 03:44:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:05 UTC)" (scheduled at 2024-04-22 03:44:35.871852+00:00)
securityworker stdout | 2024-04-22 03:44:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:44:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:44:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:44:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:44:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:44:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
globalpromstats stdout | 2024-04-22 03:44:35,887 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
securityworker stdout | 2024-04-22 03:44:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:05 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:44:36,675 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:44:38,116 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:44:38,132 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:44:38,582 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:44:38,700 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
exportactionlogsworker stdout | 2024-04-22 03:44:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:44:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:41.564959+00:00 (in 1.997528 seconds)
exportactionlogsworker stdout | 2024-04-22 03:44:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:39 UTC)" (scheduled at 2024-04-22 03:44:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:44:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:44:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:44:39,797 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:44:40,555 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:44:40,566 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:44:40,569 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:44:40,572 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:44:40,577 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:44:40,582 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:44:40,585 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:44:40,589 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:44:40,592 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:44:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:44:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:11.264267+00:00 (in 29.999521 seconds)
autopruneworker stdout | 2024-04-22 03:44:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:11 UTC)" (scheduled at 2024-04-22 03:44:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:44:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757421271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:44:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:44:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:44:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:44:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:44:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:39.566970+00:00 (in 58.001567 seconds)
exportactionlogsworker stdout | 2024-04-22 03:44:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:41 UTC)" (scheduled at 2024-04-22 03:44:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:44:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:44:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 44, 41, 565648), True, datetime.datetime(2024, 4, 22, 3, 44, 41, 565648), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:44:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:44:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:44:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:44:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:44:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:22.058978+00:00 (in 39.001312 seconds)
namespacegcworker stdout | 2024-04-22 03:44:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:43 UTC)" (scheduled at 2024-04-22 03:44:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:44:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:44:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 44, 43, 57941), True, datetime.datetime(2024, 4, 22, 3, 44, 43, 57941), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:44:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:44:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:44:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:45:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:44:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:44:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:44:53.759375+00:00 (in 9.999429 seconds)
notificationworker stdout | 2024-04-22 03:44:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:44:53 UTC)" (scheduled at 2024-04-22 03:44:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:44:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:44:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 44, 43, 760407), True, datetime.datetime(2024, 4, 22, 3, 44, 43, 760407), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:44:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:44:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:44:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:44:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:44:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:44:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:14.952062+00:00 (in 29.999556 seconds)
gcworker stdout | 2024-04-22 03:44:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:14 UTC)" (scheduled at 2024-04-22 03:44:44.952062+00:00)
gcworker stdout | 2024-04-22 03:44:44,953 [68] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."removed_tag_expiration_s" FROM "user" AS "t1" LIMIT %s', [100])
gcworker stdout | 2024-04-22 03:44:44,963 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712547884962, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:44:44,967 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:44:44,967 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:44:44,967 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:44:45,653 [278] [DEBUG] [app] Starting request: urn:request:a95f6e81-c64f-403a-9074-02002d700564 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:44:45,653 [279] [DEBUG] [app] Starting request: urn:request:9a8e0549-42b2-44c7-a6d3-b98c74c865c9 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:44:45,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:44:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:44:45,656 [284] [DEBUG] [app] Starting request: urn:request:1c1830db-30d7-49e4-b735-8a640a6aec72 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:44:45,656 [292] [DEBUG] [app] Starting request: urn:request:880fff4e-f339-41be-8b37-2bdf6d8e20eb (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:44:45,657 [284] [DEBUG] [app] Ending request: urn:request:1c1830db-30d7-49e4-b735-8a640a6aec72 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:1c1830db-30d7-49e4-b735-8a640a6aec72', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:44:45,657 [292] [DEBUG] [app] Ending request: urn:request:880fff4e-f339-41be-8b37-2bdf6d8e20eb (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:880fff4e-f339-41be-8b37-2bdf6d8e20eb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:44:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:44:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:44:45,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:44:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:44:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:44:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:44:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:44:45,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:44:45,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:44:45,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:44:45,660 [278] [DEBUG] [app] Starting request: urn:request:b51601a7-efba-4ffe-9b39-8cf0bb26e048 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:44:45,660 [278] [DEBUG] [app] Ending request: urn:request:b51601a7-efba-4ffe-9b39-8cf0bb26e048 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b51601a7-efba-4ffe-9b39-8cf0bb26e048', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:44:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:44:45,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:44:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:44:45,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:44:45,661 [282] [DEBUG] [app] Starting request: urn:request:beef784a-bdbf-4f1f-800e-455121e18526 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:44:45,661 [282] [DEBUG] [app] Ending request: urn:request:beef784a-bdbf-4f1f-800e-455121e18526 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:beef784a-bdbf-4f1f-800e-455121e18526', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:44:45,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:44:45,662 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:44:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:44:45,662 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:44:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:44:45,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:44:45,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:44:45,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:44:45,675 [278] [DEBUG] [app] Ending request: urn:request:a95f6e81-c64f-403a-9074-02002d700564 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a95f6e81-c64f-403a-9074-02002d700564', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:44:45,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:44:45,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:44:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:44:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:44:45,676 [279] [DEBUG] [app] Ending request: urn:request:9a8e0549-42b2-44c7-a6d3-b98c74c865c9 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:9a8e0549-42b2-44c7-a6d3-b98c74c865c9', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:44:45,676 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:44:45,677 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:44:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:44:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
buildlogsarchiver stdout | 2024-04-22 03:44:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:44:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:17.052354+00:00 (in 29.999471 seconds)
buildlogsarchiver stdout | 2024-04-22 03:44:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:17 UTC)" (scheduled at 2024-04-22 03:44:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:44:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 44, 47, 53228), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:44:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:44:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:44:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:44:49,005 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:44:50,571 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:44:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:44:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:03.759375+00:00 (in 9.999429 seconds)
notificationworker stdout | 2024-04-22 03:44:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:45:03 UTC)" (scheduled at 2024-04-22 03:44:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:44:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:44:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 44, 53, 760333), True, datetime.datetime(2024, 4, 22, 3, 44, 53, 760333), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:44:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:44:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:44:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:45:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:44:54,090 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:44:55,679 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:44:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:44:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:05.871852+00:00 (in 8.998286 seconds)
securityworker stdout | 2024-04-22 03:44:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:26 UTC)" (scheduled at 2024-04-22 03:44:56.873109+00:00)
securityworker stdout | 2024-04-22 03:44:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:44:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:44:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:44:56,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:44:56,876 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:44:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:44:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:44:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:44:56,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:44:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:44:56,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:44:56,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:44:56,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 39, 56, 880505), 1, 2])
securityworker stdout | 2024-04-22 03:44:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:44:56,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:44:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 39, 56, 880505), 1, 2])
securityworker stdout | 2024-04-22 03:44:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:44:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:44:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:44:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:44:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:44:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:44:56,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:44:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:44:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:44:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:44:57,132 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:44:59,068 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:44:59,073 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:44:59,736 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:44:59,746 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:44:59,749 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:44:59,751 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:44:59,754 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:45:00,108 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:45:00,653 [282] [DEBUG] [app] Starting request: urn:request:2f1029f6-f113-4c47-88c3-0d26ab317c2c (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:45:00,653 [278] [DEBUG] [app] Starting request: urn:request:0628b4b7-b29d-4776-8166-db1efa2dfb74 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:45:00,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:45:00,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:45:00,657 [284] [DEBUG] [app] Starting request: urn:request:7b99091c-56d0-48c4-b675-544023365b19 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:45:00,657 [289] [DEBUG] [app] Starting request: urn:request:34f380aa-2ee6-41bd-9d2a-ba97b037249d (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:45:00,657 [284] [DEBUG] [app] Ending request: urn:request:7b99091c-56d0-48c4-b675-544023365b19 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7b99091c-56d0-48c4-b675-544023365b19', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:45:00,657 [289] [DEBUG] [app] Ending request: urn:request:34f380aa-2ee6-41bd-9d2a-ba97b037249d (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:34f380aa-2ee6-41bd-9d2a-ba97b037249d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:45:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:45:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:45:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:45:00,658 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 03:45:00,658 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:45:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:45:00,658 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:45:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:45:00,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:45:00,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:45:00,661 [279] [DEBUG] [app] Starting request: urn:request:566757b8-4578-4f4d-8063-ccabef0e2fde (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:45:00,661 [282] [DEBUG] [app] Starting request: urn:request:a2e9aef0-c20a-4b22-a8c5-1b8cc859d071 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:45:00,661 [282] [DEBUG] [app] Ending request: urn:request:a2e9aef0-c20a-4b22-a8c5-1b8cc859d071 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a2e9aef0-c20a-4b22-a8c5-1b8cc859d071', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:45:00,661 [279] [DEBUG] [app] Ending request: urn:request:566757b8-4578-4f4d-8063-ccabef0e2fde (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:566757b8-4578-4f4d-8063-ccabef0e2fde', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:45:00,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:45:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:45:00,662 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:45:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:45:00,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:45:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:45:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 03:45:00,662 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:45:00,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:45:00,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:45:00,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:45:00,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:45:00,676 [278] [DEBUG] [app] Ending request: urn:request:0628b4b7-b29d-4776-8166-db1efa2dfb74 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:0628b4b7-b29d-4776-8166-db1efa2dfb74', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:45:00,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:45:00,676 [282] [DEBUG] [app] Ending request: urn:request:2f1029f6-f113-4c47-88c3-0d26ab317c2c (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2f1029f6-f113-4c47-88c3-0d26ab317c2c', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:45:00,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:45:00,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:45:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:45:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:45:00,677 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:45:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:45:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
notificationworker stdout | 2024-04-22 03:45:01,555 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:45:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:45:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:16.552337+00:00 (in 13.995634 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:45:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:02 UTC)" (scheduled at 2024-04-22 03:45:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:45:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:45:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:45:02,874 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:45:03,187 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:45:03,302 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:45:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:45:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:13.759375+00:00 (in 9.999492 seconds)
notificationworker stdout | 2024-04-22 03:45:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:45:13 UTC)" (scheduled at 2024-04-22 03:45:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:45:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:45:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 45, 3, 760168), True, datetime.datetime(2024, 4, 22, 3, 45, 3, 760168), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:45:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:45:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:45:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:45:13 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:45:04,349 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:45:04,352 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:45:04,355 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:45:04,408 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 03:45:05,529 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:45:05,722 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
securityworker stdout | 2024-04-22 03:45:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:45:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:26.873109+00:00 (in 21.000752 seconds)
securityworker stdout | 2024-04-22 03:45:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:35 UTC)" (scheduled at 2024-04-22 03:45:05.871852+00:00)
securityworker stdout | 2024-04-22 03:45:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:45:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:45:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:45:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:45:05,889 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:45:05,891 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:45:05,891 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:35 UTC)" executed successfully
globalpromstats stdout | 2024-04-22 03:45:05,923 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
repositorygcworker stdout | 2024-04-22 03:45:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:45:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:13.555667+00:00 (in 7.002699 seconds)
repositorygcworker stdout | 2024-04-22 03:45:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:06 UTC)" (scheduled at 2024-04-22 03:45:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:45:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:45:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 45, 6, 553254), True, datetime.datetime(2024, 4, 22, 3, 45, 6, 553254), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:45:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:45:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:45:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:06 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:45:06,711 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:45:08,127 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:45:08,167 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:45:08,621 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:45:08,727 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:45:09,833 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:45:10,565 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:45:10,575 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:45:10,580 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:45:10,583 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:45:10,587 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:45:10,591 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:45:10,595 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:45:10,599 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:45:10,602 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:45:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:45:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:41.264267+00:00 (in 29.999524 seconds)
autopruneworker stdout | 2024-04-22 03:45:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:41 UTC)" (scheduled at 2024-04-22 03:45:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:45:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757451271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:45:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:45:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:45:11,277 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:45:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:45:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:06.552482+00:00 (in 52.996326 seconds)
repositorygcworker stdout | 2024-04-22 03:45:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:13 UTC)" (scheduled at 2024-04-22 03:45:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:45:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:45:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:45:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:45:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:19.762424+00:00 (in 6.002511 seconds)
notificationworker stdout | 2024-04-22 03:45:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:45:23 UTC)" (scheduled at 2024-04-22 03:45:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:45:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:45:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 45, 13, 760343), True, datetime.datetime(2024, 4, 22, 3, 45, 13, 760343), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:45:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:45:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:45:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:45:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:45:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:45:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:44.952062+00:00 (in 29.999560 seconds)
gcworker stdout | 2024-04-22 03:45:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:44 UTC)" (scheduled at 2024-04-22 03:45:14.952062+00:00)
gcworker stdout | 2024-04-22 03:45:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712547914952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:45:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:45:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:45:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:45:15,652 [282] [DEBUG] [app] Starting request: urn:request:b34c44cd-a7d4-4d3f-af0e-43181e613ed8 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:45:15,652 [278] [DEBUG] [app] Starting request: urn:request:88bc068a-1586-48a5-9bb1-7892968e6191 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:45:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:45:15,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:45:15,656 [284] [DEBUG] [app] Starting request: urn:request:bc9b80dd-57a3-4a5b-be17-7e8cbf2f7be7 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:45:15,656 [289] [DEBUG] [app] Starting request: urn:request:01161ae3-8ade-4bc9-9e6e-496a29ddb849 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:45:15,656 [284] [DEBUG] [app] Ending request: urn:request:bc9b80dd-57a3-4a5b-be17-7e8cbf2f7be7 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:bc9b80dd-57a3-4a5b-be17-7e8cbf2f7be7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:45:15,657 [289] [DEBUG] [app] Ending request: urn:request:01161ae3-8ade-4bc9-9e6e-496a29ddb849 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:01161ae3-8ade-4bc9-9e6e-496a29ddb849', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:45:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:45:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:45:15,657 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:45:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:45:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:45:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:45:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:45:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:45:15,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:45:15,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:45:15,660 [279] [DEBUG] [app] Starting request: urn:request:0e44f58e-6ed8-457d-8c96-31f19cedb798 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:45:15,660 [278] [DEBUG] [app] Starting request: urn:request:63ea54cd-6be4-4c0f-b6b4-5c4609c3e865 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:45:15,661 [279] [DEBUG] [app] Ending request: urn:request:0e44f58e-6ed8-457d-8c96-31f19cedb798 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:0e44f58e-6ed8-457d-8c96-31f19cedb798', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:45:15,661 [278] [DEBUG] [app] Ending request: urn:request:63ea54cd-6be4-4c0f-b6b4-5c4609c3e865 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:63ea54cd-6be4-4c0f-b6b4-5c4609c3e865', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:45:15,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:45:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:45:15,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:45:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:45:15,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:45:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:45:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:45:15,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:45:15,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:45:15,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:45:15,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:45:15,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:45:15,676 [278] [DEBUG] [app] Ending request: urn:request:88bc068a-1586-48a5-9bb1-7892968e6191 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:88bc068a-1586-48a5-9bb1-7892968e6191', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:45:15,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:45:15,677 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:45:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:45:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
gunicorn-web stdout | 2024-04-22 03:45:15,677 [282] [DEBUG] [app] Ending request: urn:request:b34c44cd-a7d4-4d3f-af0e-43181e613ed8 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b34c44cd-a7d4-4d3f-af0e-43181e613ed8', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:45:15,677 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:45:15,678 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:45:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:45:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.025)
securityscanningnotificationworker stdout | 2024-04-22 03:45:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:45:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:02.556208+00:00 (in 46.003341 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:45:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:16 UTC)" (scheduled at 2024-04-22 03:45:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:45:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:45:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 45, 16, 553345), True, datetime.datetime(2024, 4, 22, 3, 45, 16, 553345), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:45:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:45:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:45:16,565 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:45:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:45:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:47.052354+00:00 (in 29.999516 seconds)
buildlogsarchiver stdout | 2024-04-22 03:45:17,052 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:47 UTC)" (scheduled at 2024-04-22 03:45:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:45:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 45, 17, 53063), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:45:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:45:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:45:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:45:19,028 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:45:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:45:19,763 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:23.759375+00:00 (in 3.996387 seconds)
notificationworker stdout | 2024-04-22 03:45:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:19 UTC)" (scheduled at 2024-04-22 03:45:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:45:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:45:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:45:20,579 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:45:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:45:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:43.057186+00:00 (in 20.997718 seconds)
namespacegcworker stdout | 2024-04-22 03:45:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:22 UTC)" (scheduled at 2024-04-22 03:45:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:45:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:45:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:45:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:45:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:33.759375+00:00 (in 9.999483 seconds)
notificationworker stdout | 2024-04-22 03:45:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:45:33 UTC)" (scheduled at 2024-04-22 03:45:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:45:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:45:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 45, 23, 760209), True, datetime.datetime(2024, 4, 22, 3, 45, 23, 760209), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:45:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:45:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:45:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:45:33 UTC)" executed successfully
builder stdout | 2024-04-22 03:45:24,126 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
quotaregistrysizeworker stdout | 2024-04-22 03:45:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:45:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:24.361582+00:00 (in 59.999527 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:45:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:24 UTC)" (scheduled at 2024-04-22 03:45:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:45:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:45:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:45:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:45:25,715 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:45:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:45:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:35.871852+00:00 (in 8.998281 seconds)
securityworker stdout | 2024-04-22 03:45:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:56 UTC)" (scheduled at 2024-04-22 03:45:26.873109+00:00)
securityworker stdout | 2024-04-22 03:45:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:45:26,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:45:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:45:26,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:45:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:45:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:45:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:45:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:45:26,882 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:45:26,892 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:45:26,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:45:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:45:26,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 40, 26, 882402), 1, 2])
securityworker stdout | 2024-04-22 03:45:26,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:45:26,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:45:26,898 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 40, 26, 882402), 1, 2])
securityworker stdout | 2024-04-22 03:45:26,901 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:45:26,901 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:45:26,901 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:45:26,901 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:45:26,901 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:45:26,901 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:45:26,901 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:45:26,902 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:45:26,902 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:45:26,902 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:45:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:45:27,170 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:45:29,105 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:45:29,108 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:45:29,744 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:45:29,753 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:45:29,758 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:45:29,761 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:45:29,764 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:45:30,145 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:45:30,652 [281] [DEBUG] [app] Starting request: urn:request:8b88ef1d-ba22-43df-b1c6-0b8a01da5c2f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:45:30,652 [279] [DEBUG] [app] Starting request: urn:request:55a05e08-11ce-4c8b-b5b9-d6735a92a4b4 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:45:30,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:45:30,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:45:30,656 [284] [DEBUG] [app] Starting request: urn:request:5c3fe2e5-16e1-480f-8952-129941d4ac44 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:45:30,656 [284] [DEBUG] [app] Ending request: urn:request:5c3fe2e5-16e1-480f-8952-129941d4ac44 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5c3fe2e5-16e1-480f-8952-129941d4ac44', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:45:30,656 [292] [DEBUG] [app] Starting request: urn:request:cac5c3c8-b148-4ce6-9161-efda7b1145a1 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:45:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:45:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:45:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:45:30,657 [292] [DEBUG] [app] Ending request: urn:request:cac5c3c8-b148-4ce6-9161-efda7b1145a1 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:cac5c3c8-b148-4ce6-9161-efda7b1145a1', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:45:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:45:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:45:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:45:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:45:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:45:30,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:45:30,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:45:30,660 [279] [DEBUG] [app] Starting request: urn:request:1a4e9284-eea4-4dff-87ad-3ce09ee289bc (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:45:30,660 [279] [DEBUG] [app] Ending request: urn:request:1a4e9284-eea4-4dff-87ad-3ce09ee289bc (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1a4e9284-eea4-4dff-87ad-3ce09ee289bc', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:45:30,661 [278] [DEBUG] [app] Starting request: urn:request:6f24bc41-76e1-429d-b0e7-034f7a2fe9b4 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:45:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:45:30,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:45:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:45:30,661 [278] [DEBUG] [app] Ending request: urn:request:6f24bc41-76e1-429d-b0e7-034f7a2fe9b4 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:6f24bc41-76e1-429d-b0e7-034f7a2fe9b4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:45:30,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:45:30,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:45:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:45:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:45:30,662 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:45:30,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:45:30,662 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:45:30,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:45:30,669 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:45:30,677 [279] [DEBUG] [app] Ending request: urn:request:55a05e08-11ce-4c8b-b5b9-d6735a92a4b4 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:55a05e08-11ce-4c8b-b5b9-d6735a92a4b4', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:45:30,677 [281] [DEBUG] [app] Ending request: urn:request:8b88ef1d-ba22-43df-b1c6-0b8a01da5c2f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:8b88ef1d-ba22-43df-b1c6-0b8a01da5c2f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:45:30,677 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:45:30,677 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:45:30,677 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:45:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:45:30,677 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:45:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:45:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:45:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
notificationworker stdout | 2024-04-22 03:45:31,591 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:45:32,905 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:45:33,223 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:45:33,340 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:45:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:45:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:43.759375+00:00 (in 9.999447 seconds)
notificationworker stdout | 2024-04-22 03:45:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:45:43 UTC)" (scheduled at 2024-04-22 03:45:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:45:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:45:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 45, 33, 760293), True, datetime.datetime(2024, 4, 22, 3, 45, 33, 760293), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:45:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:45:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:45:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:45:43 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:45:34,358 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:45:34,362 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:45:34,365 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:45:34,446 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 03:45:35,565 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:45:35,757 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
securityworker stdout | 2024-04-22 03:45:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:45:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:56.873109+00:00 (in 21.000810 seconds)
securityworker stdout | 2024-04-22 03:45:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:05 UTC)" (scheduled at 2024-04-22 03:45:35.871852+00:00)
securityworker stdout | 2024-04-22 03:45:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:45:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:45:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:45:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:45:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:45:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:45:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:05 UTC)" executed successfully
globalpromstats stdout | 2024-04-22 03:45:35,959 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 03:45:36,747 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:45:38,157 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:45:38,198 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:45:38,657 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:45:38,737 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
exportactionlogsworker stdout | 2024-04-22 03:45:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:45:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:41.564959+00:00 (in 1.997493 seconds)
exportactionlogsworker stdout | 2024-04-22 03:45:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:39 UTC)" (scheduled at 2024-04-22 03:45:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:45:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:45:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:45:39,870 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:45:40,574 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:45:40,587 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:45:40,590 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:45:40,593 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:45:40,596 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:45:40,599 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:45:40,603 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:45:40,607 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:45:40,615 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:45:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:45:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:11.264267+00:00 (in 29.999517 seconds)
autopruneworker stdout | 2024-04-22 03:45:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:11 UTC)" (scheduled at 2024-04-22 03:45:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:45:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757481271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:45:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:45:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:45:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:45:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:45:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:39.566970+00:00 (in 58.001538 seconds)
exportactionlogsworker stdout | 2024-04-22 03:45:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:41 UTC)" (scheduled at 2024-04-22 03:45:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:45:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:45:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 45, 41, 565828), True, datetime.datetime(2024, 4, 22, 3, 45, 41, 565828), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:45:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:45:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:45:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:45:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:45:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:22.058978+00:00 (in 39.001327 seconds)
namespacegcworker stdout | 2024-04-22 03:45:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:43 UTC)" (scheduled at 2024-04-22 03:45:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:45:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:45:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 45, 43, 57934), True, datetime.datetime(2024, 4, 22, 3, 45, 43, 57934), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:45:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:45:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:45:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:46:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:45:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:45:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:45:53.759375+00:00 (in 9.999466 seconds)
notificationworker stdout | 2024-04-22 03:45:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:45:53 UTC)" (scheduled at 2024-04-22 03:45:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:45:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:45:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 45, 43, 760234), True, datetime.datetime(2024, 4, 22, 3, 45, 43, 760234), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:45:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:45:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:45:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:45:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:45:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:45:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:14.952062+00:00 (in 29.999515 seconds)
gcworker stdout | 2024-04-22 03:45:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:14 UTC)" (scheduled at 2024-04-22 03:45:44.952062+00:00)
gcworker stdout | 2024-04-22 03:45:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712547944952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:45:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:45:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:45:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:45:45,652 [278] [DEBUG] [app] Starting request: urn:request:fd31e4fd-641f-48b1-8380-2297c64ec156 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:45:45,652 [282] [DEBUG] [app] Starting request: urn:request:cc7fd089-16a7-49c0-b96f-1fc5f1c7b6af (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:45:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:45:45,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:45:45,656 [284] [DEBUG] [app] Starting request: urn:request:cd0bc4bb-64f5-42e2-ae47-fe145de29c8d (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:45:45,657 [291] [DEBUG] [app] Starting request: urn:request:5b470346-8e05-4150-af68-a93ba4e175df (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:45:45,657 [284] [DEBUG] [app] Ending request: urn:request:cd0bc4bb-64f5-42e2-ae47-fe145de29c8d (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:cd0bc4bb-64f5-42e2-ae47-fe145de29c8d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:45:45,657 [291] [DEBUG] [app] Ending request: urn:request:5b470346-8e05-4150-af68-a93ba4e175df (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5b470346-8e05-4150-af68-a93ba4e175df', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:45:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:45:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:45:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:45:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:45:45,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:45:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:45:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:45:45,658 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:45:45,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:45:45,660 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:45:45,661 [279] [DEBUG] [app] Starting request: urn:request:2383e085-3cc5-4486-bf09-96b6f7884d1c (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:45:45,661 [279] [DEBUG] [app] Ending request: urn:request:2383e085-3cc5-4486-bf09-96b6f7884d1c (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:2383e085-3cc5-4486-bf09-96b6f7884d1c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:45:45,661 [282] [DEBUG] [app] Starting request: urn:request:0f670764-fdc9-444e-9700-08afe64bc746 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:45:45,662 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:45:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:45:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 03:45:45,662 [282] [DEBUG] [app] Ending request: urn:request:0f670764-fdc9-444e-9700-08afe64bc746 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:0f670764-fdc9-444e-9700-08afe64bc746', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:45:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:45:45,662 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:45:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:45:45,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:45:45,662 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:45:45,663 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:45:45,663 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:45:45,669 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:45:45,670 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:45:45,677 [278] [DEBUG] [app] Ending request: urn:request:fd31e4fd-641f-48b1-8380-2297c64ec156 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:fd31e4fd-641f-48b1-8380-2297c64ec156', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:45:45,678 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:45:45,678 [282] [DEBUG] [app] Ending request: urn:request:cc7fd089-16a7-49c0-b96f-1fc5f1c7b6af (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:cc7fd089-16a7-49c0-b96f-1fc5f1c7b6af', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:45:45,678 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:45:45,678 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:45:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:45:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
gunicorn-web stdout | 2024-04-22 03:45:45,678 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:45:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:45:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.027 118 0.026)
buildlogsarchiver stdout | 2024-04-22 03:45:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:45:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:17.052354+00:00 (in 29.999498 seconds)
buildlogsarchiver stdout | 2024-04-22 03:45:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:17 UTC)" (scheduled at 2024-04-22 03:45:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:45:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 45, 47, 53122), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:45:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:45:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:45:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:45:49,060 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:45:50,610 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:45:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:45:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:03.759375+00:00 (in 9.999440 seconds)
notificationworker stdout | 2024-04-22 03:45:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:46:03 UTC)" (scheduled at 2024-04-22 03:45:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:45:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:45:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 45, 53, 760246), True, datetime.datetime(2024, 4, 22, 3, 45, 53, 760246), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:45:53,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:45:53,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:45:53,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:46:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:45:54,162 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:45:55,751 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:45:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:45:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:05.871852+00:00 (in 8.998281 seconds)
securityworker stdout | 2024-04-22 03:45:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:26 UTC)" (scheduled at 2024-04-22 03:45:56.873109+00:00)
securityworker stdout | 2024-04-22 03:45:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:45:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:45:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:45:56,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:45:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:45:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:45:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:45:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:45:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:45:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:45:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:45:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:45:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 40, 56, 880758), 1, 2])
securityworker stdout | 2024-04-22 03:45:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:45:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:45:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 40, 56, 880758), 1, 2])
securityworker stdout | 2024-04-22 03:45:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:45:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:45:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:45:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:45:56,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:45:56,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:45:56,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:45:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:45:56,901 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:45:56,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:45:57,205 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:45:59,141 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:45:59,144 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:45:59,752 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:45:59,762 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:45:59,766 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:45:59,770 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:45:59,773 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:46:00,180 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:46:00,652 [282] [DEBUG] [app] Starting request: urn:request:593d400a-d818-4a83-9072-700578cb28ab (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:46:00,652 [279] [DEBUG] [app] Starting request: urn:request:00185fd8-9879-4d04-bbce-4905f5e9df75 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:46:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:46:00,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:46:00,656 [285] [DEBUG] [app] Starting request: urn:request:35812cdf-da07-4709-a8b9-91cff6a2ec53 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:46:00,656 [292] [DEBUG] [app] Starting request: urn:request:db568746-3ae6-4805-9dd2-4cfcf266cba1 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:46:00,656 [285] [DEBUG] [app] Ending request: urn:request:35812cdf-da07-4709-a8b9-91cff6a2ec53 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:35812cdf-da07-4709-a8b9-91cff6a2ec53', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:46:00,656 [292] [DEBUG] [app] Ending request: urn:request:db568746-3ae6-4805-9dd2-4cfcf266cba1 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:db568746-3ae6-4805-9dd2-4cfcf266cba1', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:46:00,657 [285] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:46:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:46:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:46:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:46:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:46:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:46:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:46:00,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:46:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:46:00,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:46:00,659 [279] [DEBUG] [app] Starting request: urn:request:bf458e79-46cf-4bad-b1bf-0211f3617409 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:46:00,660 [278] [DEBUG] [app] Starting request: urn:request:264a27de-3a6b-4ee2-af76-0b0bdbbc392c (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:46:00,660 [279] [DEBUG] [app] Ending request: urn:request:bf458e79-46cf-4bad-b1bf-0211f3617409 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:bf458e79-46cf-4bad-b1bf-0211f3617409', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:46:00,660 [278] [DEBUG] [app] Ending request: urn:request:264a27de-3a6b-4ee2-af76-0b0bdbbc392c (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:264a27de-3a6b-4ee2-af76-0b0bdbbc392c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:46:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:46:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:46:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:46:00,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:46:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:46:00,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:46:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:46:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:46:00,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:46:00,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:46:00,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:46:00,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:46:00,675 [282] [DEBUG] [app] Ending request: urn:request:593d400a-d818-4a83-9072-700578cb28ab (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:593d400a-d818-4a83-9072-700578cb28ab', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:46:00,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:46:00,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:46:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:46:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.023)
gunicorn-web stdout | 2024-04-22 03:46:00,675 [279] [DEBUG] [app] Ending request: urn:request:00185fd8-9879-4d04-bbce-4905f5e9df75 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:00185fd8-9879-4d04-bbce-4905f5e9df75', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:46:00,676 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:46:00,676 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:46:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:46:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.024)
notificationworker stdout | 2024-04-22 03:46:01,628 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:46:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:46:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:16.552337+00:00 (in 13.995608 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:46:02,557 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:02 UTC)" (scheduled at 2024-04-22 03:46:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:46:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:46:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:46:02,931 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:46:03,260 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:46:03,376 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:46:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:46:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:13.759375+00:00 (in 9.999476 seconds)
notificationworker stdout | 2024-04-22 03:46:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:46:13 UTC)" (scheduled at 2024-04-22 03:46:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:46:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:46:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 46, 3, 760415), True, datetime.datetime(2024, 4, 22, 3, 46, 3, 760415), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:46:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:46:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:46:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:46:13 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:46:04,367 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:46:04,371 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:46:04,374 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:46:04,457 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 03:46:05,601 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:46:05,793 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
securityworker stdout | 2024-04-22 03:46:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:46:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:26.873109+00:00 (in 21.000733 seconds)
securityworker stdout | 2024-04-22 03:46:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:35 UTC)" (scheduled at 2024-04-22 03:46:05.871852+00:00)
securityworker stdout | 2024-04-22 03:46:05,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:46:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:46:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:46:05,877 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:46:05,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:46:05,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:46:05,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:35 UTC)" executed successfully
globalpromstats stdout | 2024-04-22 03:46:05,966 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
repositorygcworker stdout | 2024-04-22 03:46:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:46:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:13.555667+00:00 (in 7.002695 seconds)
repositorygcworker stdout | 2024-04-22 03:46:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:06 UTC)" (scheduled at 2024-04-22 03:46:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:46:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:46:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 46, 6, 553357), True, datetime.datetime(2024, 4, 22, 3, 46, 6, 553357), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:46:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:46:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:46:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:06 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:46:06,785 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:46:08,192 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:46:08,234 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:46:08,693 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:46:08,759 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:46:09,907 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:46:10,583 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:46:10,596 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:46:10,600 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:46:10,605 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:46:10,608 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:46:10,611 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:46:10,613 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:46:10,619 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:46:10,625 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:46:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:46:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:41.264267+00:00 (in 29.999516 seconds)
autopruneworker stdout | 2024-04-22 03:46:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:41 UTC)" (scheduled at 2024-04-22 03:46:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:46:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757511271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:46:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:46:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:46:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:46:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:46:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:51.555445+00:00 (in 37.999285 seconds)
repositorygcworker stdout | 2024-04-22 03:46:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:13 UTC)" (scheduled at 2024-04-22 03:46:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:46:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:46:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:46:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:46:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:19.762424+00:00 (in 6.002548 seconds)
notificationworker stdout | 2024-04-22 03:46:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:46:23 UTC)" (scheduled at 2024-04-22 03:46:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:46:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:46:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 46, 13, 760365), True, datetime.datetime(2024, 4, 22, 3, 46, 13, 760365), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:46:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:46:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:46:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:46:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:46:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:46:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:44.952062+00:00 (in 29.999552 seconds)
gcworker stdout | 2024-04-22 03:46:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:44 UTC)" (scheduled at 2024-04-22 03:46:14.952062+00:00)
gcworker stdout | 2024-04-22 03:46:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712547974952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:46:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:46:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:46:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:46:15,653 [278] [DEBUG] [app] Starting request: urn:request:706535ce-8fdd-4106-8566-d22115131fcc (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:46:15,653 [279] [DEBUG] [app] Starting request: urn:request:13c7fd34-5009-4079-aab4-ae43dbf0b84b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:46:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:46:15,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:46:15,657 [288] [DEBUG] [app] Starting request: urn:request:22584145-eacb-4760-a3e2-18696181db52 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:46:15,657 [284] [DEBUG] [app] Starting request: urn:request:f6bde8bb-a9fc-45fc-a2f9-a9b26e0b5722 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:46:15,657 [284] [DEBUG] [app] Ending request: urn:request:f6bde8bb-a9fc-45fc-a2f9-a9b26e0b5722 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f6bde8bb-a9fc-45fc-a2f9-a9b26e0b5722', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:46:15,657 [288] [DEBUG] [app] Ending request: urn:request:22584145-eacb-4760-a3e2-18696181db52 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:22584145-eacb-4760-a3e2-18696181db52', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:46:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:46:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:46:15,658 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:46:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:46:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:46:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:46:15,658 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:46:15,658 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:46:15,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:46:15,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:46:15,661 [279] [DEBUG] [app] Starting request: urn:request:069307e1-3a4d-477e-b9cf-f0cc0510911a (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:46:15,661 [282] [DEBUG] [app] Starting request: urn:request:8056c0ae-300a-4e5a-b06e-2bdf85c99c92 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:46:15,661 [279] [DEBUG] [app] Ending request: urn:request:069307e1-3a4d-477e-b9cf-f0cc0510911a (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:069307e1-3a4d-477e-b9cf-f0cc0510911a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:46:15,661 [282] [DEBUG] [app] Ending request: urn:request:8056c0ae-300a-4e5a-b06e-2bdf85c99c92 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:8056c0ae-300a-4e5a-b06e-2bdf85c99c92', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:46:15,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:46:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:46:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:46:15,662 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:46:15,662 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:46:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:46:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:46:15,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:46:15,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:46:15,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:46:15,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:46:15,669 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:46:15,676 [279] [DEBUG] [app] Ending request: urn:request:13c7fd34-5009-4079-aab4-ae43dbf0b84b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:13c7fd34-5009-4079-aab4-ae43dbf0b84b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:46:15,676 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:46:15,676 [278] [DEBUG] [app] Ending request: urn:request:706535ce-8fdd-4106-8566-d22115131fcc (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:706535ce-8fdd-4106-8566-d22115131fcc', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:46:15,677 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:46:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
gunicorn-web stdout | 2024-04-22 03:46:15,677 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:46:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:46:15,677 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:46:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:46:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
securityscanningnotificationworker stdout | 2024-04-22 03:46:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:46:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:02.556208+00:00 (in 46.003260 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:46:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:16 UTC)" (scheduled at 2024-04-22 03:46:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:46:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:46:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 46, 16, 553334), True, datetime.datetime(2024, 4, 22, 3, 46, 16, 553334), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:46:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:46:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:46:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:46:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:46:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:47.052354+00:00 (in 29.999465 seconds)
buildlogsarchiver stdout | 2024-04-22 03:46:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:47 UTC)" (scheduled at 2024-04-22 03:46:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:46:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 46, 17, 53263), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:46:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:46:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:46:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:46:19,095 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:46:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:46:19,763 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:23.759375+00:00 (in 3.996375 seconds)
notificationworker stdout | 2024-04-22 03:46:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:19 UTC)" (scheduled at 2024-04-22 03:46:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:46:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:46:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:46:20,623 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:46:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:46:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:43.057186+00:00 (in 20.997731 seconds)
namespacegcworker stdout | 2024-04-22 03:46:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:22 UTC)" (scheduled at 2024-04-22 03:46:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:46:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:46:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:46:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:46:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:33.759375+00:00 (in 9.999472 seconds)
notificationworker stdout | 2024-04-22 03:46:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:46:33 UTC)" (scheduled at 2024-04-22 03:46:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:46:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:46:23,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 46, 23, 760173), True, datetime.datetime(2024, 4, 22, 3, 46, 23, 760173), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:46:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:46:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:46:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:46:33 UTC)" executed successfully
builder stdout | 2024-04-22 03:46:24,199 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
quotaregistrysizeworker stdout | 2024-04-22 03:46:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:46:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:24.361582+00:00 (in 59.999527 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:46:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:24 UTC)" (scheduled at 2024-04-22 03:46:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:46:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:46:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:46:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:46:25,789 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:46:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:46:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:35.871852+00:00 (in 8.998270 seconds)
securityworker stdout | 2024-04-22 03:46:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:56 UTC)" (scheduled at 2024-04-22 03:46:26.873109+00:00)
securityworker stdout | 2024-04-22 03:46:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:46:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:46:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:46:26,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:46:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:46:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:46:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:46:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:46:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:46:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:46:26,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:46:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:46:26,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 41, 26, 881081), 1, 2])
securityworker stdout | 2024-04-22 03:46:26,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:46:26,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:46:26,899 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 41, 26, 881081), 1, 2])
securityworker stdout | 2024-04-22 03:46:26,901 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:46:26,901 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:46:26,901 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:46:26,901 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:46:26,901 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:46:26,902 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:46:26,902 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:46:26,902 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:46:26,903 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:46:26,903 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:46:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:46:27,242 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:46:29,177 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:46:29,180 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:46:29,760 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:46:29,770 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:46:29,773 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:46:29,778 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:46:29,780 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:46:30,217 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:46:30,652 [279] [DEBUG] [app] Starting request: urn:request:c6f0cebf-bf86-48c9-8398-8186c2d7e08f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:46:30,652 [278] [DEBUG] [app] Starting request: urn:request:e93d097c-c7f8-417f-99ad-a1ad9d011f56 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:46:30,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:46:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:46:30,656 [284] [DEBUG] [app] Starting request: urn:request:f0f76991-6656-422f-a3a2-478c2ccaa378 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:46:30,656 [292] [DEBUG] [app] Starting request: urn:request:8e15b403-0488-41e4-a66e-791d0fe36aef (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:46:30,656 [284] [DEBUG] [app] Ending request: urn:request:f0f76991-6656-422f-a3a2-478c2ccaa378 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f0f76991-6656-422f-a3a2-478c2ccaa378', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:46:30,656 [292] [DEBUG] [app] Ending request: urn:request:8e15b403-0488-41e4-a66e-791d0fe36aef (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:8e15b403-0488-41e4-a66e-791d0fe36aef', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:46:30,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:46:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:46:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:46:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:46:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:46:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:46:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:46:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:46:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:46:30,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:46:30,659 [278] [DEBUG] [app] Starting request: urn:request:eec65674-3f9c-4972-bdf0-194d18879aa5 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:46:30,660 [278] [DEBUG] [app] Ending request: urn:request:eec65674-3f9c-4972-bdf0-194d18879aa5 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:eec65674-3f9c-4972-bdf0-194d18879aa5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:46:30,660 [281] [DEBUG] [app] Starting request: urn:request:98dd6eed-bd53-46f7-86ff-8fe95ca4b48a (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:46:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:46:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:46:30,660 [281] [DEBUG] [app] Ending request: urn:request:98dd6eed-bd53-46f7-86ff-8fe95ca4b48a (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:98dd6eed-bd53-46f7-86ff-8fe95ca4b48a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:46:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:46:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:46:30,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:46:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:46:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 03:46:30,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:46:30,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:46:30,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:46:30,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:46:30,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:46:30,676 [279] [DEBUG] [app] Ending request: urn:request:c6f0cebf-bf86-48c9-8398-8186c2d7e08f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:c6f0cebf-bf86-48c9-8398-8186c2d7e08f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:46:30,677 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:46:30,677 [278] [DEBUG] [app] Ending request: urn:request:e93d097c-c7f8-417f-99ad-a1ad9d011f56 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e93d097c-c7f8-417f-99ad-a1ad9d011f56', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:46:30,677 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:46:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:46:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
gunicorn-web stdout | 2024-04-22 03:46:30,677 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:46:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.025)
gunicorn-web stdout | 2024-04-22 03:46:30,677 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:46:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
notificationworker stdout | 2024-04-22 03:46:31,665 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:46:32,945 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:46:33,296 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:46:33,414 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:46:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:46:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:43.759375+00:00 (in 9.999470 seconds)
notificationworker stdout | 2024-04-22 03:46:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:46:43 UTC)" (scheduled at 2024-04-22 03:46:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:46:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:46:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 46, 33, 760327), True, datetime.datetime(2024, 4, 22, 3, 46, 33, 760327), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:46:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:46:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:46:33,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:46:43 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:46:34,377 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:46:34,381 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:46:34,384 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:46:34,469 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 03:46:35,639 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:46:35,829 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
securityworker stdout | 2024-04-22 03:46:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:46:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:56.873109+00:00 (in 21.000820 seconds)
securityworker stdout | 2024-04-22 03:46:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:05 UTC)" (scheduled at 2024-04-22 03:46:35.871852+00:00)
securityworker stdout | 2024-04-22 03:46:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:46:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:46:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:46:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:46:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:46:35,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:46:35,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:05 UTC)" executed successfully
globalpromstats stdout | 2024-04-22 03:46:35,989 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 03:46:36,821 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:46:38,228 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:46:38,270 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:46:38,730 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:46:38,791 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
exportactionlogsworker stdout | 2024-04-22 03:46:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:46:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:41.564959+00:00 (in 1.997532 seconds)
exportactionlogsworker stdout | 2024-04-22 03:46:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:39 UTC)" (scheduled at 2024-04-22 03:46:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:46:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:46:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:46:39,943 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:46:40,596 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:46:40,606 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:46:40,608 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:46:40,617 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:46:40,620 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:46:40,624 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:46:40,627 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:46:40,630 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:46:40,635 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:46:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:46:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:11.264267+00:00 (in 29.999525 seconds)
autopruneworker stdout | 2024-04-22 03:46:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:11 UTC)" (scheduled at 2024-04-22 03:46:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:46:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757541271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:46:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:46:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:46:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:46:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:46:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:53.566665+00:00 (in 12.001226 seconds)
exportactionlogsworker stdout | 2024-04-22 03:46:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:41 UTC)" (scheduled at 2024-04-22 03:46:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:46:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:46:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 46, 41, 565696), True, datetime.datetime(2024, 4, 22, 3, 46, 41, 565696), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:46:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:46:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:46:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:46:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:46:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:22.058978+00:00 (in 39.001324 seconds)
namespacegcworker stdout | 2024-04-22 03:46:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:43 UTC)" (scheduled at 2024-04-22 03:46:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:46:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:46:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 46, 43, 57954), True, datetime.datetime(2024, 4, 22, 3, 46, 43, 57954), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:46:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:46:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:46:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:47:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:46:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:46:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:46:53.759375+00:00 (in 9.999442 seconds)
notificationworker stdout | 2024-04-22 03:46:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:46:53 UTC)" (scheduled at 2024-04-22 03:46:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:46:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:46:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 46, 43, 760384), True, datetime.datetime(2024, 4, 22, 3, 46, 43, 760384), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:46:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:46:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:46:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:46:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:46:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:46:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:14.952062+00:00 (in 29.999556 seconds)
gcworker stdout | 2024-04-22 03:46:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:14 UTC)" (scheduled at 2024-04-22 03:46:44.952062+00:00)
gcworker stdout | 2024-04-22 03:46:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548004952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:46:44,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:46:44,964 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:46:44,964 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:46:45,653 [279] [DEBUG] [app] Starting request: urn:request:1458ec43-a4de-4d68-ba6c-4e4207ac09fb (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:46:45,653 [282] [DEBUG] [app] Starting request: urn:request:be27dfee-ca88-4862-8efa-056ce0a1b393 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:46:45,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:46:45,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:46:45,657 [284] [DEBUG] [app] Starting request: urn:request:92aefbb1-c8aa-42c0-9497-ea8dad9568f4 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:46:45,657 [292] [DEBUG] [app] Starting request: urn:request:5fef8ad1-45e7-438c-94e6-42bea7ab3bb8 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:46:45,657 [284] [DEBUG] [app] Ending request: urn:request:92aefbb1-c8aa-42c0-9497-ea8dad9568f4 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:92aefbb1-c8aa-42c0-9497-ea8dad9568f4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:46:45,657 [292] [DEBUG] [app] Ending request: urn:request:5fef8ad1-45e7-438c-94e6-42bea7ab3bb8 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5fef8ad1-45e7-438c-94e6-42bea7ab3bb8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:46:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:46:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:46:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:46:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:46:45,658 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:46:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:46:45,658 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:46:45,658 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:46:45,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:46:45,660 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:46:45,660 [281] [DEBUG] [app] Starting request: urn:request:9fb87a74-7920-4dd2-ba3d-d0ca47fc884d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:46:45,661 [281] [DEBUG] [app] Ending request: urn:request:9fb87a74-7920-4dd2-ba3d-d0ca47fc884d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9fb87a74-7920-4dd2-ba3d-d0ca47fc884d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:46:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:46:45,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:46:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:46:45,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:46:45,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:46:45,662 [278] [DEBUG] [app] Starting request: urn:request:81fa16b3-a215-4ef5-95ab-ac13337896ed (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:46:45,662 [278] [DEBUG] [app] Ending request: urn:request:81fa16b3-a215-4ef5-95ab-ac13337896ed (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:81fa16b3-a215-4ef5-95ab-ac13337896ed', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:46:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 03:46:45,663 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:46:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:46:45,663 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:46:45,663 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:46:45,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:46:45,669 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:46:45,677 [279] [DEBUG] [app] Ending request: urn:request:1458ec43-a4de-4d68-ba6c-4e4207ac09fb (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:1458ec43-a4de-4d68-ba6c-4e4207ac09fb', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:46:45,677 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:46:45,677 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:46:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:46:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
gunicorn-web stdout | 2024-04-22 03:46:45,678 [282] [DEBUG] [app] Ending request: urn:request:be27dfee-ca88-4862-8efa-056ce0a1b393 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:be27dfee-ca88-4862-8efa-056ce0a1b393', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:46:45,678 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:46:45,678 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:46:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:46:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
buildlogsarchiver stdout | 2024-04-22 03:46:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:46:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:17.052354+00:00 (in 29.999516 seconds)
buildlogsarchiver stdout | 2024-04-22 03:46:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:17 UTC)" (scheduled at 2024-04-22 03:46:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:46:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 46, 47, 53202), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:46:47,065 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:46:47,065 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:46:47,065 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:46:49,117 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:46:50,631 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
repositorygcworker stdout | 2024-04-22 03:46:51,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:46:51,555 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:06.552482+00:00 (in 14.996509 seconds)
repositorygcworker stdout | 2024-04-22 03:46:51,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:51:51 UTC)" (scheduled at 2024-04-22 03:46:51.555445+00:00)
repositorygcworker stdout | 2024-04-22 03:46:51,556 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 46, 51, 556337), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 03:46:51,566 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 46, 51, 556337), True, datetime.datetime(2024, 4, 22, 3, 46, 51, 556337), 0, 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 03:46:51,569 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 46, 51, 556337), True, datetime.datetime(2024, 4, 22, 3, 46, 51, 556337), 0, 'repositorygc/%', False, datetime.datetime(2024, 4, 22, 3, 46, 51, 556337), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 03:46:51,572 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:46:51,572 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:51:51 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:46:53,566 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:46:53,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:39.566970+00:00 (in 45.999832 seconds)
exportactionlogsworker stdout | 2024-04-22 03:46:53,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:51:53 UTC)" (scheduled at 2024-04-22 03:46:53.566665+00:00)
exportactionlogsworker stdout | 2024-04-22 03:46:53,567 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 46, 53, 567353), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 03:46:53,577 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 46, 53, 567353), True, datetime.datetime(2024, 4, 22, 3, 46, 53, 567353), 0, 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 03:46:53,581 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 46, 53, 567353), True, datetime.datetime(2024, 4, 22, 3, 46, 53, 567353), 0, 'exportactionlogs/%', False, datetime.datetime(2024, 4, 22, 3, 46, 53, 567353), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 03:46:53,583 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:46:53,583 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:51:53 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:46:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:46:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:03.759375+00:00 (in 9.999478 seconds)
notificationworker stdout | 2024-04-22 03:46:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:47:03 UTC)" (scheduled at 2024-04-22 03:46:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:46:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:46:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 46, 53, 760320), True, datetime.datetime(2024, 4, 22, 3, 46, 53, 760320), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:46:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:46:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:46:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:47:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:46:54,207 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:46:55,825 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:46:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:46:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:05.871852+00:00 (in 8.998293 seconds)
securityworker stdout | 2024-04-22 03:46:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:26 UTC)" (scheduled at 2024-04-22 03:46:56.873109+00:00)
securityworker stdout | 2024-04-22 03:46:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:46:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:46:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:46:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:46:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:46:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:46:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:46:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:46:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:46:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:46:56,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:46:56,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:46:56,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 41, 56, 881607), 1, 2])
securityworker stdout | 2024-04-22 03:46:56,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:46:56,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:46:56,899 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 41, 56, 881607), 1, 2])
securityworker stdout | 2024-04-22 03:46:56,901 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:46:56,901 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:46:56,901 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:46:56,901 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:46:56,901 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:46:56,901 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:46:56,902 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:46:56,902 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:46:56,902 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:46:56,902 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:46:57,278 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:46:59,214 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:46:59,218 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:46:59,769 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:46:59,778 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:46:59,781 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:46:59,785 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:46:59,788 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:47:00,255 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:47:00,652 [279] [DEBUG] [app] Starting request: urn:request:5a02534b-be00-49f2-8ce2-7b37d97ab382 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:47:00,653 [282] [DEBUG] [app] Starting request: urn:request:9bb687dc-df8b-4821-8792-2ccdd68862c3 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:47:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:47:00,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:47:00,656 [284] [DEBUG] [app] Starting request: urn:request:806a84c1-1051-454f-a0f7-ef45dc8af769 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:47:00,656 [292] [DEBUG] [app] Starting request: urn:request:24b200b2-2255-49b8-949b-a7728681f62a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:47:00,656 [292] [DEBUG] [app] Ending request: urn:request:24b200b2-2255-49b8-949b-a7728681f62a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:24b200b2-2255-49b8-949b-a7728681f62a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:47:00,656 [284] [DEBUG] [app] Ending request: urn:request:806a84c1-1051-454f-a0f7-ef45dc8af769 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:806a84c1-1051-454f-a0f7-ef45dc8af769', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:47:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:47:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:47:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:47:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:47:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:47:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:47:00,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:47:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:47:00,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:47:00,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:47:00,660 [278] [DEBUG] [app] Starting request: urn:request:5435742e-20f6-4fcd-8f51-7c2382914047 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:47:00,660 [281] [DEBUG] [app] Starting request: urn:request:a9cb6da0-b491-405a-a29b-ac9f6623d54b (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:47:00,660 [281] [DEBUG] [app] Ending request: urn:request:a9cb6da0-b491-405a-a29b-ac9f6623d54b (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a9cb6da0-b491-405a-a29b-ac9f6623d54b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:47:00,660 [278] [DEBUG] [app] Ending request: urn:request:5435742e-20f6-4fcd-8f51-7c2382914047 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:5435742e-20f6-4fcd-8f51-7c2382914047', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:47:00,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:47:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:47:00,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:47:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:47:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:47:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:47:00,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:47:00,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:47:00,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:47:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:47:00,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:47:00,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:47:00,676 [282] [DEBUG] [app] Ending request: urn:request:9bb687dc-df8b-4821-8792-2ccdd68862c3 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:9bb687dc-df8b-4821-8792-2ccdd68862c3', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:47:00,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:47:00,676 [279] [DEBUG] [app] Ending request: urn:request:5a02534b-be00-49f2-8ce2-7b37d97ab382 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:5a02534b-be00-49f2-8ce2-7b37d97ab382', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:47:00,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:47:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:47:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:47:00,677 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:47:00,677 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:47:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:47:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
notificationworker stdout | 2024-04-22 03:47:01,681 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:47:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:47:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:16.552337+00:00 (in 13.995619 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:47:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:02 UTC)" (scheduled at 2024-04-22 03:47:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:47:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:47:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:47:02,955 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:47:03,333 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:47:03,450 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:47:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:47:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:13.759375+00:00 (in 9.999517 seconds)
notificationworker stdout | 2024-04-22 03:47:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:47:13 UTC)" (scheduled at 2024-04-22 03:47:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:47:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:47:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 47, 3, 760176), True, datetime.datetime(2024, 4, 22, 3, 47, 3, 760176), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:47:03,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:47:03,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:47:03,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:47:13 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:47:04,385 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:47:04,388 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:47:04,393 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:47:04,505 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 03:47:05,675 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:47:05,866 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
securityworker stdout | 2024-04-22 03:47:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:47:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:26.873109+00:00 (in 21.000793 seconds)
securityworker stdout | 2024-04-22 03:47:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:35 UTC)" (scheduled at 2024-04-22 03:47:05.871852+00:00)
securityworker stdout | 2024-04-22 03:47:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:47:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:47:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:47:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:47:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:47:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:47:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:35 UTC)" executed successfully
globalpromstats stdout | 2024-04-22 03:47:06,025 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
repositorygcworker stdout | 2024-04-22 03:47:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:47:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:13.555667+00:00 (in 7.002675 seconds)
repositorygcworker stdout | 2024-04-22 03:47:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:06 UTC)" (scheduled at 2024-04-22 03:47:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:47:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:47:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 47, 6, 553402), True, datetime.datetime(2024, 4, 22, 3, 47, 6, 553402), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:47:06,565 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:47:06,565 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:47:06,565 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:06 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:47:06,858 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:47:08,264 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:47:08,305 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:47:08,770 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:47:08,798 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
storagereplication stdout | 2024-04-22 03:47:09,979 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:47:10,610 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:47:10,615 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:47:10,622 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:47:10,625 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:47:10,630 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:47:10,635 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:47:10,638 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:47:10,641 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:47:10,646 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:47:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:47:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:41.264267+00:00 (in 29.999568 seconds)
autopruneworker stdout | 2024-04-22 03:47:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:41 UTC)" (scheduled at 2024-04-22 03:47:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:47:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757571271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:47:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:47:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:47:11,277 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:47:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:47:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:06.552482+00:00 (in 52.996302 seconds)
repositorygcworker stdout | 2024-04-22 03:47:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:13 UTC)" (scheduled at 2024-04-22 03:47:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:47:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:47:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:47:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:47:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:19.762424+00:00 (in 6.002523 seconds)
notificationworker stdout | 2024-04-22 03:47:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:47:23 UTC)" (scheduled at 2024-04-22 03:47:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:47:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:47:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 47, 13, 760328), True, datetime.datetime(2024, 4, 22, 3, 47, 13, 760328), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:47:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:47:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:47:13,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:47:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:47:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:47:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:44.952062+00:00 (in 29.999557 seconds)
gcworker stdout | 2024-04-22 03:47:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:44 UTC)" (scheduled at 2024-04-22 03:47:14.952062+00:00)
gcworker stdout | 2024-04-22 03:47:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548034952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:47:14,966 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:47:14,966 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:47:14,966 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:47:15,652 [281] [DEBUG] [app] Starting request: urn:request:4e16ef8e-6373-4ba7-9813-c89c7ba9fad5 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:47:15,652 [278] [DEBUG] [app] Starting request: urn:request:47949560-5496-4b72-a00a-2cdda75118a2 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:47:15,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:47:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:47:15,656 [288] [DEBUG] [app] Starting request: urn:request:6e34c045-0d56-414a-9898-b8f155b237b9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:47:15,656 [292] [DEBUG] [app] Starting request: urn:request:7ecbfad7-110a-43e6-b3ec-fb17ec90329c (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:47:15,656 [288] [DEBUG] [app] Ending request: urn:request:6e34c045-0d56-414a-9898-b8f155b237b9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:6e34c045-0d56-414a-9898-b8f155b237b9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:47:15,656 [292] [DEBUG] [app] Ending request: urn:request:7ecbfad7-110a-43e6-b3ec-fb17ec90329c (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7ecbfad7-110a-43e6-b3ec-fb17ec90329c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:47:15,656 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:47:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:47:15,656 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:47:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:47:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:47:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:47:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:47:15,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:47:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:47:15,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:47:15,660 [282] [DEBUG] [app] Starting request: urn:request:e45bf7ec-613e-4aef-8834-5e63532d33b3 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:47:15,660 [279] [DEBUG] [app] Starting request: urn:request:404a1405-6635-4712-bd89-68ced5ca493c (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:47:15,660 [282] [DEBUG] [app] Ending request: urn:request:e45bf7ec-613e-4aef-8834-5e63532d33b3 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e45bf7ec-613e-4aef-8834-5e63532d33b3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:47:15,660 [279] [DEBUG] [app] Ending request: urn:request:404a1405-6635-4712-bd89-68ced5ca493c (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:404a1405-6635-4712-bd89-68ced5ca493c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:47:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:47:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:47:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:47:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:47:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:47:15,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:47:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:47:15,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:47:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:47:15,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:47:15,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:47:15,668 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:47:15,676 [278] [DEBUG] [app] Ending request: urn:request:47949560-5496-4b72-a00a-2cdda75118a2 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:47949560-5496-4b72-a00a-2cdda75118a2', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:47:15,676 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:47:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
gunicorn-web stdout | 2024-04-22 03:47:15,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:47:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:47:15,676 [281] [DEBUG] [app] Ending request: urn:request:4e16ef8e-6373-4ba7-9813-c89c7ba9fad5 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:4e16ef8e-6373-4ba7-9813-c89c7ba9fad5', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:47:15,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:47:15,677 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:47:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:47:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
securityscanningnotificationworker stdout | 2024-04-22 03:47:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:47:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:21.555879+00:00 (in 5.002984 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:47:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:16 UTC)" (scheduled at 2024-04-22 03:47:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:47:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:47:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 47, 16, 553401), True, datetime.datetime(2024, 4, 22, 3, 47, 16, 553401), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:47:16,565 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:47:16,565 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:47:16,565 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:47:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:47:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:47.052354+00:00 (in 29.999516 seconds)
buildlogsarchiver stdout | 2024-04-22 03:47:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:47 UTC)" (scheduled at 2024-04-22 03:47:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:47:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 47, 17, 53105), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:47:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:47:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:47:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:47:19,153 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:47:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:47:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:23.759375+00:00 (in 3.996421 seconds)
notificationworker stdout | 2024-04-22 03:47:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:19 UTC)" (scheduled at 2024-04-22 03:47:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:47:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:47:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:47:20,668 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
securityscanningnotificationworker stdout | 2024-04-22 03:47:21,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:47:21,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:02.556208+00:00 (in 40.999756 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:47:21,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:52:21 UTC)" (scheduled at 2024-04-22 03:47:21.555879+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:47:21,557 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 47, 21, 556837), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 03:47:21,568 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 47, 21, 556837), True, datetime.datetime(2024, 4, 22, 3, 47, 21, 556837), 0, 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 03:47:21,571 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 47, 21, 556837), True, datetime.datetime(2024, 4, 22, 3, 47, 21, 556837), 0, 'secscanv4/%', False, datetime.datetime(2024, 4, 22, 3, 47, 21, 556837), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 03:47:21,573 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:47:21,573 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:52:21 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:47:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:47:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:38.058708+00:00 (in 15.999231 seconds)
namespacegcworker stdout | 2024-04-22 03:47:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:22 UTC)" (scheduled at 2024-04-22 03:47:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:47:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:47:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:47:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:47:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:33.759375+00:00 (in 9.999510 seconds)
notificationworker stdout | 2024-04-22 03:47:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:47:33 UTC)" (scheduled at 2024-04-22 03:47:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:47:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:47:23,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 47, 23, 760164), True, datetime.datetime(2024, 4, 22, 3, 47, 23, 760164), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:47:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:47:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:47:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:47:33 UTC)" executed successfully
builder stdout | 2024-04-22 03:47:24,243 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
quotaregistrysizeworker stdout | 2024-04-22 03:47:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:47:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:24.361582+00:00 (in 59.999524 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:47:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:24 UTC)" (scheduled at 2024-04-22 03:47:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:47:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:47:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:47:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:47:25,861 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:47:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:47:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:35.871852+00:00 (in 8.998302 seconds)
securityworker stdout | 2024-04-22 03:47:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:56 UTC)" (scheduled at 2024-04-22 03:47:26.873109+00:00)
securityworker stdout | 2024-04-22 03:47:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:47:26,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:47:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:47:26,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:47:26,876 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:47:26,876 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:47:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:47:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:47:26,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:47:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:47:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:47:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:47:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 42, 26, 880384), 1, 2])
securityworker stdout | 2024-04-22 03:47:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:47:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:47:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 42, 26, 880384), 1, 2])
securityworker stdout | 2024-04-22 03:47:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:47:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:47:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:47:26,900 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:47:26,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:47:26,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:47:26,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:47:26,901 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:47:26,901 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:47:26,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:47:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:47:27,316 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:47:29,250 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:47:29,255 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:47:29,777 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:47:29,785 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:47:29,789 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:47:29,794 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:47:29,796 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:47:30,291 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:47:30,652 [281] [DEBUG] [app] Starting request: urn:request:eacb7397-71f6-4b0c-acc1-aa1836c0356f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:47:30,652 [279] [DEBUG] [app] Starting request: urn:request:1d28384f-913a-4328-b620-eeec19a91ef4 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:47:30,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:47:30,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:47:30,656 [284] [DEBUG] [app] Starting request: urn:request:30130bc7-f11e-4efe-8098-abd6454093a8 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:47:30,656 [292] [DEBUG] [app] Starting request: urn:request:47fffd85-0d9c-45d6-bf81-b9c6c3c08362 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:47:30,656 [284] [DEBUG] [app] Ending request: urn:request:30130bc7-f11e-4efe-8098-abd6454093a8 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:30130bc7-f11e-4efe-8098-abd6454093a8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:47:30,656 [292] [DEBUG] [app] Ending request: urn:request:47fffd85-0d9c-45d6-bf81-b9c6c3c08362 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:47fffd85-0d9c-45d6-bf81-b9c6c3c08362', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:47:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:47:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:47:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:47:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:47:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:47:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:47:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:47:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:47:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:47:30,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:47:30,660 [281] [DEBUG] [app] Starting request: urn:request:ad7e8665-f317-4c7d-98ab-eee55d2c9c11 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:47:30,660 [281] [DEBUG] [app] Ending request: urn:request:ad7e8665-f317-4c7d-98ab-eee55d2c9c11 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:ad7e8665-f317-4c7d-98ab-eee55d2c9c11', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:47:30,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:47:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:47:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:47:30,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:47:30,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:47:30,661 [278] [DEBUG] [app] Starting request: urn:request:342be0fe-6521-4486-9151-2112526f8aff (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:47:30,662 [278] [DEBUG] [app] Ending request: urn:request:342be0fe-6521-4486-9151-2112526f8aff (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:342be0fe-6521-4486-9151-2112526f8aff', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:47:30,662 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:47:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:47:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:47:30,662 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:47:30,663 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:47:30,668 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:47:30,669 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:47:30,676 [281] [DEBUG] [app] Ending request: urn:request:eacb7397-71f6-4b0c-acc1-aa1836c0356f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:eacb7397-71f6-4b0c-acc1-aa1836c0356f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:47:30,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:47:30,676 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:47:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:47:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:47:30,678 [279] [DEBUG] [app] Ending request: urn:request:1d28384f-913a-4328-b620-eeec19a91ef4 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:1d28384f-913a-4328-b620-eeec19a91ef4', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:47:30,678 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:47:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
gunicorn-web stdout | 2024-04-22 03:47:30,678 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:47:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
notificationworker stdout | 2024-04-22 03:47:31,717 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:47:32,991 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:47:33,369 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:47:33,458 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:47:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:47:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:43.759375+00:00 (in 9.999453 seconds)
notificationworker stdout | 2024-04-22 03:47:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:47:43 UTC)" (scheduled at 2024-04-22 03:47:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:47:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:47:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 47, 33, 760256), True, datetime.datetime(2024, 4, 22, 3, 47, 33, 760256), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:47:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:47:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:47:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:47:43 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:47:34,394 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:47:34,397 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:47:34,401 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:47:34,541 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 03:47:35,712 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
securityworker stdout | 2024-04-22 03:47:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:47:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:56.873109+00:00 (in 21.000747 seconds)
securityworker stdout | 2024-04-22 03:47:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:05 UTC)" (scheduled at 2024-04-22 03:47:35.871852+00:00)
securityworker stdout | 2024-04-22 03:47:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:47:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:47:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:47:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:47:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:47:35,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:47:35,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:05 UTC)" executed successfully
autopruneworker stdout | 2024-04-22 03:47:35,902 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:47:36,056 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 03:47:36,894 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
namespacegcworker stdout | 2024-04-22 03:47:38,058 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:47:38,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:43.057186+00:00 (in 4.998026 seconds)
namespacegcworker stdout | 2024-04-22 03:47:38,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:52:38 UTC)" (scheduled at 2024-04-22 03:47:38.058708+00:00)
namespacegcworker stdout | 2024-04-22 03:47:38,060 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 47, 38, 59573), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 03:47:38,070 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 47, 38, 59573), True, datetime.datetime(2024, 4, 22, 3, 47, 38, 59573), 0, 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 03:47:38,073 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 47, 38, 59573), True, datetime.datetime(2024, 4, 22, 3, 47, 38, 59573), 0, 'namespacegc/%', False, datetime.datetime(2024, 4, 22, 3, 47, 38, 59573), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 03:47:38,076 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:47:38,076 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:52:38 UTC)" executed successfully
securityworker stdout | 2024-04-22 03:47:38,301 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:47:38,342 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 03:47:38,807 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 03:47:38,815 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
exportactionlogsworker stdout | 2024-04-22 03:47:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:47:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:41.564959+00:00 (in 1.997521 seconds)
exportactionlogsworker stdout | 2024-04-22 03:47:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:39 UTC)" (scheduled at 2024-04-22 03:47:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:47:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:47:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:47:40,015 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:47:40,618 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:47:40,623 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:47:40,634 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:47:40,636 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:47:40,639 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:47:40,645 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:47:40,650 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:47:40,653 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:47:40,655 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:47:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:47:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:11.264267+00:00 (in 29.999535 seconds)
autopruneworker stdout | 2024-04-22 03:47:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:11 UTC)" (scheduled at 2024-04-22 03:47:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:47:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757601271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:47:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:47:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:47:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:47:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:47:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:39.566970+00:00 (in 58.001535 seconds)
exportactionlogsworker stdout | 2024-04-22 03:47:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:41 UTC)" (scheduled at 2024-04-22 03:47:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:47:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:47:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 47, 41, 565686), True, datetime.datetime(2024, 4, 22, 3, 47, 41, 565686), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:47:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:47:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:47:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:47:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:47:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:22.058978+00:00 (in 39.001107 seconds)
namespacegcworker stdout | 2024-04-22 03:47:43,058 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:43 UTC)" (scheduled at 2024-04-22 03:47:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:47:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:47:43,059 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 47, 43, 58384), True, datetime.datetime(2024, 4, 22, 3, 47, 43, 58384), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:47:43,070 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:47:43,070 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:47:43,070 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:48:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:47:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:47:43,760 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:47:53.759375+00:00 (in 9.999388 seconds)
notificationworker stdout | 2024-04-22 03:47:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:47:53 UTC)" (scheduled at 2024-04-22 03:47:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:47:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:47:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 47, 43, 760312), True, datetime.datetime(2024, 4, 22, 3, 47, 43, 760312), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:47:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:47:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:47:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:47:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:47:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:47:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:14.952062+00:00 (in 29.999531 seconds)
gcworker stdout | 2024-04-22 03:47:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:14 UTC)" (scheduled at 2024-04-22 03:47:44.952062+00:00)
gcworker stdout | 2024-04-22 03:47:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548064952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:47:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:47:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:47:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:47:45,653 [281] [DEBUG] [app] Starting request: urn:request:f0380549-dbab-43ef-8137-8cc7a17d96af (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:47:45,653 [279] [DEBUG] [app] Starting request: urn:request:601c04e0-5c0f-43ca-bcd5-c75961e96399 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:47:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:47:45,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:47:45,656 [284] [DEBUG] [app] Starting request: urn:request:d825c688-f3fc-488c-b1fd-e0b08b2c4cfe (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:47:45,656 [292] [DEBUG] [app] Starting request: urn:request:eb97abd2-6ad0-4f44-8ba3-77b07b19d284 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:47:45,657 [284] [DEBUG] [app] Ending request: urn:request:d825c688-f3fc-488c-b1fd-e0b08b2c4cfe (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:d825c688-f3fc-488c-b1fd-e0b08b2c4cfe', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:47:45,657 [292] [DEBUG] [app] Ending request: urn:request:eb97abd2-6ad0-4f44-8ba3-77b07b19d284 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:eb97abd2-6ad0-4f44-8ba3-77b07b19d284', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:47:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:47:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:47:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:47:45,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:47:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:47:45,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:47:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
gunicorn-web stdout | 2024-04-22 03:47:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:47:45,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:47:45,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:47:45,660 [279] [DEBUG] [app] Starting request: urn:request:46b0fccd-d653-496b-8631-448a9895254c (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:47:45,660 [279] [DEBUG] [app] Ending request: urn:request:46b0fccd-d653-496b-8631-448a9895254c (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:46b0fccd-d653-496b-8631-448a9895254c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:47:45,661 [278] [DEBUG] [app] Starting request: urn:request:43b3faae-a950-40f2-b58c-a7ff03f1042f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:47:45,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:47:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:47:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.001)
gunicorn-web stdout | 2024-04-22 03:47:45,661 [278] [DEBUG] [app] Ending request: urn:request:43b3faae-a950-40f2-b58c-a7ff03f1042f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:43b3faae-a950-40f2-b58c-a7ff03f1042f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:47:45,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:47:45,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:47:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:47:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:47:45,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:47:45,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:47:45,662 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:47:45,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:47:45,668 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:47:45,676 [279] [DEBUG] [app] Ending request: urn:request:601c04e0-5c0f-43ca-bcd5-c75961e96399 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:601c04e0-5c0f-43ca-bcd5-c75961e96399', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:47:45,676 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:47:45,676 [281] [DEBUG] [app] Ending request: urn:request:f0380549-dbab-43ef-8137-8cc7a17d96af (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f0380549-dbab-43ef-8137-8cc7a17d96af', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:47:45,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:47:45,676 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:47:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:47:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:47:45,677 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:47:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:47:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
buildlogsarchiver stdout | 2024-04-22 03:47:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:47:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:17.052354+00:00 (in 29.999494 seconds)
buildlogsarchiver stdout | 2024-04-22 03:47:47,052 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:17 UTC)" (scheduled at 2024-04-22 03:47:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:47:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 47, 47, 53066), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:47:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:47:47,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:47:47,063 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:47:49,189 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:47:50,677 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:47:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:47:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:03.759375+00:00 (in 9.999444 seconds)
notificationworker stdout | 2024-04-22 03:47:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:48:03 UTC)" (scheduled at 2024-04-22 03:47:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:47:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:47:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 47, 53, 760403), True, datetime.datetime(2024, 4, 22, 3, 47, 53, 760403), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:47:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:47:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:47:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:48:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:47:54,279 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:47:55,898 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:47:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:47:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:05.871852+00:00 (in 8.998268 seconds)
securityworker stdout | 2024-04-22 03:47:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:26 UTC)" (scheduled at 2024-04-22 03:47:56.873109+00:00)
securityworker stdout | 2024-04-22 03:47:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:47:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:47:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:47:56,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:47:56,876 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:47:56,876 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:47:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:47:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:47:56,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:47:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:47:56,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:47:56,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:47:56,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 42, 56, 880378), 1, 2])
securityworker stdout | 2024-04-22 03:47:56,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:47:56,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:47:56,898 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 42, 56, 880378), 1, 2])
securityworker stdout | 2024-04-22 03:47:56,900 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:47:56,900 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:47:56,900 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:47:56,900 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:47:56,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:47:56,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:47:56,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:47:56,901 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:47:56,901 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:47:56,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:47:57,352 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:47:59,286 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:47:59,291 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:47:59,785 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:47:59,794 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:47:59,797 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:47:59,803 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:47:59,805 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:48:00,329 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:48:00,653 [282] [DEBUG] [app] Starting request: urn:request:5eddfe73-dcc4-4c5e-8b16-60ee886eff7c (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:48:00,653 [281] [DEBUG] [app] Starting request: urn:request:5e852d95-0bb4-4632-8061-3a79e50a076a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:48:00,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:48:00,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:48:00,657 [284] [DEBUG] [app] Starting request: urn:request:b1b61d9c-87f1-4091-a5a8-2135e415e987 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:48:00,657 [291] [DEBUG] [app] Starting request: urn:request:0d4143e7-6ca7-4654-aeb6-d1b01ac3db82 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:48:00,657 [284] [DEBUG] [app] Ending request: urn:request:b1b61d9c-87f1-4091-a5a8-2135e415e987 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b1b61d9c-87f1-4091-a5a8-2135e415e987', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:48:00,657 [291] [DEBUG] [app] Ending request: urn:request:0d4143e7-6ca7-4654-aeb6-d1b01ac3db82 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:0d4143e7-6ca7-4654-aeb6-d1b01ac3db82', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:48:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:48:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:48:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:48:00,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:48:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:48:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:48:00,658 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:48:00,658 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:48:00,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:48:00,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:48:00,661 [278] [DEBUG] [app] Starting request: urn:request:157d4714-f1a4-4284-bf30-a884014df3b6 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:48:00,661 [281] [DEBUG] [app] Starting request: urn:request:d205c99b-8aa5-40ed-b085-8e68e1513869 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:48:00,661 [278] [DEBUG] [app] Ending request: urn:request:157d4714-f1a4-4284-bf30-a884014df3b6 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:157d4714-f1a4-4284-bf30-a884014df3b6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:48:00,661 [281] [DEBUG] [app] Ending request: urn:request:d205c99b-8aa5-40ed-b085-8e68e1513869 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d205c99b-8aa5-40ed-b085-8e68e1513869', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:48:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:48:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:48:00,662 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:48:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:48:00,662 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:48:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:48:00,662 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:48:00,662 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:48:00,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:48:00,662 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:48:00,669 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:48:00,669 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:48:00,677 [282] [DEBUG] [app] Ending request: urn:request:5eddfe73-dcc4-4c5e-8b16-60ee886eff7c (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:5eddfe73-dcc4-4c5e-8b16-60ee886eff7c', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:48:00,677 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:48:00,678 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:48:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:48:00,678 [281] [DEBUG] [app] Ending request: urn:request:5e852d95-0bb4-4632-8061-3a79e50a076a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:5e852d95-0bb4-4632-8061-3a79e50a076a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:48:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
gunicorn-web stdout | 2024-04-22 03:48:00,678 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:48:00,678 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:48:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:48:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
notificationworker stdout | 2024-04-22 03:48:01,752 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:48:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:48:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:16.552337+00:00 (in 13.995636 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:48:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:02 UTC)" (scheduled at 2024-04-22 03:48:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:48:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:48:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:48:03,027 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:48:03,405 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:48:03,495 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:48:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:48:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:13.759375+00:00 (in 9.999435 seconds)
notificationworker stdout | 2024-04-22 03:48:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:48:13 UTC)" (scheduled at 2024-04-22 03:48:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:48:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:48:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 48, 3, 760232), True, datetime.datetime(2024, 4, 22, 3, 48, 3, 760232), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:48:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:48:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:48:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:48:13 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:48:04,403 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:48:04,409 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:48:04,411 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:48:04,578 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 03:48:05,748 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
securityworker stdout | 2024-04-22 03:48:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:48:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:26.873109+00:00 (in 21.000782 seconds)
securityworker stdout | 2024-04-22 03:48:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:35 UTC)" (scheduled at 2024-04-22 03:48:05.871852+00:00)
securityworker stdout | 2024-04-22 03:48:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:48:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:48:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:48:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:48:05,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:48:05,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:48:05,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:35 UTC)" executed successfully
autopruneworker stdout | 2024-04-22 03:48:05,938 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:48:06,064 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
repositorygcworker stdout | 2024-04-22 03:48:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:48:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:13.555667+00:00 (in 7.002705 seconds)
repositorygcworker stdout | 2024-04-22 03:48:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:06 UTC)" (scheduled at 2024-04-22 03:48:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:48:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:48:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 48, 6, 553370), True, datetime.datetime(2024, 4, 22, 3, 48, 6, 553370), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:48:06,565 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:48:06,565 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:48:06,565 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:06 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:48:06,931 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:48:08,339 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:48:08,378 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:48:08,822 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:48:08,844 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
storagereplication stdout | 2024-04-22 03:48:10,051 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:48:10,628 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:48:10,636 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:48:10,643 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:48:10,646 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:48:10,649 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:48:10,653 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:48:10,660 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:48:10,662 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:48:10,665 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:48:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:48:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:41.264267+00:00 (in 29.999452 seconds)
autopruneworker stdout | 2024-04-22 03:48:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:41 UTC)" (scheduled at 2024-04-22 03:48:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:48:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757631271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:48:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:48:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:48:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:48:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:48:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:06.552482+00:00 (in 52.996350 seconds)
repositorygcworker stdout | 2024-04-22 03:48:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:13 UTC)" (scheduled at 2024-04-22 03:48:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:48:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:48:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:48:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:48:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:19.762160+00:00 (in 6.002295 seconds)
notificationworker stdout | 2024-04-22 03:48:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:48:23 UTC)" (scheduled at 2024-04-22 03:48:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:48:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:48:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 48, 13, 760265), True, datetime.datetime(2024, 4, 22, 3, 48, 13, 760265), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:48:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:48:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:48:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:48:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:48:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:48:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:44.952062+00:00 (in 29.999477 seconds)
gcworker stdout | 2024-04-22 03:48:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:44 UTC)" (scheduled at 2024-04-22 03:48:14.952062+00:00)
gcworker stdout | 2024-04-22 03:48:14,954 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548094953, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:48:14,966 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:48:14,966 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:48:14,966 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:48:15,653 [278] [DEBUG] [app] Starting request: urn:request:2e250ffd-4434-4cc1-8b5c-aed77f540f04 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:48:15,653 [282] [DEBUG] [app] Starting request: urn:request:f2034f7d-59b2-41b4-89c0-5b77327d0c40 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:48:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:48:15,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:48:15,656 [291] [DEBUG] [app] Starting request: urn:request:c2e7a474-fa38-42b5-979c-1b4803b29625 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:48:15,656 [291] [DEBUG] [app] Ending request: urn:request:c2e7a474-fa38-42b5-979c-1b4803b29625 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:c2e7a474-fa38-42b5-979c-1b4803b29625', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:48:15,656 [284] [DEBUG] [app] Starting request: urn:request:f50c07a4-5dfb-48e5-bca7-72c03cf1b949 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:48:15,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:48:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:48:15,657 [284] [DEBUG] [app] Ending request: urn:request:f50c07a4-5dfb-48e5-bca7-72c03cf1b949 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f50c07a4-5dfb-48e5-bca7-72c03cf1b949', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:48:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:48:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:48:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:48:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:48:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:48:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:48:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:48:15,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:48:15,660 [281] [DEBUG] [app] Starting request: urn:request:d31d1a81-a89e-4e5b-bd7e-541f90c2e3f7 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:48:15,660 [281] [DEBUG] [app] Ending request: urn:request:d31d1a81-a89e-4e5b-bd7e-541f90c2e3f7 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d31d1a81-a89e-4e5b-bd7e-541f90c2e3f7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:48:15,660 [278] [DEBUG] [app] Starting request: urn:request:34a2aedf-bb2f-4a8a-9b47-43a530f61621 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:48:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:48:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:48:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:48:15,660 [278] [DEBUG] [app] Ending request: urn:request:34a2aedf-bb2f-4a8a-9b47-43a530f61621 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:34a2aedf-bb2f-4a8a-9b47-43a530f61621', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:48:15,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:48:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:48:15,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:48:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.000)
gunicorn-web stdout | 2024-04-22 03:48:15,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:48:15,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:48:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:48:15,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:48:15,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:48:15,676 [282] [DEBUG] [app] Ending request: urn:request:f2034f7d-59b2-41b4-89c0-5b77327d0c40 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f2034f7d-59b2-41b4-89c0-5b77327d0c40', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:48:15,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:48:15,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:48:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:48:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:48:15,676 [278] [DEBUG] [app] Ending request: urn:request:2e250ffd-4434-4cc1-8b5c-aed77f540f04 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2e250ffd-4434-4cc1-8b5c-aed77f540f04', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:48:15,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:48:15,677 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:48:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:48:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
securityscanningnotificationworker stdout | 2024-04-22 03:48:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:48:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:02.556208+00:00 (in 46.003311 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:48:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:16 UTC)" (scheduled at 2024-04-22 03:48:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:48:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:48:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 48, 16, 553370), True, datetime.datetime(2024, 4, 22, 3, 48, 16, 553370), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:48:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:48:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:48:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:48:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:48:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:47.052354+00:00 (in 29.999497 seconds)
buildlogsarchiver stdout | 2024-04-22 03:48:17,052 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:47 UTC)" (scheduled at 2024-04-22 03:48:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:48:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 48, 17, 53052), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:48:17,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:48:17,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:48:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:48:19,225 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:48:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:48:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:23.759375+00:00 (in 3.996650 seconds)
notificationworker stdout | 2024-04-22 03:48:19,762 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:53:19 UTC)" (scheduled at 2024-04-22 03:48:19.762160+00:00)
notificationworker stdout | 2024-04-22 03:48:19,763 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 48, 19, 763051), 'notification/%'])
notificationworker stdout | 2024-04-22 03:48:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:19 UTC)" (scheduled at 2024-04-22 03:48:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:48:19,764 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:48:19,764 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:19 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:48:19,773 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 48, 19, 763051), True, datetime.datetime(2024, 4, 22, 3, 48, 19, 763051), 0, 'notification/%'])
notificationworker stdout | 2024-04-22 03:48:19,776 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 48, 19, 763051), True, datetime.datetime(2024, 4, 22, 3, 48, 19, 763051), 0, 'notification/%', False, datetime.datetime(2024, 4, 22, 3, 48, 19, 763051), 'notification/%'])
notificationworker stdout | 2024-04-22 03:48:19,778 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:48:19,778 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:53:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:48:20,712 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:48:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:48:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:43.057186+00:00 (in 20.997620 seconds)
namespacegcworker stdout | 2024-04-22 03:48:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:22 UTC)" (scheduled at 2024-04-22 03:48:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:48:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:48:22,060 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:48:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:48:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:33.759375+00:00 (in 9.999419 seconds)
notificationworker stdout | 2024-04-22 03:48:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:48:33 UTC)" (scheduled at 2024-04-22 03:48:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:48:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:48:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 48, 23, 760429), True, datetime.datetime(2024, 4, 22, 3, 48, 23, 760429), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:48:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:48:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:48:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:48:33 UTC)" executed successfully
builder stdout | 2024-04-22 03:48:24,304 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
quotaregistrysizeworker stdout | 2024-04-22 03:48:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:48:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:24.361582+00:00 (in 59.999476 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:48:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:24 UTC)" (scheduled at 2024-04-22 03:48:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:48:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:48:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:48:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:48:25,934 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:48:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:48:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:35.871852+00:00 (in 8.998263 seconds)
securityworker stdout | 2024-04-22 03:48:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:56 UTC)" (scheduled at 2024-04-22 03:48:26.873109+00:00)
securityworker stdout | 2024-04-22 03:48:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:48:26,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:48:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:48:26,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:48:26,876 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:48:26,876 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:48:26,876 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:48:26,878 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:48:26,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:48:26,889 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:48:26,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:48:26,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:48:26,892 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 43, 26, 880028), 1, 2])
securityworker stdout | 2024-04-22 03:48:26,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:48:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:48:26,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 43, 26, 880028), 1, 2])
securityworker stdout | 2024-04-22 03:48:26,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:48:26,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:48:26,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:48:26,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:48:26,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:48:26,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:48:26,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:48:26,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:48:26,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:48:26,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:48:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:48:27,388 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:48:29,299 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:48:29,312 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:48:29,793 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:48:29,800 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:48:29,803 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:48:29,810 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:48:29,813 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:48:30,364 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:48:30,653 [278] [DEBUG] [app] Starting request: urn:request:db7a7abc-35d1-4881-9b91-98744d15c049 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:48:30,653 [282] [DEBUG] [app] Starting request: urn:request:924dd61e-0380-47eb-8231-440582a28195 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:48:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:48:30,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:48:30,656 [284] [DEBUG] [app] Starting request: urn:request:92de5366-3a58-4e1e-a50f-9893eb86a011 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:48:30,656 [290] [DEBUG] [app] Starting request: urn:request:87464076-8883-49d6-b3f4-8d428dc89111 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:48:30,657 [284] [DEBUG] [app] Ending request: urn:request:92de5366-3a58-4e1e-a50f-9893eb86a011 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:92de5366-3a58-4e1e-a50f-9893eb86a011', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:48:30,657 [290] [DEBUG] [app] Ending request: urn:request:87464076-8883-49d6-b3f4-8d428dc89111 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:87464076-8883-49d6-b3f4-8d428dc89111', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:48:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:48:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:48:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:48:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:48:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:48:30,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:48:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:48:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:48:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:48:30,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:48:30,659 [278] [DEBUG] [app] Starting request: urn:request:e80e4460-8dff-4507-ac5e-2bda96df3fa7 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:48:30,660 [278] [DEBUG] [app] Ending request: urn:request:e80e4460-8dff-4507-ac5e-2bda96df3fa7 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e80e4460-8dff-4507-ac5e-2bda96df3fa7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:48:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:48:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:48:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:48:30,660 [281] [DEBUG] [app] Starting request: urn:request:b7cc773a-1c23-4ccb-9356-7d5e3fa52052 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:48:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:48:30,660 [281] [DEBUG] [app] Ending request: urn:request:b7cc773a-1c23-4ccb-9356-7d5e3fa52052 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b7cc773a-1c23-4ccb-9356-7d5e3fa52052', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:48:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 03:48:30,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:48:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:48:30,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:48:30,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:48:30,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:48:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:48:30,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:48:30,675 [278] [DEBUG] [app] Ending request: urn:request:db7a7abc-35d1-4881-9b91-98744d15c049 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:db7a7abc-35d1-4881-9b91-98744d15c049', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:48:30,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:48:30,675 [282] [DEBUG] [app] Ending request: urn:request:924dd61e-0380-47eb-8231-440582a28195 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:924dd61e-0380-47eb-8231-440582a28195', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:48:30,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:48:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:48:30,675 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:48:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:48:30,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:48:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:48:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
notificationworker stdout | 2024-04-22 03:48:31,788 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:48:33,034 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:48:33,441 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:48:33,531 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:48:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:48:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:43.759375+00:00 (in 9.999541 seconds)
notificationworker stdout | 2024-04-22 03:48:33,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:48:43 UTC)" (scheduled at 2024-04-22 03:48:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:48:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:48:33,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 48, 33, 760130), True, datetime.datetime(2024, 4, 22, 3, 48, 33, 760130), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:48:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:48:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:48:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:48:43 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:48:34,411 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:48:34,415 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:48:34,419 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:48:34,585 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 03:48:35,785 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
securityworker stdout | 2024-04-22 03:48:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:48:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:56.873109+00:00 (in 21.000716 seconds)
securityworker stdout | 2024-04-22 03:48:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:05 UTC)" (scheduled at 2024-04-22 03:48:35.871852+00:00)
securityworker stdout | 2024-04-22 03:48:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:48:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:48:35,874 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:48:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:48:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:48:35,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:48:35,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:05 UTC)" executed successfully
autopruneworker stdout | 2024-04-22 03:48:35,975 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:48:36,079 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 03:48:36,967 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:48:38,364 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:48:38,416 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:48:38,839 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:48:38,880 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
exportactionlogsworker stdout | 2024-04-22 03:48:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:48:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:41.564959+00:00 (in 1.997446 seconds)
exportactionlogsworker stdout | 2024-04-22 03:48:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:39 UTC)" (scheduled at 2024-04-22 03:48:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:48:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:48:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:48:40,087 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:48:40,639 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:48:40,649 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:48:40,652 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:48:40,656 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:48:40,659 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:48:40,663 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:48:40,670 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:48:40,672 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:48:40,676 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:48:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:48:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:11.264267+00:00 (in 29.999551 seconds)
autopruneworker stdout | 2024-04-22 03:48:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:11 UTC)" (scheduled at 2024-04-22 03:48:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:48:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757661271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:48:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:48:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:48:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:48:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:48:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:39.566970+00:00 (in 58.001516 seconds)
exportactionlogsworker stdout | 2024-04-22 03:48:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:41 UTC)" (scheduled at 2024-04-22 03:48:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:48:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:48:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 48, 41, 565741), True, datetime.datetime(2024, 4, 22, 3, 48, 41, 565741), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:48:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:48:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:48:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:48:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:48:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:22.058978+00:00 (in 39.001298 seconds)
namespacegcworker stdout | 2024-04-22 03:48:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:43 UTC)" (scheduled at 2024-04-22 03:48:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:48:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:48:43,059 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 48, 43, 58132), True, datetime.datetime(2024, 4, 22, 3, 48, 43, 58132), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:48:43,070 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:48:43,070 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:48:43,070 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:49:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:48:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:48:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:48:53.759375+00:00 (in 9.999528 seconds)
notificationworker stdout | 2024-04-22 03:48:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:48:53 UTC)" (scheduled at 2024-04-22 03:48:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:48:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:48:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 48, 43, 760258), True, datetime.datetime(2024, 4, 22, 3, 48, 43, 760258), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:48:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:48:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:48:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:48:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:48:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:48:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:14.952062+00:00 (in 29.999516 seconds)
gcworker stdout | 2024-04-22 03:48:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:14 UTC)" (scheduled at 2024-04-22 03:48:44.952062+00:00)
gcworker stdout | 2024-04-22 03:48:44,954 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548124953, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:48:44,966 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:48:44,966 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:48:44,966 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:48:45,653 [279] [DEBUG] [app] Starting request: urn:request:8d5b8629-1248-415f-8f2c-b87dd743b3bd (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:48:45,653 [281] [DEBUG] [app] Starting request: urn:request:b5778622-20dc-462e-8206-9b344c94f345 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:48:45,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:48:45,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:48:45,657 [286] [DEBUG] [app] Starting request: urn:request:7e77e19d-6f7b-4194-9d82-33cc75c4eac8 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:48:45,657 [292] [DEBUG] [app] Starting request: urn:request:31832175-27fb-45e1-aa1c-c94e1901a379 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:48:45,657 [292] [DEBUG] [app] Ending request: urn:request:31832175-27fb-45e1-aa1c-c94e1901a379 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:31832175-27fb-45e1-aa1c-c94e1901a379', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:48:45,657 [286] [DEBUG] [app] Ending request: urn:request:7e77e19d-6f7b-4194-9d82-33cc75c4eac8 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7e77e19d-6f7b-4194-9d82-33cc75c4eac8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:48:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:48:45,658 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:48:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:48:45,658 [286] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:48:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:48:45,658 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:48:45,658 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:48:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:48:45,660 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:48:45,660 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:48:45,661 [278] [DEBUG] [app] Starting request: urn:request:757f6b9e-0e8c-4d99-a349-617ccb45c5e3 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:48:45,661 [282] [DEBUG] [app] Starting request: urn:request:107e6f28-7619-410c-afb6-cd69bce7309d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:48:45,662 [278] [DEBUG] [app] Ending request: urn:request:757f6b9e-0e8c-4d99-a349-617ccb45c5e3 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:757f6b9e-0e8c-4d99-a349-617ccb45c5e3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:48:45,662 [282] [DEBUG] [app] Ending request: urn:request:107e6f28-7619-410c-afb6-cd69bce7309d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:107e6f28-7619-410c-afb6-cd69bce7309d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:48:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:48:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:48:45,662 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:48:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:48:45,662 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:48:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:48:45,662 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:48:45,662 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:48:45,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:48:45,662 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:48:45,669 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:48:45,669 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:48:45,677 [281] [DEBUG] [app] Ending request: urn:request:b5778622-20dc-462e-8206-9b344c94f345 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b5778622-20dc-462e-8206-9b344c94f345', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:48:45,678 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:48:45,678 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:48:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:48:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
gunicorn-web stdout | 2024-04-22 03:48:45,678 [279] [DEBUG] [app] Ending request: urn:request:8d5b8629-1248-415f-8f2c-b87dd743b3bd (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:8d5b8629-1248-415f-8f2c-b87dd743b3bd', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:48:45,678 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:48:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.027 118 0.027)
gunicorn-web stdout | 2024-04-22 03:48:45,679 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:48:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
buildlogsarchiver stdout | 2024-04-22 03:48:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:48:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:17.052354+00:00 (in 29.999456 seconds)
buildlogsarchiver stdout | 2024-04-22 03:48:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:17 UTC)" (scheduled at 2024-04-22 03:48:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:48:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 48, 47, 53133), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:48:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:48:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:48:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:48:49,257 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:48:50,748 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:48:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:48:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:03.759375+00:00 (in 9.999458 seconds)
notificationworker stdout | 2024-04-22 03:48:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:49:03 UTC)" (scheduled at 2024-04-22 03:48:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:48:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:48:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 48, 53, 760213), True, datetime.datetime(2024, 4, 22, 3, 48, 53, 760213), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:48:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:48:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:48:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:49:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:48:54,311 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:48:55,950 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:48:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:48:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:05.871852+00:00 (in 8.998288 seconds)
securityworker stdout | 2024-04-22 03:48:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:26 UTC)" (scheduled at 2024-04-22 03:48:56.873109+00:00)
securityworker stdout | 2024-04-22 03:48:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:48:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:48:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:48:56,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:48:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:48:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:48:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:48:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:48:56,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:48:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:48:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:48:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:48:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 43, 56, 880593), 1, 2])
securityworker stdout | 2024-04-22 03:48:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:48:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:48:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 43, 56, 880593), 1, 2])
securityworker stdout | 2024-04-22 03:48:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:48:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:48:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:48:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:48:56,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:48:56,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:48:56,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:48:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:48:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:48:56,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:48:57,405 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:48:59,316 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:48:59,347 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:48:59,801 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:48:59,807 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:48:59,811 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:48:59,817 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:48:59,820 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:49:00,401 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:49:00,653 [281] [DEBUG] [app] Starting request: urn:request:38339b4c-8b07-4c5d-9922-cf08de3e06e9 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:49:00,653 [282] [DEBUG] [app] Starting request: urn:request:207f9218-72b6-420b-9b8e-e4b0926a395a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:49:00,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:49:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:49:00,656 [284] [DEBUG] [app] Starting request: urn:request:5395776f-0e2c-45d1-a4a7-74719bd273e8 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:49:00,656 [292] [DEBUG] [app] Starting request: urn:request:416aa7d2-d467-426d-9723-84e265f97fa6 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:49:00,656 [284] [DEBUG] [app] Ending request: urn:request:5395776f-0e2c-45d1-a4a7-74719bd273e8 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5395776f-0e2c-45d1-a4a7-74719bd273e8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:49:00,656 [292] [DEBUG] [app] Ending request: urn:request:416aa7d2-d467-426d-9723-84e265f97fa6 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:416aa7d2-d467-426d-9723-84e265f97fa6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:49:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:49:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:49:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:49:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:49:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:49:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:49:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:49:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:49:00,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:49:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:49:00,659 [281] [DEBUG] [app] Starting request: urn:request:0ab07063-7e78-4dcf-a3de-0314d37027cb (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:49:00,659 [281] [DEBUG] [app] Ending request: urn:request:0ab07063-7e78-4dcf-a3de-0314d37027cb (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:0ab07063-7e78-4dcf-a3de-0314d37027cb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:49:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:49:00,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:49:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:49:00,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:49:00,660 [279] [DEBUG] [app] Starting request: urn:request:8e457120-6576-42ab-ab20-6b50ab22c328 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:49:00,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:49:00,660 [279] [DEBUG] [app] Ending request: urn:request:8e457120-6576-42ab-ab20-6b50ab22c328 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:8e457120-6576-42ab-ab20-6b50ab22c328', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:49:00,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:49:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:49:00,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:49:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:49:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:49:00,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:49:00,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:49:00,675 [281] [DEBUG] [app] Ending request: urn:request:38339b4c-8b07-4c5d-9922-cf08de3e06e9 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:38339b4c-8b07-4c5d-9922-cf08de3e06e9', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:49:00,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:49:00,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:49:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:49:00,675 [282] [DEBUG] [app] Ending request: urn:request:207f9218-72b6-420b-9b8e-e4b0926a395a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:207f9218-72b6-420b-9b8e-e4b0926a395a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:49:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:49:00,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:49:00,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:49:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:49:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
notificationworker stdout | 2024-04-22 03:49:01,809 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:49:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:49:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:16.552337+00:00 (in 13.995534 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:49:02,557 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:02 UTC)" (scheduled at 2024-04-22 03:49:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:49:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:49:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:49:03,055 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:49:03,466 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:49:03,568 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:49:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:49:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:13.759375+00:00 (in 9.999430 seconds)
notificationworker stdout | 2024-04-22 03:49:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:49:13 UTC)" (scheduled at 2024-04-22 03:49:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:49:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:49:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 49, 3, 760393), True, datetime.datetime(2024, 4, 22, 3, 49, 3, 760393), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:49:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:49:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:49:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:49:13 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:49:04,419 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:49:04,424 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:49:04,426 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:49:04,614 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 03:49:05,807 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
securityworker stdout | 2024-04-22 03:49:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:49:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:26.873109+00:00 (in 21.000739 seconds)
securityworker stdout | 2024-04-22 03:49:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:35 UTC)" (scheduled at 2024-04-22 03:49:05.871852+00:00)
securityworker stdout | 2024-04-22 03:49:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:49:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:49:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:49:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:49:05,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:49:05,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:49:05,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:35 UTC)" executed successfully
autopruneworker stdout | 2024-04-22 03:49:06,012 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:49:06,113 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
repositorygcworker stdout | 2024-04-22 03:49:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:49:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:13.555667+00:00 (in 7.002654 seconds)
repositorygcworker stdout | 2024-04-22 03:49:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:06 UTC)" (scheduled at 2024-04-22 03:49:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:49:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:49:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 49, 6, 553398), True, datetime.datetime(2024, 4, 22, 3, 49, 6, 553398), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:49:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:49:06,565 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:49:06,565 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:06 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:49:07,004 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:49:08,400 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:49:08,451 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:49:08,848 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:49:08,888 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
storagereplication stdout | 2024-04-22 03:49:10,115 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:49:10,647 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:49:10,660 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:49:10,662 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:49:10,666 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:49:10,668 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:49:10,672 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:49:10,679 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:49:10,682 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:49:10,684 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:49:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:49:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:41.264267+00:00 (in 29.999464 seconds)
autopruneworker stdout | 2024-04-22 03:49:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:41 UTC)" (scheduled at 2024-04-22 03:49:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:49:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757691271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:49:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:49:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:49:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:49:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:49:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:06.552482+00:00 (in 52.996331 seconds)
repositorygcworker stdout | 2024-04-22 03:49:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:13 UTC)" (scheduled at 2024-04-22 03:49:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:49:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:49:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:49:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:49:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:19.762424+00:00 (in 6.002562 seconds)
notificationworker stdout | 2024-04-22 03:49:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:49:23 UTC)" (scheduled at 2024-04-22 03:49:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:49:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:49:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 49, 13, 760155), True, datetime.datetime(2024, 4, 22, 3, 49, 13, 760155), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:49:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:49:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:49:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:49:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:49:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:49:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:44.952062+00:00 (in 29.999524 seconds)
gcworker stdout | 2024-04-22 03:49:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:44 UTC)" (scheduled at 2024-04-22 03:49:14.952062+00:00)
gcworker stdout | 2024-04-22 03:49:14,954 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548154952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:49:14,967 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:49:14,967 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:49:14,967 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:49:15,653 [279] [DEBUG] [app] Starting request: urn:request:1888070c-231f-4cdb-88d7-fb8d7182f1b4 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:49:15,653 [282] [DEBUG] [app] Starting request: urn:request:4099abb7-f022-4e9d-9358-b7831b96243f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:49:15,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:49:15,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:49:15,657 [284] [DEBUG] [app] Starting request: urn:request:eb3c2c04-d815-46f8-af07-767c6162ac08 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:49:15,657 [290] [DEBUG] [app] Starting request: urn:request:4d285cfe-0b92-49d4-aa7a-38e937a96ae1 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:49:15,657 [284] [DEBUG] [app] Ending request: urn:request:eb3c2c04-d815-46f8-af07-767c6162ac08 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:eb3c2c04-d815-46f8-af07-767c6162ac08', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:49:15,658 [290] [DEBUG] [app] Ending request: urn:request:4d285cfe-0b92-49d4-aa7a-38e937a96ae1 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:4d285cfe-0b92-49d4-aa7a-38e937a96ae1', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:49:15,658 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:49:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:49:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:49:15,658 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 03:49:15,658 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:49:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:49:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
gunicorn-web stdout | 2024-04-22 03:49:15,658 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:49:15,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:49:15,660 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:49:15,660 [281] [DEBUG] [app] Starting request: urn:request:0be07f4d-d569-4ad7-83ac-ed92ea221fdb (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:49:15,661 [282] [DEBUG] [app] Starting request: urn:request:7cdb4250-bee7-4bb2-94a7-5ec84f81753e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:49:15,661 [281] [DEBUG] [app] Ending request: urn:request:0be07f4d-d569-4ad7-83ac-ed92ea221fdb (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:0be07f4d-d569-4ad7-83ac-ed92ea221fdb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:49:15,661 [282] [DEBUG] [app] Ending request: urn:request:7cdb4250-bee7-4bb2-94a7-5ec84f81753e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:7cdb4250-bee7-4bb2-94a7-5ec84f81753e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:49:15,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:49:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:49:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:49:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:49:15,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:49:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:49:15,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:49:15,662 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:49:15,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:49:15,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:49:15,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:49:15,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:49:15,676 [282] [DEBUG] [app] Ending request: urn:request:4099abb7-f022-4e9d-9358-b7831b96243f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:4099abb7-f022-4e9d-9358-b7831b96243f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:49:15,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:49:15,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:49:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:49:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:49:15,677 [279] [DEBUG] [app] Ending request: urn:request:1888070c-231f-4cdb-88d7-fb8d7182f1b4 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:1888070c-231f-4cdb-88d7-fb8d7182f1b4', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:49:15,677 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:49:15,677 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:49:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:49:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
securityscanningnotificationworker stdout | 2024-04-22 03:49:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:49:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:02.556208+00:00 (in 46.003317 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:49:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:16 UTC)" (scheduled at 2024-04-22 03:49:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:49:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:49:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 49, 16, 553315), True, datetime.datetime(2024, 4, 22, 3, 49, 16, 553315), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:49:16,565 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:49:16,565 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:49:16,565 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:49:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:49:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:47.052354+00:00 (in 29.999510 seconds)
buildlogsarchiver stdout | 2024-04-22 03:49:17,052 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:47 UTC)" (scheduled at 2024-04-22 03:49:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:49:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 49, 17, 53036), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:49:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:49:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:49:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:49:19,294 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:49:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:49:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:23.759375+00:00 (in 3.996427 seconds)
notificationworker stdout | 2024-04-22 03:49:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:19 UTC)" (scheduled at 2024-04-22 03:49:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:49:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:49:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:49:20,785 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:49:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:49:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:43.057186+00:00 (in 20.997686 seconds)
namespacegcworker stdout | 2024-04-22 03:49:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:22 UTC)" (scheduled at 2024-04-22 03:49:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:49:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:49:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:49:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:49:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:33.759375+00:00 (in 9.999460 seconds)
notificationworker stdout | 2024-04-22 03:49:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:49:33 UTC)" (scheduled at 2024-04-22 03:49:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:49:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:49:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 49, 23, 760344), True, datetime.datetime(2024, 4, 22, 3, 49, 23, 760344), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:49:23,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:49:23,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:49:23,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:49:33 UTC)" executed successfully
builder stdout | 2024-04-22 03:49:24,337 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
quotaregistrysizeworker stdout | 2024-04-22 03:49:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:49:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:24.361582+00:00 (in 59.999504 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:49:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:24 UTC)" (scheduled at 2024-04-22 03:49:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:49:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:49:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:49:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:49:25,986 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:49:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:49:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:35.871852+00:00 (in 8.998275 seconds)
securityworker stdout | 2024-04-22 03:49:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:56 UTC)" (scheduled at 2024-04-22 03:49:26.873109+00:00)
securityworker stdout | 2024-04-22 03:49:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:49:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:49:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:49:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:49:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:49:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:49:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:49:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:49:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:49:26,892 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:49:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:49:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:49:26,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 44, 26, 881590), 1, 2])
securityworker stdout | 2024-04-22 03:49:26,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:49:26,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:49:26,898 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 44, 26, 881590), 1, 2])
securityworker stdout | 2024-04-22 03:49:26,901 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:49:26,901 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:49:26,901 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:49:26,901 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:49:26,901 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:49:26,901 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:49:26,901 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:49:26,902 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:49:26,902 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:49:26,902 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:49:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:49:27,440 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:49:29,346 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:49:29,383 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:49:29,810 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:49:29,814 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:49:29,817 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:49:29,824 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:49:29,827 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:49:30,409 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:49:30,653 [281] [DEBUG] [app] Starting request: urn:request:aef5d737-e0d5-433e-a019-589277211520 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:49:30,653 [278] [DEBUG] [app] Starting request: urn:request:3201d6f4-1672-4a2a-9f5e-d2d3116b4555 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:49:30,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:49:30,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:49:30,657 [290] [DEBUG] [app] Starting request: urn:request:4b843d7c-9a1a-426a-bb91-7aa15502f777 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:49:30,657 [291] [DEBUG] [app] Starting request: urn:request:9cf422aa-331e-4d2e-b609-0cc3ea16d598 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:49:30,657 [290] [DEBUG] [app] Ending request: urn:request:4b843d7c-9a1a-426a-bb91-7aa15502f777 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:4b843d7c-9a1a-426a-bb91-7aa15502f777', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:49:30,657 [291] [DEBUG] [app] Ending request: urn:request:9cf422aa-331e-4d2e-b609-0cc3ea16d598 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:9cf422aa-331e-4d2e-b609-0cc3ea16d598', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:49:30,658 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:49:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:49:30,658 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:49:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:49:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:49:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:49:30,658 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:49:30,658 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:49:30,660 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:49:30,660 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:49:30,661 [282] [DEBUG] [app] Starting request: urn:request:356142a8-b212-49d5-805b-a171fe38e31d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:49:30,661 [279] [DEBUG] [app] Starting request: urn:request:d1ee2c19-8b3c-4097-8702-4ab42b5413a6 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:49:30,662 [282] [DEBUG] [app] Ending request: urn:request:356142a8-b212-49d5-805b-a171fe38e31d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:356142a8-b212-49d5-805b-a171fe38e31d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:49:30,662 [279] [DEBUG] [app] Ending request: urn:request:d1ee2c19-8b3c-4097-8702-4ab42b5413a6 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d1ee2c19-8b3c-4097-8702-4ab42b5413a6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:49:30,662 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:49:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:49:30,662 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:49:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:49:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:49:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:49:30,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:49:30,662 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:49:30,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:49:30,662 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:49:30,669 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:49:30,670 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:49:30,677 [278] [DEBUG] [app] Ending request: urn:request:3201d6f4-1672-4a2a-9f5e-d2d3116b4555 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:3201d6f4-1672-4a2a-9f5e-d2d3116b4555', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:49:30,677 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:49:30,678 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:49:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:49:30,678 [281] [DEBUG] [app] Ending request: urn:request:aef5d737-e0d5-433e-a019-589277211520 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:aef5d737-e0d5-433e-a019-589277211520', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:49:30,678 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:49:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:49:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
gunicorn-web stdout | 2024-04-22 03:49:30,678 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:49:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
notificationworker stdout | 2024-04-22 03:49:31,838 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:49:33,092 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:49:33,490 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:49:33,596 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:49:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:49:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:43.759375+00:00 (in 9.999462 seconds)
notificationworker stdout | 2024-04-22 03:49:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:49:43 UTC)" (scheduled at 2024-04-22 03:49:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:49:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:49:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 49, 33, 760406), True, datetime.datetime(2024, 4, 22, 3, 49, 33, 760406), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:49:33,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:49:33,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:49:33,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:49:43 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:49:34,427 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:49:34,431 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:49:34,433 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:49:34,651 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 03:49:35,843 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
securityworker stdout | 2024-04-22 03:49:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:49:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:56.873109+00:00 (in 21.000731 seconds)
securityworker stdout | 2024-04-22 03:49:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:05 UTC)" (scheduled at 2024-04-22 03:49:35.871852+00:00)
securityworker stdout | 2024-04-22 03:49:35,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:49:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:49:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:49:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:49:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:49:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:49:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:05 UTC)" executed successfully
autopruneworker stdout | 2024-04-22 03:49:36,024 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:49:36,122 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 03:49:37,041 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:49:38,436 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:49:38,472 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:49:38,865 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:49:38,924 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
exportactionlogsworker stdout | 2024-04-22 03:49:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:49:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:41.564959+00:00 (in 1.997488 seconds)
exportactionlogsworker stdout | 2024-04-22 03:49:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:39 UTC)" (scheduled at 2024-04-22 03:49:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:49:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:49:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:49:40,145 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:49:40,655 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:49:40,671 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:49:40,673 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:49:40,676 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:49:40,678 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:49:40,681 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:49:40,688 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:49:40,693 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:49:40,695 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:49:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:49:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:11.264267+00:00 (in 29.999526 seconds)
autopruneworker stdout | 2024-04-22 03:49:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:11 UTC)" (scheduled at 2024-04-22 03:49:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:49:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757721272, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:49:41,277 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:49:41,277 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:49:41,277 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:49:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:49:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:39.566970+00:00 (in 58.001501 seconds)
exportactionlogsworker stdout | 2024-04-22 03:49:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:41 UTC)" (scheduled at 2024-04-22 03:49:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:49:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:49:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 49, 41, 565804), True, datetime.datetime(2024, 4, 22, 3, 49, 41, 565804), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:49:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:49:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:49:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:49:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:49:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:22.058978+00:00 (in 39.001263 seconds)
namespacegcworker stdout | 2024-04-22 03:49:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:43 UTC)" (scheduled at 2024-04-22 03:49:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:49:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:49:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 49, 43, 58121), True, datetime.datetime(2024, 4, 22, 3, 49, 43, 58121), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:49:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:49:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:49:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:50:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:49:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:49:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:49:53.759375+00:00 (in 9.999482 seconds)
notificationworker stdout | 2024-04-22 03:49:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:49:53 UTC)" (scheduled at 2024-04-22 03:49:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:49:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:49:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 49, 43, 760181), True, datetime.datetime(2024, 4, 22, 3, 49, 43, 760181), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:49:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:49:43,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:49:43,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:49:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:49:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:49:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:14.952062+00:00 (in 29.999485 seconds)
gcworker stdout | 2024-04-22 03:49:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:14 UTC)" (scheduled at 2024-04-22 03:49:44.952062+00:00)
gcworker stdout | 2024-04-22 03:49:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548184952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:49:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:49:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:49:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:49:45,653 [281] [DEBUG] [app] Starting request: urn:request:ebe135f3-fcf8-4779-851a-f4c003adaa5f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:49:45,653 [278] [DEBUG] [app] Starting request: urn:request:01307f87-c2d8-4a83-a68e-724cf60144b5 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:49:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:49:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:49:45,656 [292] [DEBUG] [app] Starting request: urn:request:ed3b5bc4-0887-4293-a736-2e04d860ac24 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:49:45,656 [291] [DEBUG] [app] Starting request: urn:request:b9c2f73d-5d90-4c8f-897a-cd158cbc832c (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:49:45,656 [292] [DEBUG] [app] Ending request: urn:request:ed3b5bc4-0887-4293-a736-2e04d860ac24 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:ed3b5bc4-0887-4293-a736-2e04d860ac24', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:49:45,656 [291] [DEBUG] [app] Ending request: urn:request:b9c2f73d-5d90-4c8f-897a-cd158cbc832c (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b9c2f73d-5d90-4c8f-897a-cd158cbc832c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:49:45,656 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:49:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:49:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:49:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:49:45,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:49:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:49:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:49:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:49:45,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:49:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:49:45,659 [278] [DEBUG] [app] Starting request: urn:request:9a2975a5-f0d9-4e30-bba0-c49746e84543 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:49:45,659 [278] [DEBUG] [app] Ending request: urn:request:9a2975a5-f0d9-4e30-bba0-c49746e84543 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9a2975a5-f0d9-4e30-bba0-c49746e84543', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:49:45,659 [282] [DEBUG] [app] Starting request: urn:request:d26d0215-a051-4951-8c11-2ab6a2bb18d2 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:49:45,659 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:49:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:49:45,660 [282] [DEBUG] [app] Ending request: urn:request:d26d0215-a051-4951-8c11-2ab6a2bb18d2 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d26d0215-a051-4951-8c11-2ab6a2bb18d2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:49:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:49:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:49:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:49:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:49:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:49:45,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:49:45,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:49:45,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:49:45,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:49:45,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:49:45,674 [278] [DEBUG] [app] Ending request: urn:request:01307f87-c2d8-4a83-a68e-724cf60144b5 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:01307f87-c2d8-4a83-a68e-724cf60144b5', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:49:45,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:49:45,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:49:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:49:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:49:45,675 [281] [DEBUG] [app] Ending request: urn:request:ebe135f3-fcf8-4779-851a-f4c003adaa5f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:ebe135f3-fcf8-4779-851a-f4c003adaa5f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:49:45,675 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:49:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:49:45,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:49:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
buildlogsarchiver stdout | 2024-04-22 03:49:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:49:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:17.052354+00:00 (in 29.999474 seconds)
buildlogsarchiver stdout | 2024-04-22 03:49:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:17 UTC)" (scheduled at 2024-04-22 03:49:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:49:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 49, 47, 53096), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:49:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:49:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:49:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:49:49,305 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:49:50,821 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:49:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:49:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:03.759375+00:00 (in 9.999469 seconds)
notificationworker stdout | 2024-04-22 03:49:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:50:03 UTC)" (scheduled at 2024-04-22 03:49:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:49:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:49:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 49, 53, 760373), True, datetime.datetime(2024, 4, 22, 3, 49, 53, 760373), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:49:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:49:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:49:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:50:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:49:54,352 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:49:55,061 [89] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositoryactioncounter stdout | 2024-04-22 03:49:55,062 [89] [INFO] [apscheduler.executors.default] Running job "RepositoryActionCountWorker._run_counting (trigger: interval[4:00:00], next run at: 2024-04-22 03:49:55 UTC)" (scheduled at 2024-04-22 03:49:55.061170+00:00)
repositoryactioncounter stdout | 2024-04-22 03:49:55,062 [89] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "repository" AS "t1"', [])
repositoryactioncounter stdout | 2024-04-22 03:49:55,063 [89] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 07:49:55.061170+00:00 (in 14399.998081 seconds)
repositoryactioncounter stdout | 2024-04-22 03:49:55,072 [89] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "repository" AS "t1"', [])
repositoryactioncounter stdout | 2024-04-22 03:49:55,074 [89] [DEBUG] [data.database] Disconnecting from database.
repositoryactioncounter stdout | 2024-04-22 03:49:55,074 [89] [INFO] [apscheduler.executors.default] Job "RepositoryActionCountWorker._run_counting (trigger: interval[4:00:00], next run at: 2024-04-22 07:49:55 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:49:56,022 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:49:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:49:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:05.871852+00:00 (in 8.998236 seconds)
securityworker stdout | 2024-04-22 03:49:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:26 UTC)" (scheduled at 2024-04-22 03:49:56.873109+00:00)
securityworker stdout | 2024-04-22 03:49:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:49:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:49:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:49:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:49:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:49:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:49:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:49:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:49:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:49:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:49:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:49:56,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:49:56,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 44, 56, 881257), 1, 2])
securityworker stdout | 2024-04-22 03:49:56,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:49:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:49:56,898 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 44, 56, 881257), 1, 2])
securityworker stdout | 2024-04-22 03:49:56,901 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:49:56,901 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:49:56,901 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:49:56,901 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:49:56,901 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:49:56,901 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:49:56,901 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:49:56,902 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:49:56,902 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:49:56,902 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:49:57,477 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:49:59,362 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:49:59,412 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:49:59,817 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:49:59,820 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:49:59,823 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:49:59,830 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:49:59,836 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:50:00,414 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:50:00,653 [282] [DEBUG] [app] Starting request: urn:request:ed3f2529-7045-4ba7-8da5-bc60de77f48f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:50:00,653 [281] [DEBUG] [app] Starting request: urn:request:e33216a5-fc47-4a13-a57e-8defcf1b0e65 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:50:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:50:00,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:50:00,656 [284] [DEBUG] [app] Starting request: urn:request:977e37e4-313c-4701-9ccc-841c0780a763 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:50:00,656 [292] [DEBUG] [app] Starting request: urn:request:0a9bfcee-dff6-40e9-8d49-9b6b74ee8257 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:50:00,656 [284] [DEBUG] [app] Ending request: urn:request:977e37e4-313c-4701-9ccc-841c0780a763 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:977e37e4-313c-4701-9ccc-841c0780a763', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:50:00,656 [292] [DEBUG] [app] Ending request: urn:request:0a9bfcee-dff6-40e9-8d49-9b6b74ee8257 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:0a9bfcee-dff6-40e9-8d49-9b6b74ee8257', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:50:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:50:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:50:00,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:50:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:50:00,656 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:50:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:50:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:50:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:50:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:50:00,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:50:00,659 [278] [DEBUG] [app] Starting request: urn:request:3aeb255c-0a18-4c1c-a5cf-6e046d3f314a (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:50:00,660 [278] [DEBUG] [app] Ending request: urn:request:3aeb255c-0a18-4c1c-a5cf-6e046d3f314a (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3aeb255c-0a18-4c1c-a5cf-6e046d3f314a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:50:00,660 [282] [DEBUG] [app] Starting request: urn:request:1ab631ee-9d5f-4111-9d2a-691713521c34 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:50:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:50:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:50:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:50:00,661 [282] [DEBUG] [app] Ending request: urn:request:1ab631ee-9d5f-4111-9d2a-691713521c34 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1ab631ee-9d5f-4111-9d2a-691713521c34', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:50:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:50:00,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:50:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:50:00,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:50:00,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:50:00,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:50:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:50:00,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:50:00,669 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:50:00,676 [282] [DEBUG] [app] Ending request: urn:request:ed3f2529-7045-4ba7-8da5-bc60de77f48f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:ed3f2529-7045-4ba7-8da5-bc60de77f48f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:50:00,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:50:00,677 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:50:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:50:00,677 [281] [DEBUG] [app] Ending request: urn:request:e33216a5-fc47-4a13-a57e-8defcf1b0e65 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e33216a5-fc47-4a13-a57e-8defcf1b0e65', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:50:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.025)
gunicorn-web stdout | 2024-04-22 03:50:00,677 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:50:00,677 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:50:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:50:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
notificationworker stdout | 2024-04-22 03:50:01,875 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:50:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:50:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:16.552337+00:00 (in 13.995591 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:50:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:02 UTC)" (scheduled at 2024-04-22 03:50:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:50:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:50:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:50:03,120 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:50:03,500 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:50:03,632 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:50:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:50:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:13.759375+00:00 (in 9.999457 seconds)
notificationworker stdout | 2024-04-22 03:50:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:50:13 UTC)" (scheduled at 2024-04-22 03:50:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:50:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:50:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 50, 3, 760361), True, datetime.datetime(2024, 4, 22, 3, 50, 3, 760361), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:50:03,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:50:03,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:50:03,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:50:13 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:50:04,434 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:50:04,439 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:50:04,442 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:50:04,660 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 03:50:05,864 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
securityworker stdout | 2024-04-22 03:50:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:50:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:26.873109+00:00 (in 21.000749 seconds)
securityworker stdout | 2024-04-22 03:50:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:35 UTC)" (scheduled at 2024-04-22 03:50:05.871852+00:00)
securityworker stdout | 2024-04-22 03:50:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:50:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:50:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:50:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:50:05,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:50:05,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:50:05,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:35 UTC)" executed successfully
autopruneworker stdout | 2024-04-22 03:50:06,060 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:50:06,159 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
repositorygcworker stdout | 2024-04-22 03:50:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:50:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:13.555667+00:00 (in 7.002668 seconds)
repositorygcworker stdout | 2024-04-22 03:50:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:06 UTC)" (scheduled at 2024-04-22 03:50:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:50:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:50:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 50, 6, 553395), True, datetime.datetime(2024, 4, 22, 3, 50, 6, 553395), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:50:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:50:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:50:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:06 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:50:07,077 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:50:08,473 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:50:08,508 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:50:08,874 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:50:08,950 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
storagereplication stdout | 2024-04-22 03:50:10,151 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:50:10,663 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:50:10,679 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:50:10,681 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:50:10,687 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:50:10,690 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:50:10,694 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:50:10,696 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:50:10,703 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:50:10,706 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:50:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:50:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:41.264267+00:00 (in 29.999504 seconds)
autopruneworker stdout | 2024-04-22 03:50:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:41 UTC)" (scheduled at 2024-04-22 03:50:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:50:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757751271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:50:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:50:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:50:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:50:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:50:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:06.552482+00:00 (in 52.996350 seconds)
repositorygcworker stdout | 2024-04-22 03:50:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:13 UTC)" (scheduled at 2024-04-22 03:50:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:50:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:50:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:50:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:50:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:19.762424+00:00 (in 6.002575 seconds)
notificationworker stdout | 2024-04-22 03:50:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:50:23 UTC)" (scheduled at 2024-04-22 03:50:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:50:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:50:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 50, 13, 760280), True, datetime.datetime(2024, 4, 22, 3, 50, 13, 760280), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:50:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:50:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:50:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:50:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:50:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:50:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:44.952062+00:00 (in 29.999493 seconds)
gcworker stdout | 2024-04-22 03:50:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:44 UTC)" (scheduled at 2024-04-22 03:50:14.952062+00:00)
gcworker stdout | 2024-04-22 03:50:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548214952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:50:14,966 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:50:14,966 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:50:14,966 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:50:15,653 [278] [DEBUG] [app] Starting request: urn:request:8d958adb-a521-4009-ae45-4a2d7c585650 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:50:15,653 [281] [DEBUG] [app] Starting request: urn:request:42acd858-bd07-42f7-861b-47df3ff03205 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:50:15,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:50:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:50:15,656 [290] [DEBUG] [app] Starting request: urn:request:a814449a-6ce1-4927-9af0-39f604cbba72 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:50:15,656 [284] [DEBUG] [app] Starting request: urn:request:05562af6-a90e-4f6c-839b-d6a5d0f52d4d (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:50:15,656 [284] [DEBUG] [app] Ending request: urn:request:05562af6-a90e-4f6c-839b-d6a5d0f52d4d (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:05562af6-a90e-4f6c-839b-d6a5d0f52d4d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:50:15,656 [290] [DEBUG] [app] Ending request: urn:request:a814449a-6ce1-4927-9af0-39f604cbba72 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:a814449a-6ce1-4927-9af0-39f604cbba72', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:50:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:50:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:50:15,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:50:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:50:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:50:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:50:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:50:15,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:50:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:50:15,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:50:15,659 [278] [DEBUG] [app] Starting request: urn:request:4410046f-e9a1-4f6c-964a-9c0d00ef2754 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:50:15,659 [278] [DEBUG] [app] Ending request: urn:request:4410046f-e9a1-4f6c-964a-9c0d00ef2754 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:4410046f-e9a1-4f6c-964a-9c0d00ef2754', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:50:15,659 [282] [DEBUG] [app] Starting request: urn:request:05a6c5c7-d08b-48f3-88f7-cd4adb78705f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:50:15,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:50:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:50:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:50:15,660 [282] [DEBUG] [app] Ending request: urn:request:05a6c5c7-d08b-48f3-88f7-cd4adb78705f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:05a6c5c7-d08b-48f3-88f7-cd4adb78705f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:50:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:50:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:50:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:50:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:50:15,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:50:15,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:50:15,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:50:15,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:50:15,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:50:15,675 [278] [DEBUG] [app] Ending request: urn:request:8d958adb-a521-4009-ae45-4a2d7c585650 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:8d958adb-a521-4009-ae45-4a2d7c585650', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:50:15,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:50:15,675 [281] [DEBUG] [app] Ending request: urn:request:42acd858-bd07-42f7-861b-47df3ff03205 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:42acd858-bd07-42f7-861b-47df3ff03205', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:50:15,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:50:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:50:15,676 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:50:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.024)
gunicorn-web stdout | 2024-04-22 03:50:15,676 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:50:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:50:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
securityscanningnotificationworker stdout | 2024-04-22 03:50:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:50:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:02.556208+00:00 (in 46.003305 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:50:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:16 UTC)" (scheduled at 2024-04-22 03:50:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:50:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:50:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 50, 16, 553346), True, datetime.datetime(2024, 4, 22, 3, 50, 16, 553346), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:50:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:50:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:50:16,565 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:50:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:50:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:47.052354+00:00 (in 29.999416 seconds)
buildlogsarchiver stdout | 2024-04-22 03:50:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:47 UTC)" (scheduled at 2024-04-22 03:50:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:50:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 50, 17, 53190), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:50:17,065 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:50:17,065 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:50:17,065 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:50:19,313 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:50:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:50:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:23.759375+00:00 (in 3.996404 seconds)
notificationworker stdout | 2024-04-22 03:50:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:19 UTC)" (scheduled at 2024-04-22 03:50:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:50:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:50:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:50:20,837 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:50:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:50:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:43.057186+00:00 (in 20.997642 seconds)
namespacegcworker stdout | 2024-04-22 03:50:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:22 UTC)" (scheduled at 2024-04-22 03:50:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:50:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:50:22,060 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:50:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:50:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:33.759375+00:00 (in 9.999437 seconds)
notificationworker stdout | 2024-04-22 03:50:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:50:33 UTC)" (scheduled at 2024-04-22 03:50:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:50:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:50:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 50, 23, 760366), True, datetime.datetime(2024, 4, 22, 3, 50, 23, 760366), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:50:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:50:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:50:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:50:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 03:50:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:50:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:24.361582+00:00 (in 59.999479 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:50:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:24 UTC)" (scheduled at 2024-04-22 03:50:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:50:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
builder stdout | 2024-04-22 03:50:24,368 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
quotaregistrysizeworker stdout | 2024-04-22 03:50:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:50:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:24 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 03:50:26,029 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:50:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:50:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:35.871852+00:00 (in 8.998261 seconds)
securityworker stdout | 2024-04-22 03:50:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:56 UTC)" (scheduled at 2024-04-22 03:50:26.873109+00:00)
securityworker stdout | 2024-04-22 03:50:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:50:26,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:50:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:50:26,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:50:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:50:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:50:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:50:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:50:26,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:50:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:50:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:50:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:50:26,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 45, 26, 880452), 1, 2])
securityworker stdout | 2024-04-22 03:50:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:50:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:50:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 45, 26, 880452), 1, 2])
securityworker stdout | 2024-04-22 03:50:26,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:50:26,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:50:26,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:50:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:50:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:50:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:50:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:50:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:50:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:50:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:50:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:50:27,510 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:50:29,377 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:50:29,448 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:50:29,824 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:50:29,828 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:50:29,830 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:50:29,837 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:50:29,842 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:50:30,450 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:50:30,653 [282] [DEBUG] [app] Starting request: urn:request:d803dd5d-c1c4-48cc-8335-4f3f6e48648b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:50:30,653 [278] [DEBUG] [app] Starting request: urn:request:d2e2fd90-5250-406a-b111-d27f02d3a1ea (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:50:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:50:30,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:50:30,656 [292] [DEBUG] [app] Starting request: urn:request:2b2da913-2180-496f-911f-ab3d51dc61dc (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:50:30,656 [290] [DEBUG] [app] Starting request: urn:request:2191525a-cd6c-4ac5-888e-f08ecdb95e4d (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:50:30,657 [292] [DEBUG] [app] Ending request: urn:request:2b2da913-2180-496f-911f-ab3d51dc61dc (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:2b2da913-2180-496f-911f-ab3d51dc61dc', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:50:30,657 [290] [DEBUG] [app] Ending request: urn:request:2191525a-cd6c-4ac5-888e-f08ecdb95e4d (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:2191525a-cd6c-4ac5-888e-f08ecdb95e4d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:50:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:50:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:50:30,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:50:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:50:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:50:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
gunicorn-web stdout | 2024-04-22 03:50:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:50:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:50:30,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:50:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:50:30,660 [278] [DEBUG] [app] Starting request: urn:request:e5416f53-cccf-4236-aafa-79b82a2e3a0f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:50:30,660 [281] [DEBUG] [app] Starting request: urn:request:5074e4d7-fc1a-4287-94f8-0aa12847524f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:50:30,660 [278] [DEBUG] [app] Ending request: urn:request:e5416f53-cccf-4236-aafa-79b82a2e3a0f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e5416f53-cccf-4236-aafa-79b82a2e3a0f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:50:30,660 [281] [DEBUG] [app] Ending request: urn:request:5074e4d7-fc1a-4287-94f8-0aa12847524f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:5074e4d7-fc1a-4287-94f8-0aa12847524f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:50:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:50:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:50:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:50:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 03:50:30,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:50:30,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:50:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:50:30,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:50:30,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:50:30,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:50:30,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:50:30,670 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:50:30,675 [282] [DEBUG] [app] Ending request: urn:request:d803dd5d-c1c4-48cc-8335-4f3f6e48648b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:d803dd5d-c1c4-48cc-8335-4f3f6e48648b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:50:30,675 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:50:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:50:30,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:50:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:50:30,678 [278] [DEBUG] [app] Ending request: urn:request:d2e2fd90-5250-406a-b111-d27f02d3a1ea (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:d2e2fd90-5250-406a-b111-d27f02d3a1ea', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:50:30,678 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:50:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.027)
gunicorn-web stdout | 2024-04-22 03:50:30,679 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:50:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
notificationworker stdout | 2024-04-22 03:50:31,911 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:50:33,156 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:50:33,535 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:50:33,651 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:50:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:50:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:43.759375+00:00 (in 9.999518 seconds)
notificationworker stdout | 2024-04-22 03:50:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:50:43 UTC)" (scheduled at 2024-04-22 03:50:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:50:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:50:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 50, 33, 760234), True, datetime.datetime(2024, 4, 22, 3, 50, 33, 760234), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:50:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:50:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:50:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:50:43 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:50:34,442 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:50:34,448 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:50:34,450 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:50:34,695 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:50:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:50:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:56.873109+00:00 (in 21.000717 seconds)
securityworker stdout | 2024-04-22 03:50:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:05 UTC)" (scheduled at 2024-04-22 03:50:35.871852+00:00)
securityworker stdout | 2024-04-22 03:50:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:50:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:50:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:50:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:50:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:50:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:50:35,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:50:35,889 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:50:36,097 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:50:36,172 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 03:50:37,085 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:50:38,491 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:50:38,534 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:50:38,911 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:50:38,960 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
exportactionlogsworker stdout | 2024-04-22 03:50:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:50:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:41.564959+00:00 (in 1.997439 seconds)
exportactionlogsworker stdout | 2024-04-22 03:50:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:39 UTC)" (scheduled at 2024-04-22 03:50:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:50:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:50:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:50:40,176 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:50:40,676 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:50:40,687 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:50:40,690 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:50:40,694 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:50:40,698 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:50:40,701 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:50:40,704 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:50:40,713 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:50:40,716 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:50:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:50:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:11.264267+00:00 (in 29.999454 seconds)
autopruneworker stdout | 2024-04-22 03:50:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:11 UTC)" (scheduled at 2024-04-22 03:50:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:50:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757781272, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:50:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:50:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:50:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:50:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:50:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:39.566970+00:00 (in 58.001489 seconds)
exportactionlogsworker stdout | 2024-04-22 03:50:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:41 UTC)" (scheduled at 2024-04-22 03:50:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:50:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:50:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 50, 41, 565853), True, datetime.datetime(2024, 4, 22, 3, 50, 41, 565853), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:50:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:50:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:50:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:50:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:50:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:22.058978+00:00 (in 39.001320 seconds)
namespacegcworker stdout | 2024-04-22 03:50:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:43 UTC)" (scheduled at 2024-04-22 03:50:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:50:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:50:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 50, 43, 58038), True, datetime.datetime(2024, 4, 22, 3, 50, 43, 58038), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:50:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:50:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:50:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:51:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:50:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:50:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:50:53.759375+00:00 (in 9.999478 seconds)
notificationworker stdout | 2024-04-22 03:50:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:50:53 UTC)" (scheduled at 2024-04-22 03:50:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:50:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:50:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 50, 43, 760295), True, datetime.datetime(2024, 4, 22, 3, 50, 43, 760295), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:50:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:50:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:50:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:50:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:50:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:50:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:14.952062+00:00 (in 29.999504 seconds)
gcworker stdout | 2024-04-22 03:50:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:14 UTC)" (scheduled at 2024-04-22 03:50:44.952062+00:00)
gcworker stdout | 2024-04-22 03:50:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548244952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:50:44,966 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:50:44,966 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:50:44,966 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:50:45,653 [278] [DEBUG] [app] Starting request: urn:request:c4215457-03a9-4902-be4d-d8f0b4374d6a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:50:45,653 [282] [DEBUG] [app] Starting request: urn:request:bc10f44f-0cdb-4caa-beb1-a5175aacf2e9 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:50:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:50:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:50:45,656 [290] [DEBUG] [app] Starting request: urn:request:8862568e-00ab-4261-b99e-6b84807a414e (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:50:45,656 [284] [DEBUG] [app] Starting request: urn:request:9dbdff47-0de0-4f9f-a783-269397964999 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:50:45,656 [284] [DEBUG] [app] Ending request: urn:request:9dbdff47-0de0-4f9f-a783-269397964999 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:9dbdff47-0de0-4f9f-a783-269397964999', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:50:45,656 [290] [DEBUG] [app] Ending request: urn:request:8862568e-00ab-4261-b99e-6b84807a414e (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:8862568e-00ab-4261-b99e-6b84807a414e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:50:45,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:50:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:50:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:50:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:50:45,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:50:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:50:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:50:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:50:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:50:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:50:45,659 [282] [DEBUG] [app] Starting request: urn:request:6d5dbff9-6a32-4085-9f83-cd2322b22a9c (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:50:45,659 [282] [DEBUG] [app] Ending request: urn:request:6d5dbff9-6a32-4085-9f83-cd2322b22a9c (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:6d5dbff9-6a32-4085-9f83-cd2322b22a9c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:50:45,659 [279] [DEBUG] [app] Starting request: urn:request:c3713be6-ed8b-4027-992d-7c82d41424d3 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:50:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:50:45,659 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:50:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:50:45,660 [279] [DEBUG] [app] Ending request: urn:request:c3713be6-ed8b-4027-992d-7c82d41424d3 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:c3713be6-ed8b-4027-992d-7c82d41424d3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:50:45,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:50:45,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:50:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:50:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:50:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.001)
gunicorn-web stdout | 2024-04-22 03:50:45,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:50:45,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:50:45,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:50:45,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:50:45,674 [282] [DEBUG] [app] Ending request: urn:request:bc10f44f-0cdb-4caa-beb1-a5175aacf2e9 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:bc10f44f-0cdb-4caa-beb1-a5175aacf2e9', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:50:45,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:50:45,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:50:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:50:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:50:45,675 [278] [DEBUG] [app] Ending request: urn:request:c4215457-03a9-4902-be4d-d8f0b4374d6a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:c4215457-03a9-4902-be4d-d8f0b4374d6a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:50:45,676 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:50:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:50:45,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:50:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
buildlogsarchiver stdout | 2024-04-22 03:50:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:50:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:17.052354+00:00 (in 29.999449 seconds)
buildlogsarchiver stdout | 2024-04-22 03:50:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:17 UTC)" (scheduled at 2024-04-22 03:50:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:50:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 50, 47, 53274), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:50:47,065 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:50:47,065 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:50:47,065 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:50:49,337 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:50:50,873 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:50:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:50:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:03.759375+00:00 (in 9.999494 seconds)
notificationworker stdout | 2024-04-22 03:50:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:51:03 UTC)" (scheduled at 2024-04-22 03:50:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:50:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:50:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 50, 53, 760330), True, datetime.datetime(2024, 4, 22, 3, 50, 53, 760330), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:50:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:50:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:50:53,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:51:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:50:54,397 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:50:56,066 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:50:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:50:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:05.871852+00:00 (in 8.998238 seconds)
securityworker stdout | 2024-04-22 03:50:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:26 UTC)" (scheduled at 2024-04-22 03:50:56.873109+00:00)
securityworker stdout | 2024-04-22 03:50:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:50:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:50:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:50:56,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:50:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:50:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:50:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:50:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:50:56,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:50:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:50:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:50:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:50:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 45, 56, 880532), 1, 2])
securityworker stdout | 2024-04-22 03:50:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:50:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:50:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 45, 56, 880532), 1, 2])
securityworker stdout | 2024-04-22 03:50:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:50:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:50:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:50:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:50:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:50:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:50:56,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:50:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:50:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:50:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:50:57,546 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:50:59,413 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:50:59,477 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:50:59,833 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:50:59,837 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:50:59,840 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:50:59,843 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:50:59,848 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:51:00,471 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:51:00,653 [282] [DEBUG] [app] Starting request: urn:request:ab74a8e9-50e4-4d33-8c85-f6a50e756e8a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:51:00,653 [281] [DEBUG] [app] Starting request: urn:request:873c19f3-8cc0-4dea-b0d6-1aae0700c6a2 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:51:00,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:51:00,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:51:00,656 [284] [DEBUG] [app] Starting request: urn:request:2d280a26-496f-44a6-a752-6459561ccf8d (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:51:00,656 [289] [DEBUG] [app] Starting request: urn:request:43b344a5-ee63-4fc2-897c-e1cd6787dbbb (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:51:00,657 [284] [DEBUG] [app] Ending request: urn:request:2d280a26-496f-44a6-a752-6459561ccf8d (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:2d280a26-496f-44a6-a752-6459561ccf8d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:51:00,657 [289] [DEBUG] [app] Ending request: urn:request:43b344a5-ee63-4fc2-897c-e1cd6787dbbb (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:43b344a5-ee63-4fc2-897c-e1cd6787dbbb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:51:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:51:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:51:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:51:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:51:00,657 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:51:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:51:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:51:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:51:00,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:51:00,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:51:00,660 [281] [DEBUG] [app] Starting request: urn:request:04e158d1-c636-4681-ac06-695ca42037b0 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:51:00,660 [278] [DEBUG] [app] Starting request: urn:request:b644eed7-92fd-49ab-bb64-5641b46adb7d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:51:00,660 [278] [DEBUG] [app] Ending request: urn:request:b644eed7-92fd-49ab-bb64-5641b46adb7d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b644eed7-92fd-49ab-bb64-5641b46adb7d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:51:00,660 [281] [DEBUG] [app] Ending request: urn:request:04e158d1-c636-4681-ac06-695ca42037b0 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:04e158d1-c636-4681-ac06-695ca42037b0', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:51:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 03:51:00,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:51:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:51:00,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:51:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:51:00,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:51:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:51:00,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:51:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:51:00,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:51:00,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:51:00,669 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:51:00,676 [282] [DEBUG] [app] Ending request: urn:request:ab74a8e9-50e4-4d33-8c85-f6a50e756e8a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:ab74a8e9-50e4-4d33-8c85-f6a50e756e8a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:51:00,676 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:51:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:51:00,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:51:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:51:00,676 [281] [DEBUG] [app] Ending request: urn:request:873c19f3-8cc0-4dea-b0d6-1aae0700c6a2 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:873c19f3-8cc0-4dea-b0d6-1aae0700c6a2', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:51:00,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:51:00,677 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:51:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:51:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
notificationworker stdout | 2024-04-22 03:51:01,947 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:51:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:51:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:16.552337+00:00 (in 13.995579 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:51:02,557 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:02 UTC)" (scheduled at 2024-04-22 03:51:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:51:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:51:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:51:03,193 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:51:03,559 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:51:03,664 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:51:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:51:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:13.759375+00:00 (in 9.999460 seconds)
notificationworker stdout | 2024-04-22 03:51:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:51:13 UTC)" (scheduled at 2024-04-22 03:51:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:51:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:51:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 51, 3, 760205), True, datetime.datetime(2024, 4, 22, 3, 51, 3, 760205), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:51:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:51:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:51:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:51:13 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:51:04,450 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:51:04,455 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:51:04,457 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:51:04,719 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:51:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:51:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:26.873109+00:00 (in 21.000680 seconds)
securityworker stdout | 2024-04-22 03:51:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:35 UTC)" (scheduled at 2024-04-22 03:51:05.871852+00:00)
securityworker stdout | 2024-04-22 03:51:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:51:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:51:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:51:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:51:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:51:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:51:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:35 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:51:05,926 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:51:06,129 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:51:06,207 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
repositorygcworker stdout | 2024-04-22 03:51:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:51:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:13.555667+00:00 (in 7.002691 seconds)
repositorygcworker stdout | 2024-04-22 03:51:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:06 UTC)" (scheduled at 2024-04-22 03:51:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:51:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:51:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 51, 6, 553398), True, datetime.datetime(2024, 4, 22, 3, 51, 6, 553398), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:51:06,565 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:51:06,565 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:51:06,565 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:06 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:51:07,120 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:51:08,502 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:51:08,565 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:51:08,947 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:51:08,996 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
storagereplication stdout | 2024-04-22 03:51:10,203 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:51:10,688 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:51:10,693 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:51:10,701 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:51:10,704 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:51:10,708 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:51:10,712 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:51:10,714 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:51:10,724 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:51:10,726 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:51:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:51:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:41.264267+00:00 (in 29.999452 seconds)
autopruneworker stdout | 2024-04-22 03:51:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:41 UTC)" (scheduled at 2024-04-22 03:51:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:51:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757811272, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:51:11,277 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:51:11,277 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:51:11,277 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:51:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:51:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:51.555445+00:00 (in 37.999319 seconds)
repositorygcworker stdout | 2024-04-22 03:51:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:13 UTC)" (scheduled at 2024-04-22 03:51:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:51:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:51:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:51:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:51:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:19.762424+00:00 (in 6.002548 seconds)
notificationworker stdout | 2024-04-22 03:51:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:51:23 UTC)" (scheduled at 2024-04-22 03:51:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:51:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:51:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 51, 13, 760289), True, datetime.datetime(2024, 4, 22, 3, 51, 13, 760289), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:51:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:51:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:51:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:51:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:51:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:51:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:44.952062+00:00 (in 29.999457 seconds)
gcworker stdout | 2024-04-22 03:51:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:44 UTC)" (scheduled at 2024-04-22 03:51:14.952062+00:00)
gcworker stdout | 2024-04-22 03:51:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548274953, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:51:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:51:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:51:14,966 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:51:15,653 [279] [DEBUG] [app] Starting request: urn:request:4f67cba9-e856-47ee-be17-1f6d34a565bb (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:51:15,653 [278] [DEBUG] [app] Starting request: urn:request:f0d660cb-267c-4e28-b31f-df84a07d5074 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:51:15,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:51:15,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:51:15,657 [288] [DEBUG] [app] Starting request: urn:request:8b734808-a131-4d32-a899-10ff76de3398 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:51:15,657 [284] [DEBUG] [app] Starting request: urn:request:9151c492-fc45-4228-b612-553dcd52f819 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:51:15,657 [288] [DEBUG] [app] Ending request: urn:request:8b734808-a131-4d32-a899-10ff76de3398 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:8b734808-a131-4d32-a899-10ff76de3398', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:51:15,657 [284] [DEBUG] [app] Ending request: urn:request:9151c492-fc45-4228-b612-553dcd52f819 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:9151c492-fc45-4228-b612-553dcd52f819', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:51:15,658 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:51:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:51:15,658 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:51:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:51:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:51:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:51:15,658 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:51:15,658 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:51:15,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:51:15,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:51:15,661 [281] [DEBUG] [app] Starting request: urn:request:b4cb03fd-bd88-44b7-949a-593e938b7604 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:51:15,661 [282] [DEBUG] [app] Starting request: urn:request:42936e8e-eb73-45d7-8b7a-da8bc678ccab (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:51:15,661 [281] [DEBUG] [app] Ending request: urn:request:b4cb03fd-bd88-44b7-949a-593e938b7604 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b4cb03fd-bd88-44b7-949a-593e938b7604', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:51:15,661 [282] [DEBUG] [app] Ending request: urn:request:42936e8e-eb73-45d7-8b7a-da8bc678ccab (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:42936e8e-eb73-45d7-8b7a-da8bc678ccab', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:51:15,662 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:51:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:51:15,662 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:51:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:51:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:51:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:51:15,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:51:15,662 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:51:15,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:51:15,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:51:15,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:51:15,670 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:51:15,676 [278] [DEBUG] [app] Ending request: urn:request:f0d660cb-267c-4e28-b31f-df84a07d5074 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f0d660cb-267c-4e28-b31f-df84a07d5074', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:51:15,677 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:51:15,677 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:51:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:51:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
gunicorn-web stdout | 2024-04-22 03:51:15,678 [279] [DEBUG] [app] Ending request: urn:request:4f67cba9-e856-47ee-be17-1f6d34a565bb (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:4f67cba9-e856-47ee-be17-1f6d34a565bb', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:51:15,678 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:51:15,678 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:51:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:51:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
securityscanningnotificationworker stdout | 2024-04-22 03:51:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:51:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:02.556208+00:00 (in 46.003254 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:51:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:16 UTC)" (scheduled at 2024-04-22 03:51:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:51:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:51:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 51, 16, 553321), True, datetime.datetime(2024, 4, 22, 3, 51, 16, 553321), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:51:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:51:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:51:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:51:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:51:17,053 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:47.052354+00:00 (in 29.999329 seconds)
buildlogsarchiver stdout | 2024-04-22 03:51:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:47 UTC)" (scheduled at 2024-04-22 03:51:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:51:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 51, 17, 53386), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:51:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:51:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:51:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:51:19,357 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:51:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:51:19,763 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:23.759375+00:00 (in 3.996370 seconds)
notificationworker stdout | 2024-04-22 03:51:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:19 UTC)" (scheduled at 2024-04-22 03:51:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:51:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:51:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:51:20,886 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:51:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:51:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:43.057186+00:00 (in 20.997717 seconds)
namespacegcworker stdout | 2024-04-22 03:51:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:22 UTC)" (scheduled at 2024-04-22 03:51:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:51:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:51:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:51:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:51:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:33.759375+00:00 (in 9.999490 seconds)
notificationworker stdout | 2024-04-22 03:51:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:51:33 UTC)" (scheduled at 2024-04-22 03:51:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:51:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:51:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 51, 23, 760237), True, datetime.datetime(2024, 4, 22, 3, 51, 23, 760237), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:51:23,776 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:51:23,776 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:51:23,776 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:51:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 03:51:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:51:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:24.361582+00:00 (in 59.999460 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:51:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:24 UTC)" (scheduled at 2024-04-22 03:51:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:51:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:51:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:51:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:24 UTC)" executed successfully
builder stdout | 2024-04-22 03:51:24,433 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:51:26,103 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:51:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:51:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:35.871852+00:00 (in 8.998225 seconds)
securityworker stdout | 2024-04-22 03:51:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:56 UTC)" (scheduled at 2024-04-22 03:51:26.873109+00:00)
securityworker stdout | 2024-04-22 03:51:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:51:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:51:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:51:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:51:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:51:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:51:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:51:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:51:26,882 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:51:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:51:26,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:51:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:51:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 46, 26, 881945), 1, 2])
securityworker stdout | 2024-04-22 03:51:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:51:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:51:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 46, 26, 881945), 1, 2])
securityworker stdout | 2024-04-22 03:51:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:51:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:51:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:51:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:51:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:51:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:51:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:51:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:51:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:51:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:51:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:51:27,572 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:51:29,450 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:51:29,500 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:51:29,843 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:51:29,847 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:51:29,850 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:51:29,852 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:51:29,855 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:51:30,497 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:51:30,653 [282] [DEBUG] [app] Starting request: urn:request:87161268-b543-4dbc-97c9-f16b26463260 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:51:30,653 [278] [DEBUG] [app] Starting request: urn:request:9e2c8dd1-8fb2-474f-8710-cec9e7061c03 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:51:30,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:51:30,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:51:30,656 [284] [DEBUG] [app] Starting request: urn:request:3d4c6d5b-e7b7-4d46-b73b-994babf5f54d (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:51:30,657 [284] [DEBUG] [app] Ending request: urn:request:3d4c6d5b-e7b7-4d46-b73b-994babf5f54d (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:3d4c6d5b-e7b7-4d46-b73b-994babf5f54d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:51:30,657 [292] [DEBUG] [app] Starting request: urn:request:7a678fe9-1e5c-4990-b810-fabdfcd88098 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:51:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:51:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:51:30,657 [292] [DEBUG] [app] Ending request: urn:request:7a678fe9-1e5c-4990-b810-fabdfcd88098 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7a678fe9-1e5c-4990-b810-fabdfcd88098', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:51:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:51:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 03:51:30,658 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:51:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:51:30,658 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:51:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:51:30,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:51:30,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:51:30,660 [282] [DEBUG] [app] Starting request: urn:request:440e72ca-a6a4-4b0a-b292-a2f146f9f916 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:51:30,660 [282] [DEBUG] [app] Ending request: urn:request:440e72ca-a6a4-4b0a-b292-a2f146f9f916 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:440e72ca-a6a4-4b0a-b292-a2f146f9f916', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:51:30,660 [278] [DEBUG] [app] Starting request: urn:request:64ff6b56-29fe-406b-862d-5bd25042e8cc (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:51:30,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:51:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:51:30,660 [278] [DEBUG] [app] Ending request: urn:request:64ff6b56-29fe-406b-862d-5bd25042e8cc (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:64ff6b56-29fe-406b-862d-5bd25042e8cc', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:51:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:51:30,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:51:30,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:51:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:51:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:51:30,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:51:30,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:51:30,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:51:30,677 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:51:30,680 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:51:30,685 [278] [DEBUG] [app] Ending request: urn:request:9e2c8dd1-8fb2-474f-8710-cec9e7061c03 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:9e2c8dd1-8fb2-474f-8710-cec9e7061c03', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:51:30,685 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:51:30,685 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:51:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:51:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.032 118 0.032)
gunicorn-web stdout | 2024-04-22 03:51:30,687 [282] [DEBUG] [app] Ending request: urn:request:87161268-b543-4dbc-97c9-f16b26463260 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:87161268-b543-4dbc-97c9-f16b26463260', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:51:30,688 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:51:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.036 118 0.035)
gunicorn-web stdout | 2024-04-22 03:51:30,688 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:51:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
notificationworker stdout | 2024-04-22 03:51:31,985 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:51:33,211 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:51:33,567 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:51:33,684 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:51:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:51:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:43.759375+00:00 (in 9.999442 seconds)
notificationworker stdout | 2024-04-22 03:51:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:51:43 UTC)" (scheduled at 2024-04-22 03:51:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:51:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:51:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 51, 33, 760281), True, datetime.datetime(2024, 4, 22, 3, 51, 33, 760281), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:51:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:51:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:51:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:51:43 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:51:34,460 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:51:34,464 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:51:34,466 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:51:34,755 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:51:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:51:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:56.873109+00:00 (in 21.000723 seconds)
securityworker stdout | 2024-04-22 03:51:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:05 UTC)" (scheduled at 2024-04-22 03:51:35.871852+00:00)
securityworker stdout | 2024-04-22 03:51:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:51:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:51:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:51:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:51:35,891 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:51:35,893 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:51:35,893 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:51:35,948 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:51:36,154 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:51:36,216 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 03:51:37,135 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:51:38,514 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:51:38,593 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:51:38,969 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:51:39,031 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
exportactionlogsworker stdout | 2024-04-22 03:51:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:51:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:41.564959+00:00 (in 1.997494 seconds)
exportactionlogsworker stdout | 2024-04-22 03:51:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:39 UTC)" (scheduled at 2024-04-22 03:51:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:51:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:51:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:51:40,239 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:51:40,700 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:51:40,704 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:51:40,710 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:51:40,713 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:51:40,718 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:51:40,722 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:51:40,726 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:51:40,733 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:51:40,736 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:51:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:51:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:11.264267+00:00 (in 29.999534 seconds)
autopruneworker stdout | 2024-04-22 03:51:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:11 UTC)" (scheduled at 2024-04-22 03:51:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:51:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757841271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:51:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:51:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:51:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:51:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:51:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:53.566665+00:00 (in 12.001205 seconds)
exportactionlogsworker stdout | 2024-04-22 03:51:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:41 UTC)" (scheduled at 2024-04-22 03:51:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:51:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:51:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 51, 41, 565727), True, datetime.datetime(2024, 4, 22, 3, 51, 41, 565727), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:51:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:51:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:51:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:51:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:51:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:22.058978+00:00 (in 39.001306 seconds)
namespacegcworker stdout | 2024-04-22 03:51:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:43 UTC)" (scheduled at 2024-04-22 03:51:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:51:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:51:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 51, 43, 58125), True, datetime.datetime(2024, 4, 22, 3, 51, 43, 58125), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:51:43,072 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:51:43,072 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:51:43,072 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:52:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:51:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:51:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:51:53.759375+00:00 (in 9.999497 seconds)
notificationworker stdout | 2024-04-22 03:51:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:51:53 UTC)" (scheduled at 2024-04-22 03:51:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:51:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:51:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 51, 43, 760131), True, datetime.datetime(2024, 4, 22, 3, 51, 43, 760131), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:51:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:51:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:51:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:51:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:51:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:51:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:14.952062+00:00 (in 29.999545 seconds)
gcworker stdout | 2024-04-22 03:51:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:14 UTC)" (scheduled at 2024-04-22 03:51:44.952062+00:00)
gcworker stdout | 2024-04-22 03:51:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548304952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:51:44,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:51:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:51:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:51:45,653 [279] [DEBUG] [app] Starting request: urn:request:17c0e021-a324-407b-a085-130f877ed44c (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:51:45,653 [282] [DEBUG] [app] Starting request: urn:request:8770e130-f8a0-4bbf-8bde-96463580f7dd (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:51:45,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:51:45,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:51:45,657 [291] [DEBUG] [app] Starting request: urn:request:cd6853e9-c0da-445c-8589-059a6c159d28 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:51:45,657 [292] [DEBUG] [app] Starting request: urn:request:e2f76d70-7038-4f32-a334-f3467b8ff186 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:51:45,657 [291] [DEBUG] [app] Ending request: urn:request:cd6853e9-c0da-445c-8589-059a6c159d28 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:cd6853e9-c0da-445c-8589-059a6c159d28', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:51:45,657 [292] [DEBUG] [app] Ending request: urn:request:e2f76d70-7038-4f32-a334-f3467b8ff186 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:e2f76d70-7038-4f32-a334-f3467b8ff186', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:51:45,658 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:51:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:51:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:51:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:51:45,658 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:51:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:51:45,658 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:51:45,658 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:51:45,660 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:51:45,660 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:51:45,661 [278] [DEBUG] [app] Starting request: urn:request:4001db54-d17c-4aa6-a928-0897e128b1ba (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:51:45,661 [281] [DEBUG] [app] Starting request: urn:request:73a60727-b66c-4bcf-b5f5-c3fb5e6b9938 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:51:45,661 [278] [DEBUG] [app] Ending request: urn:request:4001db54-d17c-4aa6-a928-0897e128b1ba (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:4001db54-d17c-4aa6-a928-0897e128b1ba', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:51:45,661 [281] [DEBUG] [app] Ending request: urn:request:73a60727-b66c-4bcf-b5f5-c3fb5e6b9938 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:73a60727-b66c-4bcf-b5f5-c3fb5e6b9938', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:51:45,662 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:51:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:51:45,662 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:51:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:51:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:51:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:51:45,662 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:51:45,662 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:51:45,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:51:45,663 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:51:45,669 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:51:45,669 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:51:45,676 [282] [DEBUG] [app] Ending request: urn:request:8770e130-f8a0-4bbf-8bde-96463580f7dd (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:8770e130-f8a0-4bbf-8bde-96463580f7dd', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:51:45,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:51:45,677 [279] [DEBUG] [app] Ending request: urn:request:17c0e021-a324-407b-a085-130f877ed44c (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:17c0e021-a324-407b-a085-130f877ed44c', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:51:45,677 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:51:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:51:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
gunicorn-web stdout | 2024-04-22 03:51:45,677 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:51:45,677 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:51:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:51:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
buildlogsarchiver stdout | 2024-04-22 03:51:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:51:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:17.052354+00:00 (in 29.999505 seconds)
buildlogsarchiver stdout | 2024-04-22 03:51:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:17 UTC)" (scheduled at 2024-04-22 03:51:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:51:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 51, 47, 53182), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:51:47,065 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:51:47,065 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:51:47,065 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:51:49,393 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:51:50,909 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
repositorygcworker stdout | 2024-04-22 03:51:51,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:51:51,555 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:06.552482+00:00 (in 14.996519 seconds)
repositorygcworker stdout | 2024-04-22 03:51:51,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:56:51 UTC)" (scheduled at 2024-04-22 03:51:51.555445+00:00)
repositorygcworker stdout | 2024-04-22 03:51:51,556 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 51, 51, 556326), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 03:51:51,578 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 51, 51, 556326), True, datetime.datetime(2024, 4, 22, 3, 51, 51, 556326), 0, 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 03:51:51,581 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 51, 51, 556326), True, datetime.datetime(2024, 4, 22, 3, 51, 51, 556326), 0, 'repositorygc/%', False, datetime.datetime(2024, 4, 22, 3, 51, 51, 556326), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 03:51:51,583 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:51:51,583 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:56:51 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:51:53,566 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:51:53,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:39.566970+00:00 (in 45.999751 seconds)
exportactionlogsworker stdout | 2024-04-22 03:51:53,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:56:53 UTC)" (scheduled at 2024-04-22 03:51:53.566665+00:00)
exportactionlogsworker stdout | 2024-04-22 03:51:53,568 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 51, 53, 567477), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 03:51:53,578 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 51, 53, 567477), True, datetime.datetime(2024, 4, 22, 3, 51, 53, 567477), 0, 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 03:51:53,580 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 51, 53, 567477), True, datetime.datetime(2024, 4, 22, 3, 51, 53, 567477), 0, 'exportactionlogs/%', False, datetime.datetime(2024, 4, 22, 3, 51, 53, 567477), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 03:51:53,582 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:51:53,582 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:56:53 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:51:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:51:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:03.759375+00:00 (in 9.999511 seconds)
notificationworker stdout | 2024-04-22 03:51:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:52:03 UTC)" (scheduled at 2024-04-22 03:51:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:51:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:51:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 51, 53, 760174), True, datetime.datetime(2024, 4, 22, 3, 51, 53, 760174), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:51:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:51:53,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:51:53,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:52:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:51:54,455 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:51:56,139 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:51:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:51:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:05.871852+00:00 (in 8.998230 seconds)
securityworker stdout | 2024-04-22 03:51:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:26 UTC)" (scheduled at 2024-04-22 03:51:56.873109+00:00)
securityworker stdout | 2024-04-22 03:51:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:51:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:51:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:51:56,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:51:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:51:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:51:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:51:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:51:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:51:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:51:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:51:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:51:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 46, 56, 880812), 1, 2])
securityworker stdout | 2024-04-22 03:51:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:51:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:51:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 46, 56, 880812), 1, 2])
securityworker stdout | 2024-04-22 03:51:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:51:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:51:56,900 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:51:56,900 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:51:56,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:51:56,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:51:56,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:51:56,901 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:51:56,901 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:51:56,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:51:57,581 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:51:59,457 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:51:59,537 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:51:59,851 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:51:59,856 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:51:59,859 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:51:59,863 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:51:59,866 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:52:00,527 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:52:00,653 [282] [DEBUG] [app] Starting request: urn:request:ec7e93fa-fad7-4969-a860-d3d9db3aa589 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:52:00,653 [278] [DEBUG] [app] Starting request: urn:request:f7324aba-3f1d-4bc3-a7c7-9fcc7eebb2ce (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:52:00,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:52:00,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:52:00,657 [292] [DEBUG] [app] Starting request: urn:request:f8b3c027-06bd-4624-80d6-e2e1d2b5519f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:52:00,657 [292] [DEBUG] [app] Ending request: urn:request:f8b3c027-06bd-4624-80d6-e2e1d2b5519f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f8b3c027-06bd-4624-80d6-e2e1d2b5519f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:52:00,657 [284] [DEBUG] [app] Starting request: urn:request:bd09263c-d94c-47e3-89b5-2eaf6b7d521e (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:52:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:52:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:52:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:52:00,657 [284] [DEBUG] [app] Ending request: urn:request:bd09263c-d94c-47e3-89b5-2eaf6b7d521e (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:bd09263c-d94c-47e3-89b5-2eaf6b7d521e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:52:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 03:52:00,658 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:52:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:52:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:52:00,658 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:52:00,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:52:00,660 [282] [DEBUG] [app] Starting request: urn:request:a3407df2-11e1-4efe-9c03-8919e9429f0e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:52:00,660 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:52:00,660 [282] [DEBUG] [app] Ending request: urn:request:a3407df2-11e1-4efe-9c03-8919e9429f0e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a3407df2-11e1-4efe-9c03-8919e9429f0e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:52:00,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:52:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:52:00,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:52:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:52:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:52:00,661 [281] [DEBUG] [app] Starting request: urn:request:bf5f239a-57cb-4f5a-89f9-4ae0ce6487cd (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:52:00,662 [281] [DEBUG] [app] Ending request: urn:request:bf5f239a-57cb-4f5a-89f9-4ae0ce6487cd (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:bf5f239a-57cb-4f5a-89f9-4ae0ce6487cd', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:52:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:52:00,662 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:52:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:52:00,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:52:00,663 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:52:00,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:52:00,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:52:00,675 [282] [DEBUG] [app] Ending request: urn:request:ec7e93fa-fad7-4969-a860-d3d9db3aa589 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:ec7e93fa-fad7-4969-a860-d3d9db3aa589', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:52:00,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:52:00,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:52:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:52:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:52:00,676 [278] [DEBUG] [app] Ending request: urn:request:f7324aba-3f1d-4bc3-a7c7-9fcc7eebb2ce (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f7324aba-3f1d-4bc3-a7c7-9fcc7eebb2ce', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:52:00,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:52:00,677 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:52:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:52:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.025)
notificationworker stdout | 2024-04-22 03:52:02,007 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:52:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:52:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:16.552337+00:00 (in 13.995574 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:52:02,557 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:02 UTC)" (scheduled at 2024-04-22 03:52:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:52:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:52:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:52:03,247 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:52:03,582 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:52:03,696 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:52:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:52:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:13.759375+00:00 (in 9.999554 seconds)
notificationworker stdout | 2024-04-22 03:52:03,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:52:13 UTC)" (scheduled at 2024-04-22 03:52:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:52:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:52:03,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 52, 3, 760074), True, datetime.datetime(2024, 4, 22, 3, 52, 3, 760074), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:52:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:52:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:52:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:52:13 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:52:04,469 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:52:04,472 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:52:04,474 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:52:04,792 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:52:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:52:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:26.873109+00:00 (in 21.000702 seconds)
securityworker stdout | 2024-04-22 03:52:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:35 UTC)" (scheduled at 2024-04-22 03:52:05.871852+00:00)
securityworker stdout | 2024-04-22 03:52:05,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:52:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:52:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:52:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:52:05,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:52:05,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:52:05,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:35 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:52:05,978 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:52:06,179 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:52:06,252 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
repositorygcworker stdout | 2024-04-22 03:52:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:52:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:13.555667+00:00 (in 7.002654 seconds)
repositorygcworker stdout | 2024-04-22 03:52:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:06 UTC)" (scheduled at 2024-04-22 03:52:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:52:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:52:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 52, 6, 553457), True, datetime.datetime(2024, 4, 22, 3, 52, 6, 553457), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:52:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:52:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:52:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:06 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:52:07,157 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:52:08,524 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:52:08,625 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:52:09,005 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:52:09,068 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
storagereplication stdout | 2024-04-22 03:52:10,276 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:52:10,711 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:52:10,716 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:52:10,722 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:52:10,726 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:52:10,728 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:52:10,732 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:52:10,736 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:52:10,741 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:52:10,743 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:52:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:52:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:41.264267+00:00 (in 29.999561 seconds)
autopruneworker stdout | 2024-04-22 03:52:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:41 UTC)" (scheduled at 2024-04-22 03:52:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:52:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757871271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:52:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:52:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:52:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:52:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:52:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:06.552482+00:00 (in 52.996303 seconds)
repositorygcworker stdout | 2024-04-22 03:52:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:13 UTC)" (scheduled at 2024-04-22 03:52:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:52:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:52:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:52:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:52:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:19.762424+00:00 (in 6.002579 seconds)
notificationworker stdout | 2024-04-22 03:52:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:52:23 UTC)" (scheduled at 2024-04-22 03:52:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:52:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:52:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 52, 13, 760140), True, datetime.datetime(2024, 4, 22, 3, 52, 13, 760140), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:52:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:52:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:52:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:52:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:52:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:52:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:44.952062+00:00 (in 29.999527 seconds)
gcworker stdout | 2024-04-22 03:52:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:44 UTC)" (scheduled at 2024-04-22 03:52:14.952062+00:00)
gcworker stdout | 2024-04-22 03:52:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548334952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:52:14,967 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:52:14,967 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:52:14,967 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:52:15,653 [278] [DEBUG] [app] Starting request: urn:request:2df539c4-2b18-47c9-8824-073e1da4def1 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:52:15,653 [282] [DEBUG] [app] Starting request: urn:request:92f327ad-cf41-4532-a6e9-4f9aa583b644 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:52:15,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:52:15,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:52:15,656 [292] [DEBUG] [app] Starting request: urn:request:620f2fe7-3414-407e-aa9d-8efe113663dc (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:52:15,656 [284] [DEBUG] [app] Starting request: urn:request:53695c73-90c7-4a64-8914-e30cf0bfca3c (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:52:15,657 [292] [DEBUG] [app] Ending request: urn:request:620f2fe7-3414-407e-aa9d-8efe113663dc (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:620f2fe7-3414-407e-aa9d-8efe113663dc', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:52:15,657 [284] [DEBUG] [app] Ending request: urn:request:53695c73-90c7-4a64-8914-e30cf0bfca3c (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:53695c73-90c7-4a64-8914-e30cf0bfca3c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:52:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:52:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:52:15,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:52:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:52:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:52:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:52:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:52:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:52:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:52:15,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:52:15,660 [278] [DEBUG] [app] Starting request: urn:request:d52e39ac-c131-40e1-b5d8-b3ec24e68bfc (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:52:15,660 [281] [DEBUG] [app] Starting request: urn:request:e3fe117e-dc5d-4b68-80e3-355f7966cf9e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:52:15,660 [278] [DEBUG] [app] Ending request: urn:request:d52e39ac-c131-40e1-b5d8-b3ec24e68bfc (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d52e39ac-c131-40e1-b5d8-b3ec24e68bfc', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:52:15,660 [281] [DEBUG] [app] Ending request: urn:request:e3fe117e-dc5d-4b68-80e3-355f7966cf9e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e3fe117e-dc5d-4b68-80e3-355f7966cf9e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:52:15,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:52:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:52:15,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:52:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:52:15,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:52:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:52:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:52:15,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:52:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:52:15,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:52:15,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:52:15,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:52:15,675 [278] [DEBUG] [app] Ending request: urn:request:2df539c4-2b18-47c9-8824-073e1da4def1 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2df539c4-2b18-47c9-8824-073e1da4def1', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:52:15,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:52:15,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:52:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:52:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.024)
gunicorn-web stdout | 2024-04-22 03:52:15,676 [282] [DEBUG] [app] Ending request: urn:request:92f327ad-cf41-4532-a6e9-4f9aa583b644 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:92f327ad-cf41-4532-a6e9-4f9aa583b644', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:52:15,676 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:52:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:52:15,677 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:52:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
securityscanningnotificationworker stdout | 2024-04-22 03:52:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:52:16,553 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:21.555879+00:00 (in 5.002891 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:52:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:16 UTC)" (scheduled at 2024-04-22 03:52:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:52:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:52:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 52, 16, 553426), True, datetime.datetime(2024, 4, 22, 3, 52, 16, 553426), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:52:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:52:16,565 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:52:16,565 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:52:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:52:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:47.052354+00:00 (in 29.999477 seconds)
buildlogsarchiver stdout | 2024-04-22 03:52:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:47 UTC)" (scheduled at 2024-04-22 03:52:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:52:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 52, 17, 53088), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:52:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:52:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:52:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:52:19,425 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:52:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:52:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:23.759375+00:00 (in 3.996429 seconds)
notificationworker stdout | 2024-04-22 03:52:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:19 UTC)" (scheduled at 2024-04-22 03:52:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:52:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:52:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:52:20,942 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
securityscanningnotificationworker stdout | 2024-04-22 03:52:21,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:52:21,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:02.556208+00:00 (in 40.999782 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:52:21,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:57:21 UTC)" (scheduled at 2024-04-22 03:52:21.555879+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:52:21,557 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 52, 21, 556735), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 03:52:21,567 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 52, 21, 556735), True, datetime.datetime(2024, 4, 22, 3, 52, 21, 556735), 0, 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 03:52:21,570 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 52, 21, 556735), True, datetime.datetime(2024, 4, 22, 3, 52, 21, 556735), 0, 'secscanv4/%', False, datetime.datetime(2024, 4, 22, 3, 52, 21, 556735), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 03:52:21,572 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:52:21,572 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:57:21 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:52:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:52:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:38.058708+00:00 (in 15.999189 seconds)
namespacegcworker stdout | 2024-04-22 03:52:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:22 UTC)" (scheduled at 2024-04-22 03:52:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:52:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:52:22,060 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:52:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:52:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:33.759375+00:00 (in 9.999433 seconds)
notificationworker stdout | 2024-04-22 03:52:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:52:33 UTC)" (scheduled at 2024-04-22 03:52:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:52:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:52:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 52, 23, 760251), True, datetime.datetime(2024, 4, 22, 3, 52, 23, 760251), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:52:23,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:52:23,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:52:23,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:52:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 03:52:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:52:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:24.361582+00:00 (in 59.999411 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:52:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:24 UTC)" (scheduled at 2024-04-22 03:52:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:52:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:52:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:52:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:24 UTC)" executed successfully
builder stdout | 2024-04-22 03:52:24,476 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:52:26,148 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:52:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:52:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:35.871852+00:00 (in 8.998260 seconds)
securityworker stdout | 2024-04-22 03:52:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:56 UTC)" (scheduled at 2024-04-22 03:52:26.873109+00:00)
securityworker stdout | 2024-04-22 03:52:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:52:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:52:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:52:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:52:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:52:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:52:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:52:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:52:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:52:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:52:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:52:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:52:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 47, 26, 881367), 1, 2])
securityworker stdout | 2024-04-22 03:52:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:52:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:52:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 47, 26, 881367), 1, 2])
securityworker stdout | 2024-04-22 03:52:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:52:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:52:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:52:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:52:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:52:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:52:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:52:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:52:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:52:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:52:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:52:27,614 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:52:29,494 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:52:29,552 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:52:29,859 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:52:29,865 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:52:29,867 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:52:29,870 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:52:29,874 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:52:30,555 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:52:30,653 [282] [DEBUG] [app] Starting request: urn:request:cb047743-79fa-4c5c-9640-33d13b43a33e (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:52:30,653 [281] [DEBUG] [app] Starting request: urn:request:949760cc-5474-49cb-a3f1-8e557f029acb (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:52:30,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:52:30,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:52:30,656 [284] [DEBUG] [app] Starting request: urn:request:5a6c06d6-9358-4d23-a198-7210d97a2bb8 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:52:30,656 [292] [DEBUG] [app] Starting request: urn:request:58e1e92b-1860-4829-b30e-35e19f067e67 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:52:30,657 [284] [DEBUG] [app] Ending request: urn:request:5a6c06d6-9358-4d23-a198-7210d97a2bb8 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5a6c06d6-9358-4d23-a198-7210d97a2bb8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:52:30,657 [292] [DEBUG] [app] Ending request: urn:request:58e1e92b-1860-4829-b30e-35e19f067e67 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:58e1e92b-1860-4829-b30e-35e19f067e67', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:52:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:52:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:52:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:52:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:52:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:52:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:52:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:52:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:52:30,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:52:30,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:52:30,660 [279] [DEBUG] [app] Starting request: urn:request:1c4ba3af-d312-40fd-a41b-44a64f5fa82d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:52:30,660 [279] [DEBUG] [app] Ending request: urn:request:1c4ba3af-d312-40fd-a41b-44a64f5fa82d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1c4ba3af-d312-40fd-a41b-44a64f5fa82d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:52:30,660 [282] [DEBUG] [app] Starting request: urn:request:bf8b5b01-1115-4b13-9d1b-01596699b92a (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:52:30,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:52:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:52:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 03:52:30,661 [282] [DEBUG] [app] Ending request: urn:request:bf8b5b01-1115-4b13-9d1b-01596699b92a (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:bf8b5b01-1115-4b13-9d1b-01596699b92a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:52:30,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:52:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:52:30,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:52:30,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:52:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:52:30,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:52:30,662 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:52:30,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:52:30,668 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:52:30,676 [282] [DEBUG] [app] Ending request: urn:request:cb047743-79fa-4c5c-9640-33d13b43a33e (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:cb047743-79fa-4c5c-9640-33d13b43a33e', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:52:30,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:52:30,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:52:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:52:30,676 [281] [DEBUG] [app] Ending request: urn:request:949760cc-5474-49cb-a3f1-8e557f029acb (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:949760cc-5474-49cb-a3f1-8e557f029acb', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:52:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:52:30,677 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:52:30,677 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:52:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:52:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
notificationworker stdout | 2024-04-22 03:52:32,027 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:52:33,283 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:52:33,614 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:52:33,733 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:52:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:52:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:43.759375+00:00 (in 9.999526 seconds)
notificationworker stdout | 2024-04-22 03:52:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:52:43 UTC)" (scheduled at 2024-04-22 03:52:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:52:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:52:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 52, 33, 760240), True, datetime.datetime(2024, 4, 22, 3, 52, 33, 760240), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:52:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:52:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:52:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:52:43 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:52:34,479 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:52:34,481 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:52:34,484 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:52:34,828 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:52:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:52:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:56.873109+00:00 (in 21.000755 seconds)
securityworker stdout | 2024-04-22 03:52:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:05 UTC)" (scheduled at 2024-04-22 03:52:35.871852+00:00)
securityworker stdout | 2024-04-22 03:52:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:52:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:52:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:52:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:52:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:52:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:52:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:52:35,999 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:52:36,207 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:52:36,290 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 03:52:37,181 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
namespacegcworker stdout | 2024-04-22 03:52:38,058 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:52:38,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:43.057186+00:00 (in 4.997999 seconds)
namespacegcworker stdout | 2024-04-22 03:52:38,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:57:38 UTC)" (scheduled at 2024-04-22 03:52:38.058708+00:00)
namespacegcworker stdout | 2024-04-22 03:52:38,060 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 52, 38, 59553), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 03:52:38,070 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 52, 38, 59553), True, datetime.datetime(2024, 4, 22, 3, 52, 38, 59553), 0, 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 03:52:38,073 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 52, 38, 59553), True, datetime.datetime(2024, 4, 22, 3, 52, 38, 59553), 0, 'namespacegc/%', False, datetime.datetime(2024, 4, 22, 3, 52, 38, 59553), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 03:52:38,075 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:52:38,075 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:57:38 UTC)" executed successfully
securityworker stdout | 2024-04-22 03:52:38,532 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:52:38,661 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:52:39,029 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:52:39,104 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
exportactionlogsworker stdout | 2024-04-22 03:52:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:52:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:41.564959+00:00 (in 1.997460 seconds)
exportactionlogsworker stdout | 2024-04-22 03:52:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:39 UTC)" (scheduled at 2024-04-22 03:52:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:52:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:52:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:52:40,304 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:52:40,721 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:52:40,727 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:52:40,732 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:52:40,734 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:52:40,738 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:52:40,741 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:52:40,744 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:52:40,748 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:52:40,751 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:52:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:52:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:11.264267+00:00 (in 29.999578 seconds)
autopruneworker stdout | 2024-04-22 03:52:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:11 UTC)" (scheduled at 2024-04-22 03:52:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:52:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757901271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:52:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:52:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:52:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:52:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:52:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:39.566970+00:00 (in 58.001470 seconds)
exportactionlogsworker stdout | 2024-04-22 03:52:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:41 UTC)" (scheduled at 2024-04-22 03:52:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:52:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:52:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 52, 41, 565815), True, datetime.datetime(2024, 4, 22, 3, 52, 41, 565815), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:52:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:52:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:52:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:52:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:52:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:22.058978+00:00 (in 39.001337 seconds)
namespacegcworker stdout | 2024-04-22 03:52:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:43 UTC)" (scheduled at 2024-04-22 03:52:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:52:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:52:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 52, 43, 57928), True, datetime.datetime(2024, 4, 22, 3, 52, 43, 57928), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:52:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:52:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:52:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:53:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:52:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:52:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:52:53.759375+00:00 (in 9.999528 seconds)
notificationworker stdout | 2024-04-22 03:52:43,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:52:53 UTC)" (scheduled at 2024-04-22 03:52:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:52:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:52:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 52, 43, 760102), True, datetime.datetime(2024, 4, 22, 3, 52, 43, 760102), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:52:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:52:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:52:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:52:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:52:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:52:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:14.952062+00:00 (in 29.999485 seconds)
gcworker stdout | 2024-04-22 03:52:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:14 UTC)" (scheduled at 2024-04-22 03:52:44.952062+00:00)
gcworker stdout | 2024-04-22 03:52:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548364952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:52:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:52:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:52:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:52:45,653 [282] [DEBUG] [app] Starting request: urn:request:237878ed-9601-4f48-883e-fb9eeeac05d8 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:52:45,653 [279] [DEBUG] [app] Starting request: urn:request:c10638f8-6bf2-48ce-ba3f-7ed8fb75e414 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:52:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:52:45,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:52:45,656 [289] [DEBUG] [app] Starting request: urn:request:d856df3e-6374-47e9-8ec5-008d69dbcd86 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:52:45,656 [284] [DEBUG] [app] Starting request: urn:request:4ccdb0d9-f66f-40c2-826a-97b23a464c6f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:52:45,656 [284] [DEBUG] [app] Ending request: urn:request:4ccdb0d9-f66f-40c2-826a-97b23a464c6f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:4ccdb0d9-f66f-40c2-826a-97b23a464c6f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:52:45,656 [289] [DEBUG] [app] Ending request: urn:request:d856df3e-6374-47e9-8ec5-008d69dbcd86 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:d856df3e-6374-47e9-8ec5-008d69dbcd86', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:52:45,657 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:52:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:52:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:52:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:52:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:52:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:52:45,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:52:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:52:45,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:52:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:52:45,659 [282] [DEBUG] [app] Starting request: urn:request:dff641e2-05d1-44ea-bc02-07efcf3459e6 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:52:45,659 [278] [DEBUG] [app] Starting request: urn:request:62ad3c3d-7c57-4465-8e99-03f5a5331082 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:52:45,660 [282] [DEBUG] [app] Ending request: urn:request:dff641e2-05d1-44ea-bc02-07efcf3459e6 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:dff641e2-05d1-44ea-bc02-07efcf3459e6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:52:45,660 [278] [DEBUG] [app] Ending request: urn:request:62ad3c3d-7c57-4465-8e99-03f5a5331082 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:62ad3c3d-7c57-4465-8e99-03f5a5331082', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:52:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:52:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:52:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:52:45,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:52:45,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:52:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:52:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:52:45,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:52:45,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:52:45,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:52:45,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:52:45,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:52:45,674 [282] [DEBUG] [app] Ending request: urn:request:237878ed-9601-4f48-883e-fb9eeeac05d8 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:237878ed-9601-4f48-883e-fb9eeeac05d8', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:52:45,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:52:45,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:52:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:52:45,674 [279] [DEBUG] [app] Ending request: urn:request:c10638f8-6bf2-48ce-ba3f-7ed8fb75e414 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:c10638f8-6bf2-48ce-ba3f-7ed8fb75e414', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:52:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 03:52:45,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:52:45,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:52:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:52:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
buildlogsarchiver stdout | 2024-04-22 03:52:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:52:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:17.052354+00:00 (in 29.999453 seconds)
buildlogsarchiver stdout | 2024-04-22 03:52:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:17 UTC)" (scheduled at 2024-04-22 03:52:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:52:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 52, 47, 53174), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:52:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:52:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:52:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:52:49,443 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:52:50,960 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:52:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:52:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:03.759375+00:00 (in 9.999509 seconds)
notificationworker stdout | 2024-04-22 03:52:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:53:03 UTC)" (scheduled at 2024-04-22 03:52:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:52:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:52:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 52, 53, 760265), True, datetime.datetime(2024, 4, 22, 3, 52, 53, 760265), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:52:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:52:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:52:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:53:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:52:54,507 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:52:56,176 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:52:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:52:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:05.871852+00:00 (in 8.998187 seconds)
securityworker stdout | 2024-04-22 03:52:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:26 UTC)" (scheduled at 2024-04-22 03:52:56.873109+00:00)
securityworker stdout | 2024-04-22 03:52:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:52:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:52:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:52:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:52:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:52:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:52:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:52:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:52:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:52:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:52:56,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:52:56,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:52:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 47, 56, 881354), 1, 2])
securityworker stdout | 2024-04-22 03:52:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:52:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:52:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 47, 56, 881354), 1, 2])
securityworker stdout | 2024-04-22 03:52:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:52:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:52:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:52:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:52:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:52:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:52:56,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:52:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:52:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:52:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:52:57,650 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:52:59,522 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:52:59,588 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:52:59,867 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:52:59,874 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:52:59,876 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:52:59,879 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:52:59,882 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:53:00,569 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:53:00,653 [282] [DEBUG] [app] Starting request: urn:request:2ebfe1c3-3ce6-44ca-8a97-9d653f900c23 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:53:00,653 [281] [DEBUG] [app] Starting request: urn:request:1a028d9c-558c-4ae5-a81e-f65ba58e3c7b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:53:00,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:53:00,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:53:00,656 [292] [DEBUG] [app] Starting request: urn:request:7907024f-8414-47f2-80e2-ad15a1335459 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:53:00,656 [286] [DEBUG] [app] Starting request: urn:request:3616d031-c567-4304-a048-12e5d53202d7 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:53:00,657 [292] [DEBUG] [app] Ending request: urn:request:7907024f-8414-47f2-80e2-ad15a1335459 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7907024f-8414-47f2-80e2-ad15a1335459', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:53:00,657 [286] [DEBUG] [app] Ending request: urn:request:3616d031-c567-4304-a048-12e5d53202d7 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:3616d031-c567-4304-a048-12e5d53202d7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:53:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:53:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:53:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:53:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:53:00,657 [286] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:53:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:53:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:53:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:53:00,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:53:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:53:00,660 [278] [DEBUG] [app] Starting request: urn:request:0307b274-ae92-42f0-b3c6-3b960168e674 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:53:00,660 [281] [DEBUG] [app] Starting request: urn:request:ce8ddab5-e0d6-42ca-9264-20fd8abd1b45 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:53:00,660 [281] [DEBUG] [app] Ending request: urn:request:ce8ddab5-e0d6-42ca-9264-20fd8abd1b45 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:ce8ddab5-e0d6-42ca-9264-20fd8abd1b45', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:53:00,660 [278] [DEBUG] [app] Ending request: urn:request:0307b274-ae92-42f0-b3c6-3b960168e674 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:0307b274-ae92-42f0-b3c6-3b960168e674', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:53:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:53:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:53:00,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:53:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:53:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:53:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:53:00,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:53:00,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:53:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:53:00,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:53:00,668 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:53:00,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:53:00,675 [281] [DEBUG] [app] Ending request: urn:request:1a028d9c-558c-4ae5-a81e-f65ba58e3c7b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:1a028d9c-558c-4ae5-a81e-f65ba58e3c7b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:53:00,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:53:00,676 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:53:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:53:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:53:00,676 [282] [DEBUG] [app] Ending request: urn:request:2ebfe1c3-3ce6-44ca-8a97-9d653f900c23 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2ebfe1c3-3ce6-44ca-8a97-9d653f900c23', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:53:00,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:53:00,677 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:53:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:53:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
notificationworker stdout | 2024-04-22 03:53:02,057 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:53:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:53:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:16.552337+00:00 (in 13.995602 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:53:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:02 UTC)" (scheduled at 2024-04-22 03:53:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:53:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:53:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:53:03,314 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:53:03,650 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
notificationworker stdout | 2024-04-22 03:53:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:53:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:13.759375+00:00 (in 9.999443 seconds)
notificationworker stdout | 2024-04-22 03:53:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:53:13 UTC)" (scheduled at 2024-04-22 03:53:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:53:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:53:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 53, 3, 760248), True, datetime.datetime(2024, 4, 22, 3, 53, 3, 760248), 0, 'notification/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:53:03,769 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
notificationworker stdout | 2024-04-22 03:53:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:53:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:53:03,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:53:13 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 03:53:04,488 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:53:04,491 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:53:04,494 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:53:04,846 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:53:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:53:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:26.873109+00:00 (in 21.000691 seconds)
securityworker stdout | 2024-04-22 03:53:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:35 UTC)" (scheduled at 2024-04-22 03:53:05.871852+00:00)
securityworker stdout | 2024-04-22 03:53:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:53:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:53:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:53:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:53:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:53:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:53:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:35 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:53:06,032 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:53:06,230 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:53:06,324 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
repositorygcworker stdout | 2024-04-22 03:53:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:53:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:13.555667+00:00 (in 7.002666 seconds)
repositorygcworker stdout | 2024-04-22 03:53:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:06 UTC)" (scheduled at 2024-04-22 03:53:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:53:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:53:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 53, 6, 553408), True, datetime.datetime(2024, 4, 22, 3, 53, 6, 553408), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:53:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:53:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:53:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:06 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:53:07,217 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:53:08,550 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:53:08,687 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:53:09,054 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:53:09,135 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
storagereplication stdout | 2024-04-22 03:53:10,341 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:53:10,731 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:53:10,737 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:53:10,741 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:53:10,743 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:53:10,747 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:53:10,750 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:53:10,754 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:53:10,757 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:53:10,759 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:53:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:53:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:41.264267+00:00 (in 29.999498 seconds)
autopruneworker stdout | 2024-04-22 03:53:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:41 UTC)" (scheduled at 2024-04-22 03:53:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:53:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757931271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:53:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:53:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:53:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:53:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:53:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:06.552482+00:00 (in 52.996257 seconds)
repositorygcworker stdout | 2024-04-22 03:53:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:13 UTC)" (scheduled at 2024-04-22 03:53:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:53:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:53:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:53:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:53:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:19.762160+00:00 (in 6.002273 seconds)
notificationworker stdout | 2024-04-22 03:53:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:53:23 UTC)" (scheduled at 2024-04-22 03:53:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:53:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:53:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 53, 13, 760277), True, datetime.datetime(2024, 4, 22, 3, 53, 13, 760277), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:53:13,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:53:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:53:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:53:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:53:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:53:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:44.952062+00:00 (in 29.999520 seconds)
gcworker stdout | 2024-04-22 03:53:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:44 UTC)" (scheduled at 2024-04-22 03:53:14.952062+00:00)
gcworker stdout | 2024-04-22 03:53:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548394952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:53:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:53:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:53:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:53:15,653 [278] [DEBUG] [app] Starting request: urn:request:1e7bd32b-a5c5-40d0-b51d-5b06d1165d67 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:53:15,653 [282] [DEBUG] [app] Starting request: urn:request:bd76183b-f4c6-463f-b77b-6d463b5748fe (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:53:15,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:53:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:53:15,656 [290] [DEBUG] [app] Starting request: urn:request:1406cd82-9d3a-4a8e-9acb-27f4748ceef4 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:53:15,656 [291] [DEBUG] [app] Starting request: urn:request:d289c548-a038-414d-8272-b7cb8bb1c34a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:53:15,656 [291] [DEBUG] [app] Ending request: urn:request:d289c548-a038-414d-8272-b7cb8bb1c34a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:d289c548-a038-414d-8272-b7cb8bb1c34a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:53:15,656 [290] [DEBUG] [app] Ending request: urn:request:1406cd82-9d3a-4a8e-9acb-27f4748ceef4 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:1406cd82-9d3a-4a8e-9acb-27f4748ceef4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:53:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:53:15,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:53:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:53:15,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:53:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:53:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:53:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:53:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:53:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:53:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:53:15,659 [282] [DEBUG] [app] Starting request: urn:request:aa93ec23-d908-4c9c-9dbb-4a21ab9ad57d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:53:15,660 [282] [DEBUG] [app] Ending request: urn:request:aa93ec23-d908-4c9c-9dbb-4a21ab9ad57d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:aa93ec23-d908-4c9c-9dbb-4a21ab9ad57d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:53:15,660 [281] [DEBUG] [app] Starting request: urn:request:d31fc86d-e19e-43d9-a3a8-e3d9795be34b (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:53:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:53:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:53:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:53:15,660 [281] [DEBUG] [app] Ending request: urn:request:d31fc86d-e19e-43d9-a3a8-e3d9795be34b (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d31fc86d-e19e-43d9-a3a8-e3d9795be34b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:53:15,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:53:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:53:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:53:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:53:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:53:15,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:53:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:53:15,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:53:15,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:53:15,674 [282] [DEBUG] [app] Ending request: urn:request:bd76183b-f4c6-463f-b77b-6d463b5748fe (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:bd76183b-f4c6-463f-b77b-6d463b5748fe', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:53:15,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:53:15,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:53:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:53:15,675 [278] [DEBUG] [app] Ending request: urn:request:1e7bd32b-a5c5-40d0-b51d-5b06d1165d67 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:1e7bd32b-a5c5-40d0-b51d-5b06d1165d67', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:53:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:53:15,675 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:53:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:53:15,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:53:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
securityscanningnotificationworker stdout | 2024-04-22 03:53:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:53:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:02.556208+00:00 (in 46.003271 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:53:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:16 UTC)" (scheduled at 2024-04-22 03:53:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:53:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:53:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 53, 16, 553353), True, datetime.datetime(2024, 4, 22, 3, 53, 16, 553353), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:53:16,565 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:53:16,565 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:53:16,565 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:53:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:53:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:47.052354+00:00 (in 29.999400 seconds)
buildlogsarchiver stdout | 2024-04-22 03:53:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:47 UTC)" (scheduled at 2024-04-22 03:53:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:53:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 53, 17, 53322), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:53:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:53:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:53:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:53:19,464 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:53:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:53:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:23.759375+00:00 (in 3.996612 seconds)
notificationworker stdout | 2024-04-22 03:53:19,762 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:58:19 UTC)" (scheduled at 2024-04-22 03:53:19.762160+00:00)
notificationworker stdout | 2024-04-22 03:53:19,763 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 53, 19, 763049), 'notification/%'])
notificationworker stdout | 2024-04-22 03:53:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:19 UTC)" (scheduled at 2024-04-22 03:53:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:53:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:53:19,764 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:19 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:53:19,774 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 53, 19, 763049), True, datetime.datetime(2024, 4, 22, 3, 53, 19, 763049), 0, 'notification/%'])
notificationworker stdout | 2024-04-22 03:53:19,777 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 53, 19, 763049), True, datetime.datetime(2024, 4, 22, 3, 53, 19, 763049), 0, 'notification/%', False, datetime.datetime(2024, 4, 22, 3, 53, 19, 763049), 'notification/%'])
notificationworker stdout | 2024-04-22 03:53:19,779 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:53:19,779 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 03:58:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:53:20,977 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:53:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:53:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:43.057186+00:00 (in 20.997757 seconds)
namespacegcworker stdout | 2024-04-22 03:53:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:22 UTC)" (scheduled at 2024-04-22 03:53:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:53:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:53:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:53:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:53:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:33.759375+00:00 (in 9.999403 seconds)
notificationworker stdout | 2024-04-22 03:53:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:53:33 UTC)" (scheduled at 2024-04-22 03:53:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:53:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:53:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 53, 23, 760418), True, datetime.datetime(2024, 4, 22, 3, 53, 23, 760418), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:53:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:53:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:53:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:53:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 03:53:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:53:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:24.361582+00:00 (in 59.999454 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:53:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:24 UTC)" (scheduled at 2024-04-22 03:53:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:53:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:53:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:53:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:24 UTC)" executed successfully
builder stdout | 2024-04-22 03:53:24,544 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:53:26,207 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:53:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:53:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:35.871852+00:00 (in 8.998147 seconds)
securityworker stdout | 2024-04-22 03:53:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:56 UTC)" (scheduled at 2024-04-22 03:53:26.873109+00:00)
securityworker stdout | 2024-04-22 03:53:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:53:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:53:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:53:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:53:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:53:26,878 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:53:26,878 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:53:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:53:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:53:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:53:26,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:53:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:53:26,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 48, 26, 881581), 1, 2])
securityworker stdout | 2024-04-22 03:53:26,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:53:26,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:53:26,898 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 48, 26, 881581), 1, 2])
securityworker stdout | 2024-04-22 03:53:26,900 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:53:26,900 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:53:26,900 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:53:26,900 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:53:26,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:53:26,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:53:26,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:53:26,901 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:53:26,901 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:53:26,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:53:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:53:27,670 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:53:29,537 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:53:29,615 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:53:29,876 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:53:29,882 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:53:29,884 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:53:29,887 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:53:29,890 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:53:30,587 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:53:30,653 [282] [DEBUG] [app] Starting request: urn:request:4d7dea9a-9d71-44a2-991d-08d13c4d0c45 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:53:30,653 [278] [DEBUG] [app] Starting request: urn:request:defde7f9-b494-48d3-bec6-ade506c65627 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:53:30,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:53:30,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:53:30,656 [284] [DEBUG] [app] Starting request: urn:request:3ab20e64-3819-43a7-9d2a-fa0030be3ec8 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:53:30,656 [290] [DEBUG] [app] Starting request: urn:request:04cda9bb-ae18-4e40-9167-2f03168aeb8a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:53:30,657 [290] [DEBUG] [app] Ending request: urn:request:04cda9bb-ae18-4e40-9167-2f03168aeb8a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:04cda9bb-ae18-4e40-9167-2f03168aeb8a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:53:30,657 [284] [DEBUG] [app] Ending request: urn:request:3ab20e64-3819-43a7-9d2a-fa0030be3ec8 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:3ab20e64-3819-43a7-9d2a-fa0030be3ec8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:53:30,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:53:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:53:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:53:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:53:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:53:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:53:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:53:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:53:30,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:53:30,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:53:30,660 [281] [DEBUG] [app] Starting request: urn:request:9f0ef363-5b0b-48f8-904d-38db676ce927 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:53:30,660 [278] [DEBUG] [app] Starting request: urn:request:081affe1-8a66-43f5-a8ff-a2ced714314e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:53:30,660 [281] [DEBUG] [app] Ending request: urn:request:9f0ef363-5b0b-48f8-904d-38db676ce927 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9f0ef363-5b0b-48f8-904d-38db676ce927', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:53:30,660 [278] [DEBUG] [app] Ending request: urn:request:081affe1-8a66-43f5-a8ff-a2ced714314e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:081affe1-8a66-43f5-a8ff-a2ced714314e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:53:30,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:53:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:53:30,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:53:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:53:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:53:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 03:53:30,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:53:30,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:53:30,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:53:30,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:53:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:53:30,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:53:30,675 [278] [DEBUG] [app] Ending request: urn:request:defde7f9-b494-48d3-bec6-ade506c65627 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:defde7f9-b494-48d3-bec6-ade506c65627', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:53:30,675 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:53:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.024)
gunicorn-web stdout | 2024-04-22 03:53:30,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:53:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:53:30,676 [282] [DEBUG] [app] Ending request: urn:request:4d7dea9a-9d71-44a2-991d-08d13c4d0c45 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:4d7dea9a-9d71-44a2-991d-08d13c4d0c45', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:53:30,676 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:53:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:53:30,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:53:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
notificationworker stdout | 2024-04-22 03:53:32,085 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:53:33,338 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:53:33,687 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
notificationworker stdout | 2024-04-22 03:53:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:53:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:43.759375+00:00 (in 9.999437 seconds)
notificationworker stdout | 2024-04-22 03:53:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:53:43 UTC)" (scheduled at 2024-04-22 03:53:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:53:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:53:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 53, 33, 760269), True, datetime.datetime(2024, 4, 22, 3, 53, 33, 760269), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:53:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:53:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:53:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:53:43 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:53:33,799 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 03:53:34,496 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:53:34,499 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:53:34,502 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:53:34,882 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:53:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:53:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:56.873109+00:00 (in 21.000687 seconds)
securityworker stdout | 2024-04-22 03:53:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:05 UTC)" (scheduled at 2024-04-22 03:53:35.871852+00:00)
securityworker stdout | 2024-04-22 03:53:35,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:53:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:53:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:53:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:53:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:53:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:53:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:53:36,048 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:53:36,241 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:53:36,348 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 03:53:37,254 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:53:38,586 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:53:38,715 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:53:39,068 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:53:39,155 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
exportactionlogsworker stdout | 2024-04-22 03:53:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:53:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:41.564959+00:00 (in 1.997460 seconds)
exportactionlogsworker stdout | 2024-04-22 03:53:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:39 UTC)" (scheduled at 2024-04-22 03:53:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:53:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:53:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:53:40,364 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:53:40,740 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:53:40,747 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:53:40,749 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:53:40,753 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:53:40,756 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:53:40,759 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:53:40,761 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:53:40,765 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:53:40,767 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:53:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:53:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:11.264267+00:00 (in 29.999438 seconds)
autopruneworker stdout | 2024-04-22 03:53:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:11 UTC)" (scheduled at 2024-04-22 03:53:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:53:41,273 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757961272, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:53:41,277 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:53:41,277 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:53:41,277 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:53:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:53:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:39.566970+00:00 (in 58.001468 seconds)
exportactionlogsworker stdout | 2024-04-22 03:53:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:41 UTC)" (scheduled at 2024-04-22 03:53:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:53:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:53:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 53, 41, 565841), True, datetime.datetime(2024, 4, 22, 3, 53, 41, 565841), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:53:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:53:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:53:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:53:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:53:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:22.058978+00:00 (in 39.001322 seconds)
namespacegcworker stdout | 2024-04-22 03:53:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:43 UTC)" (scheduled at 2024-04-22 03:53:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:53:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:53:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 53, 43, 57944), True, datetime.datetime(2024, 4, 22, 3, 53, 43, 57944), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:53:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:53:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:53:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:54:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:53:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:53:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:53:53.759375+00:00 (in 9.999487 seconds)
notificationworker stdout | 2024-04-22 03:53:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:53:53 UTC)" (scheduled at 2024-04-22 03:53:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:53:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:53:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 53, 43, 760150), True, datetime.datetime(2024, 4, 22, 3, 53, 43, 760150), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:53:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:53:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:53:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:53:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:53:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:53:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:14.952062+00:00 (in 29.999537 seconds)
gcworker stdout | 2024-04-22 03:53:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:14 UTC)" (scheduled at 2024-04-22 03:53:44.952062+00:00)
gcworker stdout | 2024-04-22 03:53:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548424952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:53:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:53:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:53:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:53:45,653 [278] [DEBUG] [app] Starting request: urn:request:37b046a1-7b90-47b6-b295-b508d9506f5c (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:53:45,653 [279] [DEBUG] [app] Starting request: urn:request:459efbd3-62ee-4de1-8b63-16d41b379e5f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:53:45,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:53:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:53:45,656 [284] [DEBUG] [app] Starting request: urn:request:47296da3-55e6-42e0-bdee-9a2b3390cfa7 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:53:45,656 [290] [DEBUG] [app] Starting request: urn:request:ca61ebee-440e-4229-97e7-cbf63fb75179 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:53:45,656 [290] [DEBUG] [app] Ending request: urn:request:ca61ebee-440e-4229-97e7-cbf63fb75179 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:ca61ebee-440e-4229-97e7-cbf63fb75179', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:53:45,656 [284] [DEBUG] [app] Ending request: urn:request:47296da3-55e6-42e0-bdee-9a2b3390cfa7 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:47296da3-55e6-42e0-bdee-9a2b3390cfa7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:53:45,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:53:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:53:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:53:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:53:45,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:53:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:53:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:53:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:53:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:53:45,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:53:45,659 [278] [DEBUG] [app] Starting request: urn:request:e2fa388e-de16-410a-a590-ce02df97a099 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:53:45,660 [278] [DEBUG] [app] Ending request: urn:request:e2fa388e-de16-410a-a590-ce02df97a099 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e2fa388e-de16-410a-a590-ce02df97a099', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:53:45,660 [282] [DEBUG] [app] Starting request: urn:request:e7331c95-c7e3-4641-84d7-72f720a7cedb (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:53:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:53:45,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:53:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:53:45,660 [282] [DEBUG] [app] Ending request: urn:request:e7331c95-c7e3-4641-84d7-72f720a7cedb (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e7331c95-c7e3-4641-84d7-72f720a7cedb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:53:45,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:53:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:53:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:53:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:53:45,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:53:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:53:45,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:53:45,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:53:45,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:53:45,674 [278] [DEBUG] [app] Ending request: urn:request:37b046a1-7b90-47b6-b295-b508d9506f5c (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:37b046a1-7b90-47b6-b295-b508d9506f5c', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:53:45,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:53:45,675 [279] [DEBUG] [app] Ending request: urn:request:459efbd3-62ee-4de1-8b63-16d41b379e5f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:459efbd3-62ee-4de1-8b63-16d41b379e5f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:53:45,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:53:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:53:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:53:45,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:53:45,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:53:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:53:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
buildlogsarchiver stdout | 2024-04-22 03:53:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:53:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:17.052354+00:00 (in 29.999415 seconds)
buildlogsarchiver stdout | 2024-04-22 03:53:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:17 UTC)" (scheduled at 2024-04-22 03:53:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:53:47,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 53, 47, 53497), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:53:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:53:47,065 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:53:47,065 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:53:49,481 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:53:51,011 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:53:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:53:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:03.759375+00:00 (in 9.999464 seconds)
notificationworker stdout | 2024-04-22 03:53:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:54:03 UTC)" (scheduled at 2024-04-22 03:53:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:53:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:53:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 53, 53, 760212), True, datetime.datetime(2024, 4, 22, 3, 53, 53, 760212), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:53:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:53:53,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:53:53,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:54:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:53:54,568 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:53:56,214 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:53:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:53:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:05.871852+00:00 (in 8.998157 seconds)
securityworker stdout | 2024-04-22 03:53:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:26 UTC)" (scheduled at 2024-04-22 03:53:56.873109+00:00)
securityworker stdout | 2024-04-22 03:53:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:53:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:53:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:53:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:53:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:53:56,878 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:53:56,878 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:53:56,881 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:53:56,882 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:53:56,892 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:53:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:53:56,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:53:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 48, 56, 882444), 1, 2])
securityworker stdout | 2024-04-22 03:53:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:53:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:53:56,899 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 48, 56, 882444), 1, 2])
securityworker stdout | 2024-04-22 03:53:56,901 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:53:56,901 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:53:56,901 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:53:56,901 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:53:56,901 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:53:56,901 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:53:56,901 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:53:56,902 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:53:56,902 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:53:56,902 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:53:57,694 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:53:59,552 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:53:59,649 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:53:59,883 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:53:59,889 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:53:59,892 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:53:59,894 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:53:59,897 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:54:00,614 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:54:00,653 [281] [DEBUG] [app] Starting request: urn:request:12e63eb3-80cc-429f-baf7-82ed071d7f7d (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:54:00,653 [282] [DEBUG] [app] Starting request: urn:request:ec9a9fd3-4489-4e29-9d32-75470a888729 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:54:00,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:54:00,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:54:00,656 [284] [DEBUG] [app] Starting request: urn:request:cbddb5ff-5943-4057-b1d6-df3e6790169a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:54:00,657 [292] [DEBUG] [app] Starting request: urn:request:d1251087-6009-4049-b80c-1352dbf6a768 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:54:00,657 [284] [DEBUG] [app] Ending request: urn:request:cbddb5ff-5943-4057-b1d6-df3e6790169a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:cbddb5ff-5943-4057-b1d6-df3e6790169a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:54:00,657 [292] [DEBUG] [app] Ending request: urn:request:d1251087-6009-4049-b80c-1352dbf6a768 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:d1251087-6009-4049-b80c-1352dbf6a768', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:54:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:54:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:54:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:54:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:54:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:54:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:54:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:54:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:54:00,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:54:00,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:54:00,659 [281] [DEBUG] [app] Starting request: urn:request:26d160d9-92d7-486f-9013-003d2badf309 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:54:00,660 [281] [DEBUG] [app] Ending request: urn:request:26d160d9-92d7-486f-9013-003d2badf309 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:26d160d9-92d7-486f-9013-003d2badf309', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:54:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:54:00,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:54:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:54:00,660 [278] [DEBUG] [app] Starting request: urn:request:1ace070e-833e-4e77-9dea-78ee1bc97ddf (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:54:00,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:54:00,660 [278] [DEBUG] [app] Ending request: urn:request:1ace070e-833e-4e77-9dea-78ee1bc97ddf (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1ace070e-833e-4e77-9dea-78ee1bc97ddf', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:54:00,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:54:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:54:00,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:54:00,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:54:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:54:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:54:00,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:54:00,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:54:00,675 [281] [DEBUG] [app] Ending request: urn:request:12e63eb3-80cc-429f-baf7-82ed071d7f7d (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:12e63eb3-80cc-429f-baf7-82ed071d7f7d', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:54:00,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:54:00,675 [282] [DEBUG] [app] Ending request: urn:request:ec9a9fd3-4489-4e29-9d32-75470a888729 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:ec9a9fd3-4489-4e29-9d32-75470a888729', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:54:00,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:54:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:54:00,675 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:54:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:54:00,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:54:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:54:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
notificationworker stdout | 2024-04-22 03:54:02,113 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:54:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:54:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:16.552337+00:00 (in 13.995595 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:54:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:02 UTC)" (scheduled at 2024-04-22 03:54:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:54:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:54:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:54:03,363 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:54:03,695 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
notificationworker stdout | 2024-04-22 03:54:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:54:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:13.759375+00:00 (in 9.999487 seconds)
notificationworker stdout | 2024-04-22 03:54:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:54:13 UTC)" (scheduled at 2024-04-22 03:54:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:54:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:54:03,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 54, 3, 760153), True, datetime.datetime(2024, 4, 22, 3, 54, 3, 760153), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:54:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:54:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:54:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:54:13 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:54:03,836 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 03:54:04,504 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:54:04,508 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:54:04,511 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:54:04,919 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:54:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:54:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:26.873109+00:00 (in 21.000628 seconds)
securityworker stdout | 2024-04-22 03:54:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:35 UTC)" (scheduled at 2024-04-22 03:54:05.871852+00:00)
securityworker stdout | 2024-04-22 03:54:05,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:54:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:54:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:54:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:54:05,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:54:05,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:54:05,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:35 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:54:06,064 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:54:06,256 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:54:06,361 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
repositorygcworker stdout | 2024-04-22 03:54:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:54:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:13.555667+00:00 (in 7.002657 seconds)
repositorygcworker stdout | 2024-04-22 03:54:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:06 UTC)" (scheduled at 2024-04-22 03:54:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:54:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:54:06,553 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 54, 6, 553257), True, datetime.datetime(2024, 4, 22, 3, 54, 6, 553257), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:54:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:54:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:54:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:06 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:54:07,290 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
globalpromstats stdout | 2024-04-22 03:54:08,260 [69] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
globalpromstats stdout | 2024-04-22 03:54:08,261 [69] [INFO] [apscheduler.executors.default] Running job "GlobalPrometheusStatsWorker._try_report_stats (trigger: interval[1:00:00], next run at: 2024-04-22 03:54:08 UTC)" (scheduled at 2024-04-22 03:54:08.260282+00:00)
globalpromstats stdout | 2024-04-22 03:54:08,261 [69] [DEBUG] [__main__] Attempting to report stats
globalpromstats stdout | 2024-04-22 03:54:08,261 [69] [DEBUG] [util.locking] Acquiring global lock GLOBAL_PROM_STATS
globalpromstats stdout | 2024-04-22 03:54:08,261 [69] [DEBUG] [redis_lock.acquire] Getting 'lock:GLOBAL_PROM_STATS' ...
globalpromstats stdout | 2024-04-22 03:54:08,262 [69] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:54:08.260282+00:00 (in 3599.998184 seconds)
globalpromstats stdout | 2024-04-22 03:54:08,264 [69] [INFO] [redis_lock.acquire] Got lock for 'lock:GLOBAL_PROM_STATS'.
globalpromstats stdout | 2024-04-22 03:54:08,264 [69] [DEBUG] [util.locking] Acquired lock GLOBAL_PROM_STATS
globalpromstats stdout | 2024-04-22 03:54:08,264 [69] [DEBUG] [__main__] Reporting global stats
globalpromstats stdout | 2024-04-22 03:54:08,265 [69] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT 1 FROM "repository" AS "t1") AS "_wrapped"', [])
globalpromstats stdout | 2024-04-22 03:54:08,275 [69] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT 1 FROM "user" AS "t1" WHERE ((("t1"."organization" = %s) AND ("t1"."robot" = %s)) AND ("t1"."id" NOT IN (SELECT "t2"."namespace_id" FROM "deletednamespace" AS "t2")))) AS "_wrapped"', [False, False])
globalpromstats stdout | 2024-04-22 03:54:08,279 [69] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT 1 FROM "user" AS "t1" WHERE ((("t1"."organization" = %s) AND ("t1"."robot" = %s)) AND ("t1"."enabled" = %s))) AS "_wrapped"', [True, False, True])
globalpromstats stdout | 2024-04-22 03:54:08,281 [69] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT 1 FROM "robotaccounttoken" AS "t1") AS "_wrapped"', [])
globalpromstats stdout | 2024-04-22 03:54:08,283 [69] [DEBUG] [data.database] Disconnecting from database.
globalpromstats stdout | 2024-04-22 03:54:08,283 [69] [DEBUG] [util.locking] Releasing lock GLOBAL_PROM_STATS
globalpromstats stdout | 2024-04-22 03:54:08,283 [69] [DEBUG] [redis_lock.release] Releasing 'lock:GLOBAL_PROM_STATS'.
globalpromstats stdout | 2024-04-22 03:54:08,284 [69] [DEBUG] [util.locking] Released lock GLOBAL_PROM_STATS
globalpromstats stdout | 2024-04-22 03:54:08,284 [69] [INFO] [apscheduler.executors.default] Job "GlobalPrometheusStatsWorker._try_report_stats (trigger: interval[1:00:00], next run at: 2024-04-22 04:54:08 UTC)" executed successfully
securityworker stdout | 2024-04-22 03:54:08,623 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:54:08,750 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:54:09,105 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:54:09,179 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
storagereplication stdout | 2024-04-22 03:54:10,379 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:54:10,748 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:54:10,757 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:54:10,760 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:54:10,762 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:54:10,766 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:54:10,769 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:54:10,771 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:54:10,776 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:54:10,778 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:54:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:54:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:41.264267+00:00 (in 29.999458 seconds)
autopruneworker stdout | 2024-04-22 03:54:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:41 UTC)" (scheduled at 2024-04-22 03:54:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:54:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713757991272, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:54:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:54:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:54:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:54:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:54:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:06.552482+00:00 (in 52.996309 seconds)
repositorygcworker stdout | 2024-04-22 03:54:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:13 UTC)" (scheduled at 2024-04-22 03:54:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:54:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:54:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:54:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:54:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:19.762424+00:00 (in 6.002533 seconds)
notificationworker stdout | 2024-04-22 03:54:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:54:23 UTC)" (scheduled at 2024-04-22 03:54:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:54:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:54:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 54, 13, 760153), True, datetime.datetime(2024, 4, 22, 3, 54, 13, 760153), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:54:13,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:54:13,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:54:13,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:54:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:54:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:54:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:44.952062+00:00 (in 29.999490 seconds)
gcworker stdout | 2024-04-22 03:54:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:44 UTC)" (scheduled at 2024-04-22 03:54:14.952062+00:00)
gcworker stdout | 2024-04-22 03:54:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548454952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:54:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:54:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:54:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:54:15,653 [282] [DEBUG] [app] Starting request: urn:request:82799898-1c57-4e5d-956c-977583e119db (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:54:15,653 [281] [DEBUG] [app] Starting request: urn:request:ef6263c9-2293-465c-9660-fe47a06481f8 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:54:15,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:54:15,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:54:15,656 [291] [DEBUG] [app] Starting request: urn:request:fedb1fad-c09f-4311-997e-e6cecc1b15b9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:54:15,657 [288] [DEBUG] [app] Starting request: urn:request:5c0eb94a-60e3-4926-b459-551eb6602dbe (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:54:15,657 [291] [DEBUG] [app] Ending request: urn:request:fedb1fad-c09f-4311-997e-e6cecc1b15b9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:fedb1fad-c09f-4311-997e-e6cecc1b15b9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:54:15,657 [288] [DEBUG] [app] Ending request: urn:request:5c0eb94a-60e3-4926-b459-551eb6602dbe (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5c0eb94a-60e3-4926-b459-551eb6602dbe', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:54:15,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:54:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:54:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:54:15,657 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:54:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:54:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:54:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:54:15,658 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:54:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:54:15,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:54:15,660 [282] [DEBUG] [app] Starting request: urn:request:36927773-fc6f-4354-8209-3f334727d442 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:54:15,660 [278] [DEBUG] [app] Starting request: urn:request:741d9adc-d18b-4c74-9493-c5a4fe112fcd (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:54:15,660 [282] [DEBUG] [app] Ending request: urn:request:36927773-fc6f-4354-8209-3f334727d442 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:36927773-fc6f-4354-8209-3f334727d442', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:54:15,660 [278] [DEBUG] [app] Ending request: urn:request:741d9adc-d18b-4c74-9493-c5a4fe112fcd (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:741d9adc-d18b-4c74-9493-c5a4fe112fcd', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:54:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:54:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:54:15,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:54:15,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:54:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:54:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:54:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:54:15,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:54:15,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:54:15,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:54:15,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:54:15,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:54:15,675 [281] [DEBUG] [app] Ending request: urn:request:ef6263c9-2293-465c-9660-fe47a06481f8 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:ef6263c9-2293-465c-9660-fe47a06481f8', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:54:15,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:54:15,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:54:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:54:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 03:54:15,681 [282] [DEBUG] [app] Ending request: urn:request:82799898-1c57-4e5d-956c-977583e119db (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:82799898-1c57-4e5d-956c-977583e119db', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:54:15,681 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:54:15,681 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:54:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:54:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.029 118 0.029)
securityscanningnotificationworker stdout | 2024-04-22 03:54:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:54:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:02.556208+00:00 (in 46.003255 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:54:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:16 UTC)" (scheduled at 2024-04-22 03:54:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:54:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:54:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 54, 16, 553421), True, datetime.datetime(2024, 4, 22, 3, 54, 16, 553421), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:54:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:54:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:54:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:54:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:54:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:47.052354+00:00 (in 29.999444 seconds)
buildlogsarchiver stdout | 2024-04-22 03:54:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:47 UTC)" (scheduled at 2024-04-22 03:54:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:54:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 54, 17, 53266), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:54:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:54:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:54:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:54:19,502 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:54:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:54:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:23.759375+00:00 (in 3.996409 seconds)
notificationworker stdout | 2024-04-22 03:54:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:19 UTC)" (scheduled at 2024-04-22 03:54:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:54:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:54:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:54:21,024 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:54:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:54:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:43.057186+00:00 (in 20.997687 seconds)
namespacegcworker stdout | 2024-04-22 03:54:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:22 UTC)" (scheduled at 2024-04-22 03:54:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:54:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:54:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:54:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:54:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:33.759375+00:00 (in 9.999460 seconds)
notificationworker stdout | 2024-04-22 03:54:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:54:33 UTC)" (scheduled at 2024-04-22 03:54:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:54:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:54:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 54, 23, 760388), True, datetime.datetime(2024, 4, 22, 3, 54, 23, 760388), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:54:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:54:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:54:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:54:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 03:54:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:54:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:24.361582+00:00 (in 59.999469 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:54:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:24 UTC)" (scheduled at 2024-04-22 03:54:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:54:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:54:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:54:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:24 UTC)" executed successfully
builder stdout | 2024-04-22 03:54:24,587 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:54:26,251 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:54:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:54:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:35.871852+00:00 (in 8.998147 seconds)
securityworker stdout | 2024-04-22 03:54:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:56 UTC)" (scheduled at 2024-04-22 03:54:26.873109+00:00)
securityworker stdout | 2024-04-22 03:54:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:54:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:54:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:54:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:54:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:54:26,878 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:54:26,878 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:54:26,881 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:54:26,882 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:54:26,892 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:54:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:54:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:54:26,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 49, 26, 882489), 1, 2])
securityworker stdout | 2024-04-22 03:54:26,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:54:26,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:54:26,898 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 49, 26, 882489), 1, 2])
securityworker stdout | 2024-04-22 03:54:26,900 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:54:26,900 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:54:26,900 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:54:26,901 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:54:26,901 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:54:26,901 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:54:26,901 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:54:26,902 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:54:26,902 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:54:26,902 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:54:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:54:27,731 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:54:29,568 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:54:29,684 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:54:29,890 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:54:29,897 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:54:29,900 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:54:29,902 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:54:29,905 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
quotaregistrysizeworker stdout | 2024-04-22 03:54:30,644 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 03:54:30,653 [282] [DEBUG] [app] Starting request: urn:request:cd7880f7-b949-4f26-9fc4-ff7ba79ea3f2 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:54:30,653 [279] [DEBUG] [app] Starting request: urn:request:46cb1c11-128d-49b8-9181-5bd871239ddf (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:54:30,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:54:30,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:54:30,656 [291] [DEBUG] [app] Starting request: urn:request:f0d174cf-baeb-4f02-bb9b-0bf2237239f8 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:54:30,656 [290] [DEBUG] [app] Starting request: urn:request:714a81fd-25e1-49bc-8c73-818bb3ed401b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:54:30,656 [290] [DEBUG] [app] Ending request: urn:request:714a81fd-25e1-49bc-8c73-818bb3ed401b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:714a81fd-25e1-49bc-8c73-818bb3ed401b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:54:30,656 [291] [DEBUG] [app] Ending request: urn:request:f0d174cf-baeb-4f02-bb9b-0bf2237239f8 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f0d174cf-baeb-4f02-bb9b-0bf2237239f8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:54:30,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:54:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:54:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:54:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:54:30,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:54:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:54:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:54:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:54:30,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:54:30,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:54:30,659 [282] [DEBUG] [app] Starting request: urn:request:f35b8b54-ee68-4739-91ae-50bd6a8822ca (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:54:30,660 [281] [DEBUG] [app] Starting request: urn:request:a839fbbb-4e0f-4b8e-b3dd-b18b497311f7 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:54:30,660 [282] [DEBUG] [app] Ending request: urn:request:f35b8b54-ee68-4739-91ae-50bd6a8822ca (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:f35b8b54-ee68-4739-91ae-50bd6a8822ca', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:54:30,660 [281] [DEBUG] [app] Ending request: urn:request:a839fbbb-4e0f-4b8e-b3dd-b18b497311f7 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a839fbbb-4e0f-4b8e-b3dd-b18b497311f7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:54:30,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:54:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:54:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:54:30,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:54:30,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:54:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:54:30,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:54:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:54:30,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:54:30,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:54:30,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:54:30,669 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:54:30,674 [279] [DEBUG] [app] Ending request: urn:request:46cb1c11-128d-49b8-9181-5bd871239ddf (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:46cb1c11-128d-49b8-9181-5bd871239ddf', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:54:30,674 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:54:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 03:54:30,674 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:54:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:54:30,676 [282] [DEBUG] [app] Ending request: urn:request:cd7880f7-b949-4f26-9fc4-ff7ba79ea3f2 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:cd7880f7-b949-4f26-9fc4-ff7ba79ea3f2', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:54:30,677 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:54:30,677 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:54:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:54:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
notificationworker stdout | 2024-04-22 03:54:32,150 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:54:33,392 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 03:54:33,726 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
notificationworker stdout | 2024-04-22 03:54:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:54:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:43.759375+00:00 (in 9.999470 seconds)
notificationworker stdout | 2024-04-22 03:54:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:54:43 UTC)" (scheduled at 2024-04-22 03:54:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:54:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:54:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 54, 33, 760205), True, datetime.datetime(2024, 4, 22, 3, 54, 33, 760205), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:54:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:54:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:54:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:54:43 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:54:33,873 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 03:54:34,512 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:54:34,516 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:54:34,519 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:54:34,955 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:54:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:54:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:56.873109+00:00 (in 21.000484 seconds)
securityworker stdout | 2024-04-22 03:54:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:05 UTC)" (scheduled at 2024-04-22 03:54:35.871852+00:00)
securityworker stdout | 2024-04-22 03:54:35,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:54:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:54:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:54:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:54:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:54:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:54:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:54:36,101 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:54:36,287 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:54:36,397 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 03:54:37,327 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:54:38,657 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:54:38,757 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:54:39,141 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:54:39,187 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
exportactionlogsworker stdout | 2024-04-22 03:54:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:54:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:41.564959+00:00 (in 1.997450 seconds)
exportactionlogsworker stdout | 2024-04-22 03:54:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:39 UTC)" (scheduled at 2024-04-22 03:54:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:54:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:54:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:54:40,415 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:54:40,757 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:54:40,765 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:54:40,767 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:54:40,771 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:54:40,776 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:54:40,780 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:54:40,782 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:54:40,786 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:54:40,788 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:54:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:54:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:11.264267+00:00 (in 29.999495 seconds)
autopruneworker stdout | 2024-04-22 03:54:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:11 UTC)" (scheduled at 2024-04-22 03:54:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:54:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758021271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:54:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:54:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:54:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:54:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:54:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:39.566970+00:00 (in 58.001515 seconds)
exportactionlogsworker stdout | 2024-04-22 03:54:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:41 UTC)" (scheduled at 2024-04-22 03:54:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:54:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:54:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 54, 41, 565858), True, datetime.datetime(2024, 4, 22, 3, 54, 41, 565858), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:54:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:54:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:54:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:54:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:54:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:22.058978+00:00 (in 39.001323 seconds)
namespacegcworker stdout | 2024-04-22 03:54:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:43 UTC)" (scheduled at 2024-04-22 03:54:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:54:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:54:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 54, 43, 57921), True, datetime.datetime(2024, 4, 22, 3, 54, 43, 57921), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:54:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:54:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:54:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:55:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:54:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:54:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:54:53.759375+00:00 (in 9.999525 seconds)
notificationworker stdout | 2024-04-22 03:54:43,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:54:53 UTC)" (scheduled at 2024-04-22 03:54:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:54:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:54:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 54, 43, 760101), True, datetime.datetime(2024, 4, 22, 3, 54, 43, 760101), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:54:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:54:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:54:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:54:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:54:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:54:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:14.952062+00:00 (in 29.999497 seconds)
gcworker stdout | 2024-04-22 03:54:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:14 UTC)" (scheduled at 2024-04-22 03:54:44.952062+00:00)
gcworker stdout | 2024-04-22 03:54:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548484952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:54:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:54:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:54:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:54:45,653 [278] [DEBUG] [app] Starting request: urn:request:a5b0b7b9-2af4-400b-9cdc-b339257f4c29 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:54:45,653 [281] [DEBUG] [app] Starting request: urn:request:88d94528-e402-4720-9647-16ead0d897c1 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:54:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:54:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:54:45,656 [292] [DEBUG] [app] Starting request: urn:request:8a850807-1a89-4125-bdff-d0bfcbfb2860 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:54:45,656 [284] [DEBUG] [app] Starting request: urn:request:c711be6e-d811-4550-bcc6-50366ec55a56 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:54:45,656 [292] [DEBUG] [app] Ending request: urn:request:8a850807-1a89-4125-bdff-d0bfcbfb2860 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:8a850807-1a89-4125-bdff-d0bfcbfb2860', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:54:45,656 [284] [DEBUG] [app] Ending request: urn:request:c711be6e-d811-4550-bcc6-50366ec55a56 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:c711be6e-d811-4550-bcc6-50366ec55a56', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:54:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:54:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:54:45,656 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:54:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:54:45,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:54:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:54:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:54:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:54:45,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:54:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:54:45,659 [281] [DEBUG] [app] Starting request: urn:request:13d2eab0-81cf-49d7-b7f9-153d48f0f30d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:54:45,659 [281] [DEBUG] [app] Ending request: urn:request:13d2eab0-81cf-49d7-b7f9-153d48f0f30d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:13d2eab0-81cf-49d7-b7f9-153d48f0f30d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:54:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:54:45,659 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:54:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:54:45,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:54:45,660 [279] [DEBUG] [app] Starting request: urn:request:2bfb8ea0-3257-4451-8ab2-108ae1ad5039 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:54:45,660 [279] [DEBUG] [app] Ending request: urn:request:2bfb8ea0-3257-4451-8ab2-108ae1ad5039 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:2bfb8ea0-3257-4451-8ab2-108ae1ad5039', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:54:45,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:54:45,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:54:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:54:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:54:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:54:45,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:54:45,665 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:54:45,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:54:45,673 [281] [DEBUG] [app] Ending request: urn:request:88d94528-e402-4720-9647-16ead0d897c1 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:88d94528-e402-4720-9647-16ead0d897c1', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:54:45,673 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:54:45,673 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:54:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:54:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.021 118 0.021)
gunicorn-web stdout | 2024-04-22 03:54:45,674 [278] [DEBUG] [app] Ending request: urn:request:a5b0b7b9-2af4-400b-9cdc-b339257f4c29 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a5b0b7b9-2af4-400b-9cdc-b339257f4c29', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:54:45,674 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:54:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 03:54:45,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:54:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
buildlogsarchiver stdout | 2024-04-22 03:54:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:54:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:17.052354+00:00 (in 29.999401 seconds)
buildlogsarchiver stdout | 2024-04-22 03:54:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:17 UTC)" (scheduled at 2024-04-22 03:54:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:54:47,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 54, 47, 53360), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:54:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:54:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:54:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:54:49,520 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:54:51,032 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:54:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:54:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:03.759375+00:00 (in 9.999504 seconds)
notificationworker stdout | 2024-04-22 03:54:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:55:03 UTC)" (scheduled at 2024-04-22 03:54:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:54:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:54:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 54, 53, 760209), True, datetime.datetime(2024, 4, 22, 3, 54, 53, 760209), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:54:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:54:53,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:54:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:55:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:54:54,616 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:54:56,287 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:54:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:54:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:05.871852+00:00 (in 8.998141 seconds)
securityworker stdout | 2024-04-22 03:54:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:26 UTC)" (scheduled at 2024-04-22 03:54:56.873109+00:00)
securityworker stdout | 2024-04-22 03:54:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:54:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:54:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:54:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:54:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:54:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:54:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:54:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:54:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:54:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:54:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:54:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:54:56,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 49, 56, 881305), 1, 2])
securityworker stdout | 2024-04-22 03:54:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:54:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:54:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 49, 56, 881305), 1, 2])
securityworker stdout | 2024-04-22 03:54:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:54:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:54:56,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:54:56,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:54:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:54:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:54:56,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:54:56,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:54:56,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:54:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:54:57,767 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:54:59,604 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:54:59,721 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:54:59,898 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:54:59,906 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:54:59,908 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:54:59,911 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:54:59,913 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 03:55:00,653 [281] [DEBUG] [app] Starting request: urn:request:780aa401-fcd0-4e33-9c20-7c3fed7bb6f7 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:55:00,653 [278] [DEBUG] [app] Starting request: urn:request:2ff32165-fc15-43a8-943a-e99bce318f7d (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:55:00,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:55:00,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:55:00,656 [284] [DEBUG] [app] Starting request: urn:request:a1f308a3-7232-495a-98e6-c26c8d2024da (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:55:00,656 [284] [DEBUG] [app] Ending request: urn:request:a1f308a3-7232-495a-98e6-c26c8d2024da (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:a1f308a3-7232-495a-98e6-c26c8d2024da', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:55:00,656 [292] [DEBUG] [app] Starting request: urn:request:55af4a90-dd87-4ddd-80ac-ab2e66ba97af (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:55:00,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:55:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:55:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:55:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 03:55:00,657 [292] [DEBUG] [app] Ending request: urn:request:55af4a90-dd87-4ddd-80ac-ab2e66ba97af (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:55af4a90-dd87-4ddd-80ac-ab2e66ba97af', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:55:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:55:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:55:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:55:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:55:00,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:55:00,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:55:00,659 [279] [DEBUG] [app] Starting request: urn:request:f310d583-ee6f-4a1e-8a6f-5534dfc30a4d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:55:00,659 [279] [DEBUG] [app] Ending request: urn:request:f310d583-ee6f-4a1e-8a6f-5534dfc30a4d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:f310d583-ee6f-4a1e-8a6f-5534dfc30a4d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:55:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:55:00,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:55:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:55:00,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:55:00,660 [282] [DEBUG] [app] Starting request: urn:request:40bd1da7-bc8c-46e1-b610-6cb577a33c82 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:55:00,660 [282] [DEBUG] [app] Ending request: urn:request:40bd1da7-bc8c-46e1-b610-6cb577a33c82 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:40bd1da7-bc8c-46e1-b610-6cb577a33c82', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:55:00,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:55:00,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:55:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:55:00,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:55:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 03:55:00,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:55:00,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:55:00,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:55:00,674 [281] [DEBUG] [app] Ending request: urn:request:780aa401-fcd0-4e33-9c20-7c3fed7bb6f7 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:780aa401-fcd0-4e33-9c20-7c3fed7bb6f7', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:55:00,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:55:00,675 [278] [DEBUG] [app] Ending request: urn:request:2ff32165-fc15-43a8-943a-e99bce318f7d (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2ff32165-fc15-43a8-943a-e99bce318f7d', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:55:00,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:55:00,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:55:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:55:00,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:55:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:55:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:55:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotaregistrysizeworker stdout | 2024-04-22 03:55:00,679 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 03:55:02,158 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:55:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:55:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:16.552337+00:00 (in 13.995577 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:55:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:02 UTC)" (scheduled at 2024-04-22 03:55:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:55:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:55:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:55:03,415 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
notificationworker stdout | 2024-04-22 03:55:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:55:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:13.759375+00:00 (in 9.999513 seconds)
notificationworker stdout | 2024-04-22 03:55:03,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:55:13 UTC)" (scheduled at 2024-04-22 03:55:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:55:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:55:03,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 55, 3, 760122), True, datetime.datetime(2024, 4, 22, 3, 55, 3, 760122), 0, 'notification/%', 50, 1, 0])
gcworker stdout | 2024-04-22 03:55:03,762 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
notificationworker stdout | 2024-04-22 03:55:03,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:55:03,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:55:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:55:13 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:55:03,909 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 03:55:04,519 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:55:04,524 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:55:04,527 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:55:04,992 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:55:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:55:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:26.873109+00:00 (in 21.000645 seconds)
securityworker stdout | 2024-04-22 03:55:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:35 UTC)" (scheduled at 2024-04-22 03:55:05.871852+00:00)
securityworker stdout | 2024-04-22 03:55:05,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:55:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:55:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:55:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:55:05,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:55:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:55:05,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:35 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:55:06,138 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:55:06,300 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:55:06,433 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
repositorygcworker stdout | 2024-04-22 03:55:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:55:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:13.555667+00:00 (in 7.002673 seconds)
repositorygcworker stdout | 2024-04-22 03:55:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:06 UTC)" (scheduled at 2024-04-22 03:55:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:55:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:55:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 55, 6, 553284), True, datetime.datetime(2024, 4, 22, 3, 55, 6, 553284), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:55:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:55:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:55:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:06 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:55:07,350 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:55:08,693 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:55:08,794 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:55:09,168 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:55:09,204 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
storagereplication stdout | 2024-04-22 03:55:10,452 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:55:10,770 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:55:10,773 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:55:10,779 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:55:10,782 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:55:10,786 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:55:10,789 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:55:10,791 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:55:10,795 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:55:10,797 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:55:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:55:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:41.264267+00:00 (in 29.999452 seconds)
autopruneworker stdout | 2024-04-22 03:55:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:41 UTC)" (scheduled at 2024-04-22 03:55:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:55:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758051271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:55:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:55:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:55:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:55:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:55:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:06.552482+00:00 (in 52.996271 seconds)
repositorygcworker stdout | 2024-04-22 03:55:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:13 UTC)" (scheduled at 2024-04-22 03:55:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:55:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:55:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:55:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:55:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:19.762424+00:00 (in 6.002562 seconds)
notificationworker stdout | 2024-04-22 03:55:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:55:23 UTC)" (scheduled at 2024-04-22 03:55:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:55:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:55:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 55, 13, 760118), True, datetime.datetime(2024, 4, 22, 3, 55, 13, 760118), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:55:13,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:55:13,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:55:13,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:55:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:55:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:55:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:44.952062+00:00 (in 29.999526 seconds)
gcworker stdout | 2024-04-22 03:55:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:44 UTC)" (scheduled at 2024-04-22 03:55:14.952062+00:00)
gcworker stdout | 2024-04-22 03:55:14,953 [68] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."removed_tag_expiration_s" FROM "user" AS "t1" LIMIT %s', [100])
gcworker stdout | 2024-04-22 03:55:14,963 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548514962, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:55:14,967 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:55:14,967 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:55:14,967 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:55:15,652 [282] [DEBUG] [app] Starting request: urn:request:c533a30b-d27b-433f-8415-3a658bcf5603 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:55:15,652 [278] [DEBUG] [app] Starting request: urn:request:a9c01b92-ab75-4442-8b1c-09187819b145 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:55:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:55:15,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:55:15,655 [291] [DEBUG] [app] Starting request: urn:request:81dea8d0-6e33-4ebb-bdcd-33f373f2bc0c (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:55:15,655 [284] [DEBUG] [app] Starting request: urn:request:74cae8db-c0ac-410b-86ee-cdd2b0751a89 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:55:15,656 [291] [DEBUG] [app] Ending request: urn:request:81dea8d0-6e33-4ebb-bdcd-33f373f2bc0c (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:81dea8d0-6e33-4ebb-bdcd-33f373f2bc0c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:55:15,656 [284] [DEBUG] [app] Ending request: urn:request:74cae8db-c0ac-410b-86ee-cdd2b0751a89 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:74cae8db-c0ac-410b-86ee-cdd2b0751a89', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:55:15,656 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:55:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:55:15,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:55:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:55:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:55:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:55:15,656 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:55:15,656 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:55:15,657 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:55:15,657 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:55:15,659 [282] [DEBUG] [app] Starting request: urn:request:1f531983-be0f-490b-b6eb-f92220c0daa1 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:55:15,659 [281] [DEBUG] [app] Starting request: urn:request:f7f2536a-ba4a-4ce1-a562-7b26672d7d5a (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:55:15,659 [282] [DEBUG] [app] Ending request: urn:request:1f531983-be0f-490b-b6eb-f92220c0daa1 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1f531983-be0f-490b-b6eb-f92220c0daa1', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:55:15,659 [281] [DEBUG] [app] Ending request: urn:request:f7f2536a-ba4a-4ce1-a562-7b26672d7d5a (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:f7f2536a-ba4a-4ce1-a562-7b26672d7d5a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:55:15,659 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:55:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:55:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:55:15,659 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:55:15,659 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:55:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:55:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:55:15,659 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:55:15,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:55:15,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:55:15,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:55:15,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:55:15,673 [278] [DEBUG] [app] Ending request: urn:request:a9c01b92-ab75-4442-8b1c-09187819b145 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a9c01b92-ab75-4442-8b1c-09187819b145', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:55:15,673 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:55:15,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:55:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:55:15,674 [282] [DEBUG] [app] Ending request: urn:request:c533a30b-d27b-433f-8415-3a658bcf5603 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:c533a30b-d27b-433f-8415-3a658bcf5603', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:55:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.023)
gunicorn-web stdout | 2024-04-22 03:55:15,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:55:15,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:55:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:55:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
securityscanningnotificationworker stdout | 2024-04-22 03:55:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:55:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:02.556208+00:00 (in 46.003288 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:55:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:16 UTC)" (scheduled at 2024-04-22 03:55:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:55:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:55:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 55, 16, 553353), True, datetime.datetime(2024, 4, 22, 3, 55, 16, 553353), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:55:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:55:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:55:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:55:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:55:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:47.052354+00:00 (in 29.999406 seconds)
buildlogsarchiver stdout | 2024-04-22 03:55:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:47 UTC)" (scheduled at 2024-04-22 03:55:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:55:17,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 55, 17, 53205), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:55:17,071 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:55:17,071 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:55:17,071 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:55:19,557 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:55:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:55:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:23.759375+00:00 (in 3.996447 seconds)
notificationworker stdout | 2024-04-22 03:55:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:19 UTC)" (scheduled at 2024-04-22 03:55:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:55:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:55:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:55:21,057 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:55:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:55:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:43.057186+00:00 (in 20.997721 seconds)
namespacegcworker stdout | 2024-04-22 03:55:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:22 UTC)" (scheduled at 2024-04-22 03:55:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:55:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:55:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:55:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:55:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:33.759375+00:00 (in 9.999491 seconds)
notificationworker stdout | 2024-04-22 03:55:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:55:33 UTC)" (scheduled at 2024-04-22 03:55:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:55:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:55:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 55, 23, 760279), True, datetime.datetime(2024, 4, 22, 3, 55, 23, 760279), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:55:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:55:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:55:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:55:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 03:55:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:55:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:24.361582+00:00 (in 59.999481 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:55:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:24 UTC)" (scheduled at 2024-04-22 03:55:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:55:24,363 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:55:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:55:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:24 UTC)" executed successfully
builder stdout | 2024-04-22 03:55:24,643 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:55:26,311 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:55:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:55:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:35.871852+00:00 (in 8.998145 seconds)
securityworker stdout | 2024-04-22 03:55:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:56 UTC)" (scheduled at 2024-04-22 03:55:26.873109+00:00)
securityworker stdout | 2024-04-22 03:55:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:55:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:55:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:55:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:55:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:55:26,878 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:55:26,878 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:55:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:55:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:55:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:55:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:55:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:55:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 50, 26, 881474), 1, 2])
securityworker stdout | 2024-04-22 03:55:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:55:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:55:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 50, 26, 881474), 1, 2])
securityworker stdout | 2024-04-22 03:55:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:55:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:55:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:55:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:55:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:55:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:55:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:55:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:55:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:55:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:55:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:55:27,776 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:55:29,614 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:55:29,757 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:55:29,908 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:55:29,913 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:55:29,915 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:55:29,918 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:55:29,920 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 03:55:30,653 [282] [DEBUG] [app] Starting request: urn:request:0b40e6ec-5fbf-414b-bd5d-35eb8a1373ec (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:55:30,653 [278] [DEBUG] [app] Starting request: urn:request:0aa717d4-6bd4-4603-a48f-7ac2fd95622f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:55:30,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:55:30,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:55:30,656 [291] [DEBUG] [app] Starting request: urn:request:b8585883-d716-4b9e-97c0-4aac94bdb332 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:55:30,657 [292] [DEBUG] [app] Starting request: urn:request:4892994a-6344-4670-810f-479eba2f21ec (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:55:30,657 [291] [DEBUG] [app] Ending request: urn:request:b8585883-d716-4b9e-97c0-4aac94bdb332 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b8585883-d716-4b9e-97c0-4aac94bdb332', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:55:30,657 [292] [DEBUG] [app] Ending request: urn:request:4892994a-6344-4670-810f-479eba2f21ec (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:4892994a-6344-4670-810f-479eba2f21ec', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:55:30,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:55:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:55:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:55:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:55:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:55:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:55:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:55:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:55:30,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:55:30,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:55:30,660 [282] [DEBUG] [app] Starting request: urn:request:c92f48c1-d4ab-40ef-bc64-e3854aa5eff2 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:55:30,660 [282] [DEBUG] [app] Ending request: urn:request:c92f48c1-d4ab-40ef-bc64-e3854aa5eff2 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:c92f48c1-d4ab-40ef-bc64-e3854aa5eff2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:55:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:55:30,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:55:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:55:30,660 [281] [DEBUG] [app] Starting request: urn:request:6230ca6d-a120-42fc-94d0-c59f3cfa1307 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:55:30,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:55:30,661 [281] [DEBUG] [app] Ending request: urn:request:6230ca6d-a120-42fc-94d0-c59f3cfa1307 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:6230ca6d-a120-42fc-94d0-c59f3cfa1307', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:55:30,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:55:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:55:30,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:55:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:55:30,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:55:30,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:55:30,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:55:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:55:30,674 [282] [DEBUG] [app] Ending request: urn:request:0b40e6ec-5fbf-414b-bd5d-35eb8a1373ec (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:0b40e6ec-5fbf-414b-bd5d-35eb8a1373ec', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:55:30,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:55:30,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:55:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:55:30,675 [278] [DEBUG] [app] Ending request: urn:request:0aa717d4-6bd4-4603-a48f-7ac2fd95622f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:0aa717d4-6bd4-4603-a48f-7ac2fd95622f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:55:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 03:55:30,675 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:55:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:55:30,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:55:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotaregistrysizeworker stdout | 2024-04-22 03:55:30,707 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 03:55:32,191 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:55:33,452 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
notificationworker stdout | 2024-04-22 03:55:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:55:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:43.759375+00:00 (in 9.999439 seconds)
notificationworker stdout | 2024-04-22 03:55:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:55:43 UTC)" (scheduled at 2024-04-22 03:55:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:55:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:55:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 55, 33, 760279), True, datetime.datetime(2024, 4, 22, 3, 55, 33, 760279), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:55:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:55:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:55:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:55:43 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:55:33,798 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:55:33,928 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 03:55:34,526 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:55:34,533 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:55:34,535 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:55:35,027 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:55:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:55:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:56.873109+00:00 (in 21.000630 seconds)
securityworker stdout | 2024-04-22 03:55:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:05 UTC)" (scheduled at 2024-04-22 03:55:35.871852+00:00)
securityworker stdout | 2024-04-22 03:55:35,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:55:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:55:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:55:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:55:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:55:35,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:55:35,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:55:36,174 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:55:36,337 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:55:36,460 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 03:55:37,366 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:55:38,729 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:55:38,803 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:55:39,184 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:55:39,218 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
exportactionlogsworker stdout | 2024-04-22 03:55:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:55:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:41.564959+00:00 (in 1.997464 seconds)
exportactionlogsworker stdout | 2024-04-22 03:55:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:39 UTC)" (scheduled at 2024-04-22 03:55:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:55:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:55:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:55:40,469 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:55:40,781 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:55:40,784 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:55:40,788 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:55:40,790 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:55:40,797 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:55:40,800 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:55:40,803 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:55:40,805 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 03:55:40,808 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
autopruneworker stdout | 2024-04-22 03:55:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:55:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:11.264267+00:00 (in 29.999467 seconds)
autopruneworker stdout | 2024-04-22 03:55:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:11 UTC)" (scheduled at 2024-04-22 03:55:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:55:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758081271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:55:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:55:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:55:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:55:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:55:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:39.566970+00:00 (in 58.001472 seconds)
exportactionlogsworker stdout | 2024-04-22 03:55:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:41 UTC)" (scheduled at 2024-04-22 03:55:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:55:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:55:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 55, 41, 565775), True, datetime.datetime(2024, 4, 22, 3, 55, 41, 565775), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:55:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:55:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:55:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:55:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:55:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:22.058978+00:00 (in 39.001304 seconds)
namespacegcworker stdout | 2024-04-22 03:55:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:43 UTC)" (scheduled at 2024-04-22 03:55:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:55:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:55:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 55, 43, 57995), True, datetime.datetime(2024, 4, 22, 3, 55, 43, 57995), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:55:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:55:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:55:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:56:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:55:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:55:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:55:53.759375+00:00 (in 9.999477 seconds)
notificationworker stdout | 2024-04-22 03:55:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:55:53 UTC)" (scheduled at 2024-04-22 03:55:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:55:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:55:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 55, 43, 760289), True, datetime.datetime(2024, 4, 22, 3, 55, 43, 760289), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:55:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:55:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:55:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:55:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:55:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:55:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:14.952062+00:00 (in 29.999527 seconds)
gcworker stdout | 2024-04-22 03:55:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:14 UTC)" (scheduled at 2024-04-22 03:55:44.952062+00:00)
gcworker stdout | 2024-04-22 03:55:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548544952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:55:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:55:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:55:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:55:45,653 [282] [DEBUG] [app] Starting request: urn:request:d87b8010-adf1-4cb8-976e-1f09e451f3ac (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:55:45,653 [278] [DEBUG] [app] Starting request: urn:request:bac9fbd1-b937-487a-8439-9f85889618c5 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:55:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:55:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:55:45,656 [292] [DEBUG] [app] Starting request: urn:request:5bdb1951-9e99-4656-8b33-c911711e4863 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:55:45,656 [291] [DEBUG] [app] Starting request: urn:request:fdad24aa-bbaa-4781-ab02-8326b6911dc2 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:55:45,656 [292] [DEBUG] [app] Ending request: urn:request:5bdb1951-9e99-4656-8b33-c911711e4863 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5bdb1951-9e99-4656-8b33-c911711e4863', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:55:45,657 [291] [DEBUG] [app] Ending request: urn:request:fdad24aa-bbaa-4781-ab02-8326b6911dc2 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:fdad24aa-bbaa-4781-ab02-8326b6911dc2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:55:45,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:55:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:55:45,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:55:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:55:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:55:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:55:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:55:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
gunicorn-web stdout | 2024-04-22 03:55:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:55:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:55:45,659 [278] [DEBUG] [app] Starting request: urn:request:3ab27539-dafc-4a4c-8056-f7599321cf77 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:55:45,659 [282] [DEBUG] [app] Starting request: urn:request:a3386b9a-5c6e-45fa-b0a3-427af71ad521 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:55:45,660 [278] [DEBUG] [app] Ending request: urn:request:3ab27539-dafc-4a4c-8056-f7599321cf77 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3ab27539-dafc-4a4c-8056-f7599321cf77', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:55:45,660 [282] [DEBUG] [app] Ending request: urn:request:a3386b9a-5c6e-45fa-b0a3-427af71ad521 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a3386b9a-5c6e-45fa-b0a3-427af71ad521', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:55:45,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:55:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:55:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:55:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:55:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:55:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:55:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:55:45,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:55:45,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:55:45,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:55:45,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:55:45,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:55:45,674 [282] [DEBUG] [app] Ending request: urn:request:d87b8010-adf1-4cb8-976e-1f09e451f3ac (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:d87b8010-adf1-4cb8-976e-1f09e451f3ac', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:55:45,674 [278] [DEBUG] [app] Ending request: urn:request:bac9fbd1-b937-487a-8439-9f85889618c5 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:bac9fbd1-b937-487a-8439-9f85889618c5', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:55:45,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:55:45,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:55:45,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:55:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:55:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:55:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:55:45,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:55:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
buildlogsarchiver stdout | 2024-04-22 03:55:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:55:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:17.052354+00:00 (in 29.999410 seconds)
buildlogsarchiver stdout | 2024-04-22 03:55:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:17 UTC)" (scheduled at 2024-04-22 03:55:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:55:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 55, 47, 53224), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:55:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:55:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:55:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:55:49,568 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:55:51,090 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:55:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:55:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:03.759375+00:00 (in 9.999438 seconds)
notificationworker stdout | 2024-04-22 03:55:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:56:03 UTC)" (scheduled at 2024-04-22 03:55:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:55:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:55:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 55, 53, 760292), True, datetime.datetime(2024, 4, 22, 3, 55, 53, 760292), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:55:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:55:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:55:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:56:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:55:54,678 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:55:56,342 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:55:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:55:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:05.871852+00:00 (in 8.998193 seconds)
securityworker stdout | 2024-04-22 03:55:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:26 UTC)" (scheduled at 2024-04-22 03:55:56.873109+00:00)
securityworker stdout | 2024-04-22 03:55:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:55:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:55:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:55:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:55:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:55:56,878 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:55:56,878 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:55:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:55:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:55:56,906 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:55:56,908 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:55:56,908 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:55:56,909 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 50, 56, 881595), 1, 2])
securityworker stdout | 2024-04-22 03:55:56,911 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:55:56,911 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:55:56,912 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 50, 56, 881595), 1, 2])
securityworker stdout | 2024-04-22 03:55:56,914 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:55:56,914 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:55:56,914 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:55:56,914 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:55:56,914 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:55:56,914 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:55:56,914 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:55:56,915 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:55:56,915 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:55:56,915 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:55:57,808 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:55:59,651 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:55:59,794 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:55:59,915 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:55:59,920 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:55:59,922 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:55:59,925 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:55:59,927 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 03:56:00,653 [282] [DEBUG] [app] Starting request: urn:request:4c787391-7ebe-4630-8476-b83eb4e2d297 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:56:00,653 [278] [DEBUG] [app] Starting request: urn:request:4d836aae-e6d2-4493-be4a-5aa8ee73d37a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:56:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:56:00,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:56:00,656 [292] [DEBUG] [app] Starting request: urn:request:7311752f-ae40-4a63-8e7e-24800d9b45ea (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:56:00,656 [292] [DEBUG] [app] Ending request: urn:request:7311752f-ae40-4a63-8e7e-24800d9b45ea (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7311752f-ae40-4a63-8e7e-24800d9b45ea', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:56:00,656 [284] [DEBUG] [app] Starting request: urn:request:74b40456-6550-4b99-aa07-b2288d684e8e (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:56:00,657 [284] [DEBUG] [app] Ending request: urn:request:74b40456-6550-4b99-aa07-b2288d684e8e (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:74b40456-6550-4b99-aa07-b2288d684e8e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:56:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:56:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:56:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:56:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:56:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:56:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:56:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:56:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:56:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:56:00,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:56:00,659 [282] [DEBUG] [app] Starting request: urn:request:77ef5e73-e4a5-4eaf-8243-3add891e3328 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:56:00,660 [282] [DEBUG] [app] Ending request: urn:request:77ef5e73-e4a5-4eaf-8243-3add891e3328 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:77ef5e73-e4a5-4eaf-8243-3add891e3328', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:56:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:56:00,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:56:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:56:00,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:56:00,660 [281] [DEBUG] [app] Starting request: urn:request:1f413036-cbee-43f5-8919-57307c12c379 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:56:00,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:56:00,661 [281] [DEBUG] [app] Ending request: urn:request:1f413036-cbee-43f5-8919-57307c12c379 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1f413036-cbee-43f5-8919-57307c12c379', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:56:00,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:56:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:56:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:56:00,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:56:00,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:56:00,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:56:00,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:56:00,675 [282] [DEBUG] [app] Ending request: urn:request:4c787391-7ebe-4630-8476-b83eb4e2d297 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:4c787391-7ebe-4630-8476-b83eb4e2d297', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:56:00,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:56:00,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:56:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:56:00,675 [278] [DEBUG] [app] Ending request: urn:request:4d836aae-e6d2-4493-be4a-5aa8ee73d37a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:4d836aae-e6d2-4493-be4a-5aa8ee73d37a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:56:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:56:00,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:56:00,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:56:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:56:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
quotaregistrysizeworker stdout | 2024-04-22 03:56:00,743 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 03:56:02,227 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:56:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:56:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:16.552337+00:00 (in 13.995586 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:56:02,557 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:02 UTC)" (scheduled at 2024-04-22 03:56:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:56:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:56:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:56:03,488 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
notificationworker stdout | 2024-04-22 03:56:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:56:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:13.759375+00:00 (in 9.999480 seconds)
notificationworker stdout | 2024-04-22 03:56:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:56:13 UTC)" (scheduled at 2024-04-22 03:56:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:56:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:56:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 56, 3, 760321), True, datetime.datetime(2024, 4, 22, 3, 56, 3, 760321), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:56:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:56:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:56:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:56:13 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:56:03,815 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:56:03,956 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 03:56:04,534 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:56:04,539 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:56:04,542 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:56:05,063 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:56:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:56:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:26.873109+00:00 (in 21.000753 seconds)
securityworker stdout | 2024-04-22 03:56:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:35 UTC)" (scheduled at 2024-04-22 03:56:05.871852+00:00)
securityworker stdout | 2024-04-22 03:56:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:56:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:56:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:56:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:56:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:56:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:56:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:35 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:56:06,207 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:56:06,371 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:56:06,467 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
repositorygcworker stdout | 2024-04-22 03:56:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:56:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:13.555667+00:00 (in 7.002683 seconds)
repositorygcworker stdout | 2024-04-22 03:56:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:06 UTC)" (scheduled at 2024-04-22 03:56:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:56:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:56:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 56, 6, 553227), True, datetime.datetime(2024, 4, 22, 3, 56, 6, 553227), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:56:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:56:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:56:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:06 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:56:07,403 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:56:08,767 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:56:08,838 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:56:09,201 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:56:09,253 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
storagereplication stdout | 2024-04-22 03:56:10,500 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:56:10,794 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:56:10,797 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:56:10,800 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:56:10,802 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:56:10,807 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:56:10,811 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:56:10,815 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:56:10,818 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 03:56:10,820 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
autopruneworker stdout | 2024-04-22 03:56:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:56:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:41.264267+00:00 (in 29.999453 seconds)
autopruneworker stdout | 2024-04-22 03:56:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:41 UTC)" (scheduled at 2024-04-22 03:56:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:56:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758111271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:56:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:56:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:56:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:56:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:56:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:51.555445+00:00 (in 37.999268 seconds)
repositorygcworker stdout | 2024-04-22 03:56:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:13 UTC)" (scheduled at 2024-04-22 03:56:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:56:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:56:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:56:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:56:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:19.762424+00:00 (in 6.002583 seconds)
notificationworker stdout | 2024-04-22 03:56:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:56:23 UTC)" (scheduled at 2024-04-22 03:56:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:56:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:56:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 56, 13, 760142), True, datetime.datetime(2024, 4, 22, 3, 56, 13, 760142), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:56:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:56:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:56:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:56:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:56:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:56:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:44.952062+00:00 (in 29.999536 seconds)
gcworker stdout | 2024-04-22 03:56:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:44 UTC)" (scheduled at 2024-04-22 03:56:14.952062+00:00)
gcworker stdout | 2024-04-22 03:56:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548574952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:56:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:56:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:56:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:56:15,653 [279] [DEBUG] [app] Starting request: urn:request:247bf856-442f-467a-86d0-083b6fb532f6 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:56:15,653 [278] [DEBUG] [app] Starting request: urn:request:929a560f-9a11-497c-a1f4-66067fb28c3e (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:56:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:56:15,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:56:15,656 [284] [DEBUG] [app] Starting request: urn:request:60d3f54e-a17b-4ff6-b2a9-5ef192027cf5 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:56:15,656 [291] [DEBUG] [app] Starting request: urn:request:e541570b-f238-4e84-8d2f-7731471aa4d1 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:56:15,656 [284] [DEBUG] [app] Ending request: urn:request:60d3f54e-a17b-4ff6-b2a9-5ef192027cf5 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:60d3f54e-a17b-4ff6-b2a9-5ef192027cf5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:56:15,656 [291] [DEBUG] [app] Ending request: urn:request:e541570b-f238-4e84-8d2f-7731471aa4d1 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:e541570b-f238-4e84-8d2f-7731471aa4d1', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:56:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:56:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:56:15,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:56:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:56:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:56:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:56:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:56:15,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:56:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:56:15,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:56:15,659 [278] [DEBUG] [app] Starting request: urn:request:c3cf06de-437a-45a4-9438-9b503d8177ec (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:56:15,659 [278] [DEBUG] [app] Ending request: urn:request:c3cf06de-437a-45a4-9438-9b503d8177ec (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:c3cf06de-437a-45a4-9438-9b503d8177ec', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:56:15,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:56:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:56:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:56:15,660 [282] [DEBUG] [app] Starting request: urn:request:2defd9d8-d110-450f-b1a2-ff4e1db4108e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:56:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:56:15,660 [282] [DEBUG] [app] Ending request: urn:request:2defd9d8-d110-450f-b1a2-ff4e1db4108e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:2defd9d8-d110-450f-b1a2-ff4e1db4108e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:56:15,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:56:15,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:56:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:56:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 03:56:15,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:56:15,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:56:15,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:56:15,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:56:15,674 [278] [DEBUG] [app] Ending request: urn:request:929a560f-9a11-497c-a1f4-66067fb28c3e (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:929a560f-9a11-497c-a1f4-66067fb28c3e', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:56:15,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:56:15,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:56:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:56:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 03:56:15,675 [279] [DEBUG] [app] Ending request: urn:request:247bf856-442f-467a-86d0-083b6fb532f6 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:247bf856-442f-467a-86d0-083b6fb532f6', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:56:15,675 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:56:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:56:15,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:56:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
securityscanningnotificationworker stdout | 2024-04-22 03:56:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:56:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:02.556208+00:00 (in 46.003282 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:56:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:16 UTC)" (scheduled at 2024-04-22 03:56:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:56:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:56:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 56, 16, 553340), True, datetime.datetime(2024, 4, 22, 3, 56, 16, 553340), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:56:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:56:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:56:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:56:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:56:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:47.052354+00:00 (in 29.999418 seconds)
buildlogsarchiver stdout | 2024-04-22 03:56:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:47 UTC)" (scheduled at 2024-04-22 03:56:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:56:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 56, 17, 53155), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:56:17,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:56:17,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:56:17,063 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:56:19,581 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:56:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:56:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:23.759375+00:00 (in 3.996459 seconds)
notificationworker stdout | 2024-04-22 03:56:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:19 UTC)" (scheduled at 2024-04-22 03:56:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:56:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:56:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:56:21,104 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:56:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:56:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:43.057186+00:00 (in 20.997639 seconds)
namespacegcworker stdout | 2024-04-22 03:56:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:22 UTC)" (scheduled at 2024-04-22 03:56:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:56:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:56:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:56:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:56:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:33.759375+00:00 (in 9.999449 seconds)
notificationworker stdout | 2024-04-22 03:56:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:56:33 UTC)" (scheduled at 2024-04-22 03:56:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:56:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:56:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 56, 23, 760374), True, datetime.datetime(2024, 4, 22, 3, 56, 23, 760374), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:56:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:56:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:56:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:56:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 03:56:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:56:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:24.361582+00:00 (in 59.999458 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:56:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:24 UTC)" (scheduled at 2024-04-22 03:56:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:56:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:56:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:56:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:24 UTC)" executed successfully
builder stdout | 2024-04-22 03:56:24,714 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:56:26,370 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:56:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:56:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:35.871852+00:00 (in 8.998258 seconds)
securityworker stdout | 2024-04-22 03:56:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:56 UTC)" (scheduled at 2024-04-22 03:56:26.873109+00:00)
securityworker stdout | 2024-04-22 03:56:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:56:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:56:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:56:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:56:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:56:26,878 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:56:26,878 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:56:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:56:26,882 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:56:26,899 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:56:26,902 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:56:26,902 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:56:26,903 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 51, 26, 882113), 1, 2])
securityworker stdout | 2024-04-22 03:56:26,905 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:56:26,905 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:56:26,906 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 51, 26, 882113), 1, 2])
securityworker stdout | 2024-04-22 03:56:26,908 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:56:26,908 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:56:26,908 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:56:26,908 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:56:26,908 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:56:26,909 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:56:26,909 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:56:26,909 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:56:26,909 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:56:26,910 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:56:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:56:27,844 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:56:29,686 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:56:29,830 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:56:29,923 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:56:29,926 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:56:29,929 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:56:29,932 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:56:29,934 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 03:56:30,653 [278] [DEBUG] [app] Starting request: urn:request:b3bd842d-f62e-4604-84b2-6013d26c4a8b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:56:30,653 [279] [DEBUG] [app] Starting request: urn:request:8fca6b0e-9fe6-40be-b05d-98c4e9df8ef0 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:56:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:56:30,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:56:30,656 [290] [DEBUG] [app] Starting request: urn:request:4205299e-7ae7-4797-8faf-8bda77682bdd (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:56:30,657 [290] [DEBUG] [app] Ending request: urn:request:4205299e-7ae7-4797-8faf-8bda77682bdd (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:4205299e-7ae7-4797-8faf-8bda77682bdd', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:56:30,656 [284] [DEBUG] [app] Starting request: urn:request:4fd90c53-2a0c-40dc-8e97-f5d5ced42ad3 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:56:30,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:56:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:56:30,657 [284] [DEBUG] [app] Ending request: urn:request:4fd90c53-2a0c-40dc-8e97-f5d5ced42ad3 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:4fd90c53-2a0c-40dc-8e97-f5d5ced42ad3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:56:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:56:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:56:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:56:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:56:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:56:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:56:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:56:30,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:56:30,659 [278] [DEBUG] [app] Starting request: urn:request:526fa25d-42d8-45b7-844d-611543b59db8 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:56:30,660 [278] [DEBUG] [app] Ending request: urn:request:526fa25d-42d8-45b7-844d-611543b59db8 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:526fa25d-42d8-45b7-844d-611543b59db8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:56:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:56:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:56:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:56:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:56:30,660 [282] [DEBUG] [app] Starting request: urn:request:954ddd17-edd1-46c0-a1fb-1f8c5f3a7b76 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:56:30,660 [282] [DEBUG] [app] Ending request: urn:request:954ddd17-edd1-46c0-a1fb-1f8c5f3a7b76 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:954ddd17-edd1-46c0-a1fb-1f8c5f3a7b76', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:56:30,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:56:30,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:56:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:56:30,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:56:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:56:30,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:56:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:56:30,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:56:30,674 [278] [DEBUG] [app] Ending request: urn:request:b3bd842d-f62e-4604-84b2-6013d26c4a8b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b3bd842d-f62e-4604-84b2-6013d26c4a8b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:56:30,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:56:30,675 [279] [DEBUG] [app] Ending request: urn:request:8fca6b0e-9fe6-40be-b05d-98c4e9df8ef0 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:8fca6b0e-9fe6-40be-b05d-98c4e9df8ef0', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:56:30,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:56:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:56:30,675 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:56:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:56:30,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:56:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:56:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotaregistrysizeworker stdout | 2024-04-22 03:56:30,761 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 03:56:32,264 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:56:33,520 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
notificationworker stdout | 2024-04-22 03:56:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:56:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:43.759375+00:00 (in 9.999450 seconds)
notificationworker stdout | 2024-04-22 03:56:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:56:43 UTC)" (scheduled at 2024-04-22 03:56:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:56:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:56:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 56, 33, 760236), True, datetime.datetime(2024, 4, 22, 3, 56, 33, 760236), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:56:33,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:56:33,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:56:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:56:43 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:56:33,849 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:56:33,976 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 03:56:34,542 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:56:34,547 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:56:34,550 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:56:35,082 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:56:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:56:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:56.873109+00:00 (in 21.000699 seconds)
securityworker stdout | 2024-04-22 03:56:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:05 UTC)" (scheduled at 2024-04-22 03:56:35.871852+00:00)
securityworker stdout | 2024-04-22 03:56:35,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:56:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:56:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:56:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:56:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:56:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:56:35,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:56:36,240 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:56:36,400 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:56:36,475 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 03:56:37,439 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:56:38,804 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:56:38,856 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:56:39,208 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:56:39,282 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
exportactionlogsworker stdout | 2024-04-22 03:56:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:56:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:41.564959+00:00 (in 1.997425 seconds)
exportactionlogsworker stdout | 2024-04-22 03:56:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:39 UTC)" (scheduled at 2024-04-22 03:56:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:56:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:56:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:56:40,526 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:56:40,805 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:56:40,809 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:56:40,811 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:56:40,814 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:56:40,818 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:56:40,822 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:56:40,825 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:56:40,828 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 03:56:40,831 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
autopruneworker stdout | 2024-04-22 03:56:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:56:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:11.264267+00:00 (in 29.999465 seconds)
autopruneworker stdout | 2024-04-22 03:56:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:11 UTC)" (scheduled at 2024-04-22 03:56:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:56:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758141271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:56:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:56:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:56:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:56:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:56:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:53.566665+00:00 (in 12.001184 seconds)
exportactionlogsworker stdout | 2024-04-22 03:56:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:41 UTC)" (scheduled at 2024-04-22 03:56:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:56:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:56:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 56, 41, 565767), True, datetime.datetime(2024, 4, 22, 3, 56, 41, 565767), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:56:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:56:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:56:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:56:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:56:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:22.058978+00:00 (in 39.001297 seconds)
namespacegcworker stdout | 2024-04-22 03:56:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:43 UTC)" (scheduled at 2024-04-22 03:56:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:56:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:56:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 56, 43, 57965), True, datetime.datetime(2024, 4, 22, 3, 56, 43, 57965), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:56:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:56:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:56:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:57:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:56:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:56:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:56:53.759375+00:00 (in 9.999468 seconds)
notificationworker stdout | 2024-04-22 03:56:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:56:53 UTC)" (scheduled at 2024-04-22 03:56:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:56:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:56:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 56, 43, 760299), True, datetime.datetime(2024, 4, 22, 3, 56, 43, 760299), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:56:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:56:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:56:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:56:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:56:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:56:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:14.952062+00:00 (in 29.999518 seconds)
gcworker stdout | 2024-04-22 03:56:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:14 UTC)" (scheduled at 2024-04-22 03:56:44.952062+00:00)
gcworker stdout | 2024-04-22 03:56:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548604952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:56:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:56:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:56:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:56:45,653 [282] [DEBUG] [app] Starting request: urn:request:3be8e5d5-6b78-44e0-94d6-98c56103ce1f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:56:45,653 [281] [DEBUG] [app] Starting request: urn:request:090308c6-4f49-4d22-9c87-9decf6b7b828 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:56:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:56:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:56:45,656 [290] [DEBUG] [app] Starting request: urn:request:c011c834-6639-496c-960e-f4d909b55e6a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:56:45,656 [292] [DEBUG] [app] Starting request: urn:request:79fd087f-a740-4eb7-af69-c5f80695ba8f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:56:45,657 [290] [DEBUG] [app] Ending request: urn:request:c011c834-6639-496c-960e-f4d909b55e6a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:c011c834-6639-496c-960e-f4d909b55e6a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:56:45,657 [292] [DEBUG] [app] Ending request: urn:request:79fd087f-a740-4eb7-af69-c5f80695ba8f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:79fd087f-a740-4eb7-af69-c5f80695ba8f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:56:45,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:56:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:56:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:56:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:56:45,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:56:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:56:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:56:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:56:45,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:56:45,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:56:45,660 [281] [DEBUG] [app] Starting request: urn:request:677b757a-eea5-442f-a74a-30b1d5062416 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:56:45,660 [281] [DEBUG] [app] Ending request: urn:request:677b757a-eea5-442f-a74a-30b1d5062416 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:677b757a-eea5-442f-a74a-30b1d5062416', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:56:45,660 [278] [DEBUG] [app] Starting request: urn:request:0816e0ef-7097-4f9f-ae94-15844d965cdd (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:56:45,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:56:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:56:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:56:45,660 [278] [DEBUG] [app] Ending request: urn:request:0816e0ef-7097-4f9f-ae94-15844d965cdd (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:0816e0ef-7097-4f9f-ae94-15844d965cdd', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:56:45,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:56:45,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:56:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:56:45,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:56:45,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:56:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:56:45,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:56:45,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:56:45,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:56:45,675 [281] [DEBUG] [app] Ending request: urn:request:090308c6-4f49-4d22-9c87-9decf6b7b828 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:090308c6-4f49-4d22-9c87-9decf6b7b828', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:56:45,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:56:45,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:56:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:56:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:56:45,676 [282] [DEBUG] [app] Ending request: urn:request:3be8e5d5-6b78-44e0-94d6-98c56103ce1f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:3be8e5d5-6b78-44e0-94d6-98c56103ce1f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:56:45,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:56:45,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:56:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:56:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
buildlogsarchiver stdout | 2024-04-22 03:56:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:56:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:17.052354+00:00 (in 29.999486 seconds)
buildlogsarchiver stdout | 2024-04-22 03:56:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:17 UTC)" (scheduled at 2024-04-22 03:56:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:56:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 56, 47, 53093), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:56:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:56:47,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:56:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:56:49,615 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:56:51,124 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
repositorygcworker stdout | 2024-04-22 03:56:51,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:56:51,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:06.552482+00:00 (in 14.996487 seconds)
repositorygcworker stdout | 2024-04-22 03:56:51,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:01:51 UTC)" (scheduled at 2024-04-22 03:56:51.555445+00:00)
repositorygcworker stdout | 2024-04-22 03:56:51,556 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 56, 51, 556403), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 03:56:51,568 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 56, 51, 556403), True, datetime.datetime(2024, 4, 22, 3, 56, 51, 556403), 0, 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 03:56:51,570 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 56, 51, 556403), True, datetime.datetime(2024, 4, 22, 3, 56, 51, 556403), 0, 'repositorygc/%', False, datetime.datetime(2024, 4, 22, 3, 56, 51, 556403), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 03:56:51,573 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:56:51,573 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:01:51 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:56:53,566 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:56:53,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:39.566970+00:00 (in 45.999754 seconds)
exportactionlogsworker stdout | 2024-04-22 03:56:53,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:01:53 UTC)" (scheduled at 2024-04-22 03:56:53.566665+00:00)
exportactionlogsworker stdout | 2024-04-22 03:56:53,567 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 56, 53, 567450), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 03:56:53,578 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 56, 53, 567450), True, datetime.datetime(2024, 4, 22, 3, 56, 53, 567450), 0, 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 03:56:53,580 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 56, 53, 567450), True, datetime.datetime(2024, 4, 22, 3, 56, 53, 567450), 0, 'exportactionlogs/%', False, datetime.datetime(2024, 4, 22, 3, 56, 53, 567450), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 03:56:53,583 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:56:53,583 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:01:53 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:56:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:56:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:03.759375+00:00 (in 9.999474 seconds)
notificationworker stdout | 2024-04-22 03:56:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:57:03 UTC)" (scheduled at 2024-04-22 03:56:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:56:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:56:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 56, 53, 760244), True, datetime.datetime(2024, 4, 22, 3, 56, 53, 760244), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:56:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:56:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:56:53,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:57:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:56:54,750 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:56:56,395 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:56:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:56:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:05.871852+00:00 (in 8.998237 seconds)
securityworker stdout | 2024-04-22 03:56:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:26 UTC)" (scheduled at 2024-04-22 03:56:56.873109+00:00)
securityworker stdout | 2024-04-22 03:56:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:56:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:56:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:56:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:56:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:56:56,878 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:56:56,878 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:56:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:56:56,882 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:56:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:56:56,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:56:56,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:56:56,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 51, 56, 882109), 1, 2])
securityworker stdout | 2024-04-22 03:56:56,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:56:56,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:56:56,898 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 51, 56, 882109), 1, 2])
securityworker stdout | 2024-04-22 03:56:56,900 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:56:56,900 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:56:56,901 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:56:56,901 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:56:56,901 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:56:56,901 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:56:56,901 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:56:56,902 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:56:56,902 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:56:56,902 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:56:57,852 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:56:59,711 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:56:59,866 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:56:59,932 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:56:59,937 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:56:59,939 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:56:59,942 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:56:59,944 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 03:57:00,652 [278] [DEBUG] [app] Starting request: urn:request:510309d5-8556-4ec6-b8db-3567f9b07ad9 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:57:00,653 [282] [DEBUG] [app] Starting request: urn:request:4ac67caf-a5de-480a-9962-fab9f245ba2b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:57:00,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:57:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:57:00,656 [292] [DEBUG] [app] Starting request: urn:request:f7cf2c2e-6efa-4b90-9a9a-cac62baa0c4b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:57:00,656 [284] [DEBUG] [app] Starting request: urn:request:7b47114c-c62a-472e-9a6b-995a68b8dd56 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:57:00,656 [292] [DEBUG] [app] Ending request: urn:request:f7cf2c2e-6efa-4b90-9a9a-cac62baa0c4b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f7cf2c2e-6efa-4b90-9a9a-cac62baa0c4b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:57:00,656 [284] [DEBUG] [app] Ending request: urn:request:7b47114c-c62a-472e-9a6b-995a68b8dd56 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7b47114c-c62a-472e-9a6b-995a68b8dd56', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:57:00,656 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:57:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:57:00,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:57:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:57:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:57:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:57:00,656 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:57:00,656 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:57:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:57:00,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:57:00,659 [278] [DEBUG] [app] Starting request: urn:request:a4d5453f-59e2-495f-b686-c6d1018aeb08 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:57:00,659 [279] [DEBUG] [app] Starting request: urn:request:dceae59a-f428-4ed3-8438-9100c2338e74 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:57:00,659 [278] [DEBUG] [app] Ending request: urn:request:a4d5453f-59e2-495f-b686-c6d1018aeb08 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a4d5453f-59e2-495f-b686-c6d1018aeb08', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:57:00,659 [279] [DEBUG] [app] Ending request: urn:request:dceae59a-f428-4ed3-8438-9100c2338e74 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:dceae59a-f428-4ed3-8438-9100c2338e74', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:57:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:57:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:57:00,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:57:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:57:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:57:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:57:00,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:57:00,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:57:00,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:57:00,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:57:00,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:57:00,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:57:00,674 [282] [DEBUG] [app] Ending request: urn:request:4ac67caf-a5de-480a-9962-fab9f245ba2b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:4ac67caf-a5de-480a-9962-fab9f245ba2b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:57:00,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:57:00,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:57:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:57:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 03:57:00,674 [278] [DEBUG] [app] Ending request: urn:request:510309d5-8556-4ec6-b8db-3567f9b07ad9 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:510309d5-8556-4ec6-b8db-3567f9b07ad9', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:57:00,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:57:00,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:57:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:57:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotaregistrysizeworker stdout | 2024-04-22 03:57:00,787 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 03:57:02,301 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:57:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:57:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:16.552337+00:00 (in 13.995515 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:57:02,557 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:02 UTC)" (scheduled at 2024-04-22 03:57:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:57:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:57:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:57:03,536 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
notificationworker stdout | 2024-04-22 03:57:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:57:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:13.759375+00:00 (in 9.999441 seconds)
notificationworker stdout | 2024-04-22 03:57:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:57:13 UTC)" (scheduled at 2024-04-22 03:57:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:57:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:57:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 57, 3, 760425), True, datetime.datetime(2024, 4, 22, 3, 57, 3, 760425), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:57:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:57:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:57:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:57:13 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:57:03,886 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:57:03,987 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 03:57:04,549 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:57:04,554 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:57:04,557 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:57:05,119 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:57:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:57:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:26.873109+00:00 (in 21.000741 seconds)
securityworker stdout | 2024-04-22 03:57:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:35 UTC)" (scheduled at 2024-04-22 03:57:05.871852+00:00)
securityworker stdout | 2024-04-22 03:57:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:57:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:57:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:57:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:57:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:57:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:57:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:35 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:57:06,276 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:57:06,435 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:57:06,511 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
repositorygcworker stdout | 2024-04-22 03:57:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:57:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:13.555667+00:00 (in 7.002680 seconds)
repositorygcworker stdout | 2024-04-22 03:57:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:06 UTC)" (scheduled at 2024-04-22 03:57:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:57:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:57:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 57, 6, 553279), True, datetime.datetime(2024, 4, 22, 3, 57, 6, 553279), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:57:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:57:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:57:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:06 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:57:07,475 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:57:08,841 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:57:08,893 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:57:09,227 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:57:09,313 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
storagereplication stdout | 2024-04-22 03:57:10,563 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:57:10,817 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:57:10,820 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:57:10,822 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:57:10,825 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:57:10,827 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:57:10,831 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:57:10,834 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:57:10,837 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 03:57:10,840 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
autopruneworker stdout | 2024-04-22 03:57:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:57:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:41.264267+00:00 (in 29.999451 seconds)
autopruneworker stdout | 2024-04-22 03:57:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:41 UTC)" (scheduled at 2024-04-22 03:57:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:57:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758171271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:57:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:57:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:57:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:57:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:57:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:06.552482+00:00 (in 52.996320 seconds)
repositorygcworker stdout | 2024-04-22 03:57:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:13 UTC)" (scheduled at 2024-04-22 03:57:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:57:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:57:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:57:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:57:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:19.762424+00:00 (in 6.002513 seconds)
notificationworker stdout | 2024-04-22 03:57:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:57:23 UTC)" (scheduled at 2024-04-22 03:57:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:57:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:57:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 57, 13, 760212), True, datetime.datetime(2024, 4, 22, 3, 57, 13, 760212), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:57:13,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:57:13,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:57:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:57:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:57:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:57:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:44.952062+00:00 (in 29.999534 seconds)
gcworker stdout | 2024-04-22 03:57:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:44 UTC)" (scheduled at 2024-04-22 03:57:14.952062+00:00)
gcworker stdout | 2024-04-22 03:57:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548634952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:57:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:57:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:57:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:57:15,653 [282] [DEBUG] [app] Starting request: urn:request:6c08815d-af71-40aa-9d95-5c8cf8ee592d (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:57:15,653 [278] [DEBUG] [app] Starting request: urn:request:e2929a3c-ec2d-4965-be27-e4864a0456fc (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:57:15,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:57:15,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:57:15,656 [292] [DEBUG] [app] Starting request: urn:request:b0af0481-9963-4b22-a3ad-2d2766843c07 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:57:15,656 [288] [DEBUG] [app] Starting request: urn:request:b955b669-cbd0-43e7-87e6-c5d762ee637b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:57:15,657 [292] [DEBUG] [app] Ending request: urn:request:b0af0481-9963-4b22-a3ad-2d2766843c07 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b0af0481-9963-4b22-a3ad-2d2766843c07', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:57:15,657 [288] [DEBUG] [app] Ending request: urn:request:b955b669-cbd0-43e7-87e6-c5d762ee637b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b955b669-cbd0-43e7-87e6-c5d762ee637b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:57:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:57:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:57:15,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:57:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:57:15,657 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:57:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:57:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:57:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:57:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:57:15,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:57:15,660 [282] [DEBUG] [app] Starting request: urn:request:5898e807-4d96-449f-b5f1-28a668679907 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:57:15,660 [282] [DEBUG] [app] Ending request: urn:request:5898e807-4d96-449f-b5f1-28a668679907 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:5898e807-4d96-449f-b5f1-28a668679907', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:57:15,660 [281] [DEBUG] [app] Starting request: urn:request:82976e03-8e77-4e43-be32-4c515130fd44 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:57:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:57:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:57:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:57:15,660 [281] [DEBUG] [app] Ending request: urn:request:82976e03-8e77-4e43-be32-4c515130fd44 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:82976e03-8e77-4e43-be32-4c515130fd44', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:57:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:57:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:57:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:57:15,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:57:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:57:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:57:15,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:57:15,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:57:15,670 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:57:15,675 [278] [DEBUG] [app] Ending request: urn:request:e2929a3c-ec2d-4965-be27-e4864a0456fc (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e2929a3c-ec2d-4965-be27-e4864a0456fc', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:57:15,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:57:15,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:57:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:57:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 03:57:15,678 [282] [DEBUG] [app] Ending request: urn:request:6c08815d-af71-40aa-9d95-5c8cf8ee592d (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:6c08815d-af71-40aa-9d95-5c8cf8ee592d', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:57:15,678 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:57:15,678 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:57:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:57:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.025)
securityscanningnotificationworker stdout | 2024-04-22 03:57:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:57:16,553 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:21.555879+00:00 (in 5.002831 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:57:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:16 UTC)" (scheduled at 2024-04-22 03:57:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:57:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:57:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 57, 16, 553528), True, datetime.datetime(2024, 4, 22, 3, 57, 16, 553528), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:57:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:57:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:57:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:16 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:57:16,763 [66] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
expiredappspecifictokenworker stdout | 2024-04-22 03:57:16,763 [66] [INFO] [apscheduler.executors.default] Running job "ExpiredAppSpecificTokenWorker._gc_expired_tokens (trigger: interval[1:00:00], next run at: 2024-04-22 03:57:16 UTC)" (scheduled at 2024-04-22 03:57:16.762836+00:00)
expiredappspecifictokenworker stdout | 2024-04-22 03:57:16,763 [66] [DEBUG] [__main__] Garbage collecting expired app specific tokens with window: 1 day, 0:00:00
expiredappspecifictokenworker stdout | 2024-04-22 03:57:16,764 [66] [DEBUG] [peewee] ('DELETE FROM "appspecificauthtoken" WHERE ("appspecificauthtoken"."expiration" < %s)', [datetime.datetime(2024, 4, 21, 3, 57, 16, 764312)])
expiredappspecifictokenworker stdout | 2024-04-22 03:57:16,765 [66] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:57:16.762836+00:00 (in 3599.997808 seconds)
expiredappspecifictokenworker stdout | 2024-04-22 03:57:16,774 [66] [DEBUG] [data.database] Disconnecting from database.
expiredappspecifictokenworker stdout | 2024-04-22 03:57:16,774 [66] [INFO] [apscheduler.executors.default] Job "ExpiredAppSpecificTokenWorker._gc_expired_tokens (trigger: interval[1:00:00], next run at: 2024-04-22 04:57:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:57:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:57:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:47.052354+00:00 (in 29.999454 seconds)
buildlogsarchiver stdout | 2024-04-22 03:57:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:47 UTC)" (scheduled at 2024-04-22 03:57:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:57:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 57, 17, 53153), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:57:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:57:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:57:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:57:19,632 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:57:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:57:19,763 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:23.759375+00:00 (in 3.996386 seconds)
notificationworker stdout | 2024-04-22 03:57:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:19 UTC)" (scheduled at 2024-04-22 03:57:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:57:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:57:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:57:21,136 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
securityscanningnotificationworker stdout | 2024-04-22 03:57:21,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:57:21,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:02.556208+00:00 (in 40.999556 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:57:21,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:02:21 UTC)" (scheduled at 2024-04-22 03:57:21.555879+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:57:21,557 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 57, 21, 557064), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 03:57:21,568 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 57, 21, 557064), True, datetime.datetime(2024, 4, 22, 3, 57, 21, 557064), 0, 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 03:57:21,570 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 57, 21, 557064), True, datetime.datetime(2024, 4, 22, 3, 57, 21, 557064), 0, 'secscanv4/%', False, datetime.datetime(2024, 4, 22, 3, 57, 21, 557064), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 03:57:21,572 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:57:21,572 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:02:21 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:57:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:57:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:38.058708+00:00 (in 15.999195 seconds)
namespacegcworker stdout | 2024-04-22 03:57:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:22 UTC)" (scheduled at 2024-04-22 03:57:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:57:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:57:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:57:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:57:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:33.759375+00:00 (in 9.999488 seconds)
notificationworker stdout | 2024-04-22 03:57:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:57:33 UTC)" (scheduled at 2024-04-22 03:57:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:57:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:57:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 57, 23, 760318), True, datetime.datetime(2024, 4, 22, 3, 57, 23, 760318), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:57:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:57:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:57:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:57:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 03:57:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:57:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:24.361582+00:00 (in 59.999447 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:57:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:24 UTC)" (scheduled at 2024-04-22 03:57:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:57:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:57:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:57:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:24 UTC)" executed successfully
builder stdout | 2024-04-22 03:57:24,784 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:57:26,408 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:57:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:57:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:35.871852+00:00 (in 8.998229 seconds)
securityworker stdout | 2024-04-22 03:57:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:56 UTC)" (scheduled at 2024-04-22 03:57:26.873109+00:00)
securityworker stdout | 2024-04-22 03:57:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:57:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:57:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:57:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:57:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:57:26,878 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:57:26,878 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:57:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:57:26,883 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:57:26,892 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:57:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:57:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:57:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 52, 26, 882864), 1, 2])
securityworker stdout | 2024-04-22 03:57:26,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:57:26,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:57:26,899 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 52, 26, 882864), 1, 2])
securityworker stdout | 2024-04-22 03:57:26,901 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:57:26,901 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:57:26,901 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:57:26,902 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:57:26,902 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:57:26,902 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:57:26,902 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:57:26,903 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:57:26,903 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:57:26,903 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:57:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:57:27,863 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:57:29,747 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:57:29,903 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:57:29,939 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:57:29,945 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:57:29,949 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:57:29,951 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:57:29,954 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 03:57:30,653 [278] [DEBUG] [app] Starting request: urn:request:12dbfe31-f294-4738-b4f6-78988a390115 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:57:30,653 [282] [DEBUG] [app] Starting request: urn:request:b54005f5-cfab-4812-a399-c5b2cd9c95d1 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:57:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:57:30,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:57:30,656 [284] [DEBUG] [app] Starting request: urn:request:66beaad8-e23b-46b0-94cf-ec8f25dd45d4 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:57:30,656 [290] [DEBUG] [app] Starting request: urn:request:05608005-60b7-4570-a978-93038d19ed3a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:57:30,656 [284] [DEBUG] [app] Ending request: urn:request:66beaad8-e23b-46b0-94cf-ec8f25dd45d4 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:66beaad8-e23b-46b0-94cf-ec8f25dd45d4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:57:30,656 [290] [DEBUG] [app] Ending request: urn:request:05608005-60b7-4570-a978-93038d19ed3a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:05608005-60b7-4570-a978-93038d19ed3a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:57:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:57:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:57:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:57:30,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:57:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:57:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:57:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:57:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:57:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:57:30,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:57:30,659 [278] [DEBUG] [app] Starting request: urn:request:880b5d88-dcec-4fc8-b480-3200c08f2231 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:57:30,659 [281] [DEBUG] [app] Starting request: urn:request:232039f8-a6b1-457d-82ab-4873ba61d3b8 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:57:30,660 [278] [DEBUG] [app] Ending request: urn:request:880b5d88-dcec-4fc8-b480-3200c08f2231 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:880b5d88-dcec-4fc8-b480-3200c08f2231', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:57:30,660 [281] [DEBUG] [app] Ending request: urn:request:232039f8-a6b1-457d-82ab-4873ba61d3b8 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:232039f8-a6b1-457d-82ab-4873ba61d3b8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:57:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:57:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:57:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:57:30,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:57:30,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:57:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:57:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:57:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:57:30,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:57:30,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:57:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:57:30,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:57:30,675 [278] [DEBUG] [app] Ending request: urn:request:12dbfe31-f294-4738-b4f6-78988a390115 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:12dbfe31-f294-4738-b4f6-78988a390115', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:57:30,675 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:57:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:57:30,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:57:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:57:30,676 [282] [DEBUG] [app] Ending request: urn:request:b54005f5-cfab-4812-a399-c5b2cd9c95d1 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b54005f5-cfab-4812-a399-c5b2cd9c95d1', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:57:30,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:57:30,677 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:57:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:57:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
quotaregistrysizeworker stdout | 2024-04-22 03:57:30,823 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 03:57:32,337 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:57:33,572 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
notificationworker stdout | 2024-04-22 03:57:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:57:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:43.759375+00:00 (in 9.999452 seconds)
notificationworker stdout | 2024-04-22 03:57:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:57:43 UTC)" (scheduled at 2024-04-22 03:57:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:57:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:57:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 57, 33, 760250), True, datetime.datetime(2024, 4, 22, 3, 57, 33, 760250), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:57:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:57:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:57:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:57:43 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:57:33,921 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:57:34,022 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 03:57:34,557 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:57:34,561 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:57:34,564 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:57:35,155 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:57:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:57:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:56.873109+00:00 (in 21.000718 seconds)
securityworker stdout | 2024-04-22 03:57:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:05 UTC)" (scheduled at 2024-04-22 03:57:35.871852+00:00)
securityworker stdout | 2024-04-22 03:57:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:57:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:57:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:57:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:57:35,889 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:57:35,891 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:57:35,891 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:57:36,306 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:57:36,470 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:57:36,522 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 03:57:37,500 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
namespacegcworker stdout | 2024-04-22 03:57:38,058 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:57:38,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:43.057186+00:00 (in 4.998026 seconds)
namespacegcworker stdout | 2024-04-22 03:57:38,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:02:38 UTC)" (scheduled at 2024-04-22 03:57:38.058708+00:00)
namespacegcworker stdout | 2024-04-22 03:57:38,060 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 57, 38, 59376), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 03:57:38,070 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 57, 38, 59376), True, datetime.datetime(2024, 4, 22, 3, 57, 38, 59376), 0, 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 03:57:38,072 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 57, 38, 59376), True, datetime.datetime(2024, 4, 22, 3, 57, 38, 59376), 0, 'namespacegc/%', False, datetime.datetime(2024, 4, 22, 3, 57, 38, 59376), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 03:57:38,075 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:57:38,075 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:02:38 UTC)" executed successfully
securityworker stdout | 2024-04-22 03:57:38,877 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:57:38,905 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:57:39,258 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:57:39,349 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
exportactionlogsworker stdout | 2024-04-22 03:57:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:57:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:41.564959+00:00 (in 1.997506 seconds)
exportactionlogsworker stdout | 2024-04-22 03:57:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:39 UTC)" (scheduled at 2024-04-22 03:57:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:57:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:57:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:57:40,587 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:57:40,826 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:57:40,832 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:57:40,835 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:57:40,837 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:57:40,840 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:57:40,843 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:57:40,846 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:57:40,849 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:57:40,852 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:57:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:57:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:11.264267+00:00 (in 29.999506 seconds)
autopruneworker stdout | 2024-04-22 03:57:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:11 UTC)" (scheduled at 2024-04-22 03:57:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:57:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758201271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:57:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:57:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:57:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:57:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:57:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:39.566970+00:00 (in 58.001539 seconds)
exportactionlogsworker stdout | 2024-04-22 03:57:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:41 UTC)" (scheduled at 2024-04-22 03:57:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:57:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:57:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 57, 41, 565659), True, datetime.datetime(2024, 4, 22, 3, 57, 41, 565659), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:57:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:57:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:57:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:57:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:57:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:22.058978+00:00 (in 39.001330 seconds)
namespacegcworker stdout | 2024-04-22 03:57:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:43 UTC)" (scheduled at 2024-04-22 03:57:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:57:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:57:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 57, 43, 57935), True, datetime.datetime(2024, 4, 22, 3, 57, 43, 57935), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:57:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:57:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:57:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:58:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:57:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:57:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:57:53.759375+00:00 (in 9.999501 seconds)
notificationworker stdout | 2024-04-22 03:57:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:57:53 UTC)" (scheduled at 2024-04-22 03:57:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:57:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:57:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 57, 43, 760259), True, datetime.datetime(2024, 4, 22, 3, 57, 43, 760259), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:57:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:57:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:57:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:57:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:57:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:57:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:14.952062+00:00 (in 29.999535 seconds)
gcworker stdout | 2024-04-22 03:57:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:14 UTC)" (scheduled at 2024-04-22 03:57:44.952062+00:00)
gcworker stdout | 2024-04-22 03:57:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548664953, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:57:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:57:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:57:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:57:45,652 [281] [DEBUG] [app] Starting request: urn:request:9c4b6108-61f7-45a8-b7a6-a49ade72d2fa (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:57:45,652 [278] [DEBUG] [app] Starting request: urn:request:993fa23e-ed68-412b-a8dd-37c37564acd2 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:57:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:57:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:57:45,656 [291] [DEBUG] [app] Starting request: urn:request:6f2c2e8d-e317-4530-a343-f23727c64dc9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:57:45,656 [292] [DEBUG] [app] Starting request: urn:request:cf31a0b7-6349-469e-a3a2-8feda6566d1a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:57:45,656 [291] [DEBUG] [app] Ending request: urn:request:6f2c2e8d-e317-4530-a343-f23727c64dc9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:6f2c2e8d-e317-4530-a343-f23727c64dc9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:57:45,656 [292] [DEBUG] [app] Ending request: urn:request:cf31a0b7-6349-469e-a3a2-8feda6566d1a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:cf31a0b7-6349-469e-a3a2-8feda6566d1a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:57:45,656 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:57:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:57:45,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:57:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:57:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:57:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:57:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:57:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-web stdout | 2024-04-22 03:57:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:57:45,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:57:45,659 [278] [DEBUG] [app] Starting request: urn:request:7dae39e3-f78a-4227-91ba-5c0631bd8c26 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:57:45,659 [282] [DEBUG] [app] Starting request: urn:request:7fea865c-fc81-483f-84b6-27ec419a7bc2 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:57:45,659 [278] [DEBUG] [app] Ending request: urn:request:7dae39e3-f78a-4227-91ba-5c0631bd8c26 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:7dae39e3-f78a-4227-91ba-5c0631bd8c26', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:57:45,660 [282] [DEBUG] [app] Ending request: urn:request:7fea865c-fc81-483f-84b6-27ec419a7bc2 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:7fea865c-fc81-483f-84b6-27ec419a7bc2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:57:45,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:57:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:57:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:57:45,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:57:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.001)
gunicorn-web stdout | 2024-04-22 03:57:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:57:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:57:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:57:45,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:57:45,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:57:45,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:57:45,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:57:45,674 [281] [DEBUG] [app] Ending request: urn:request:9c4b6108-61f7-45a8-b7a6-a49ade72d2fa (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:9c4b6108-61f7-45a8-b7a6-a49ade72d2fa', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:57:45,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:57:45,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:57:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:57:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.023)
gunicorn-web stdout | 2024-04-22 03:57:45,675 [278] [DEBUG] [app] Ending request: urn:request:993fa23e-ed68-412b-a8dd-37c37564acd2 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:993fa23e-ed68-412b-a8dd-37c37564acd2', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:57:45,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:57:45,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:57:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:57:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
buildlogsarchiver stdout | 2024-04-22 03:57:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:57:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:17.052354+00:00 (in 29.999443 seconds)
buildlogsarchiver stdout | 2024-04-22 03:57:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:17 UTC)" (scheduled at 2024-04-22 03:57:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:57:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 57, 47, 53157), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:57:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:57:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:57:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:57:49,668 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:57:51,172 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:57:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:57:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:03.759375+00:00 (in 9.999458 seconds)
notificationworker stdout | 2024-04-22 03:57:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:58:03 UTC)" (scheduled at 2024-04-22 03:57:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:57:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:57:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 57, 53, 760302), True, datetime.datetime(2024, 4, 22, 3, 57, 53, 760302), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:57:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:57:53,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:57:53,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:58:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:57:54,801 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:57:56,445 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:57:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:57:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:05.871852+00:00 (in 8.998216 seconds)
securityworker stdout | 2024-04-22 03:57:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:26 UTC)" (scheduled at 2024-04-22 03:57:56.873109+00:00)
securityworker stdout | 2024-04-22 03:57:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:57:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:57:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:57:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:57:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:57:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:57:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:57:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:57:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:57:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:57:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:57:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:57:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 52, 56, 881042), 1, 2])
securityworker stdout | 2024-04-22 03:57:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:57:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:57:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 52, 56, 881042), 1, 2])
securityworker stdout | 2024-04-22 03:57:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:57:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:57:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:57:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:57:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:57:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:57:56,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:57:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:57:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:57:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:57:57,880 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:57:59,753 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 03:57:59,939 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:57:59,946 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:57:59,952 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:57:59,958 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:57:59,960 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:57:59,963 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 03:58:00,653 [282] [DEBUG] [app] Starting request: urn:request:190ad1fb-3464-4790-b506-8f4b35366f53 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:58:00,653 [279] [DEBUG] [app] Starting request: urn:request:921b64db-ff75-4d9c-8a73-51bb05583c38 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:58:00,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:58:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:58:00,656 [290] [DEBUG] [app] Starting request: urn:request:30ff6248-4e16-4471-801b-5f57b4f44a20 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:58:00,656 [284] [DEBUG] [app] Starting request: urn:request:c4e70879-6a0b-4e07-b639-e3e116e8161e (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:58:00,656 [284] [DEBUG] [app] Ending request: urn:request:c4e70879-6a0b-4e07-b639-e3e116e8161e (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:c4e70879-6a0b-4e07-b639-e3e116e8161e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:58:00,656 [290] [DEBUG] [app] Ending request: urn:request:30ff6248-4e16-4471-801b-5f57b4f44a20 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:30ff6248-4e16-4471-801b-5f57b4f44a20', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:58:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:58:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:58:00,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:58:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:58:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:58:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:58:00,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:58:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:58:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:58:00,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:58:00,659 [279] [DEBUG] [app] Starting request: urn:request:5a67a244-c286-48a7-8e15-3c53e4d49d82 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:58:00,659 [279] [DEBUG] [app] Ending request: urn:request:5a67a244-c286-48a7-8e15-3c53e4d49d82 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:5a67a244-c286-48a7-8e15-3c53e4d49d82', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:58:00,660 [278] [DEBUG] [app] Starting request: urn:request:577c481d-0e62-46e8-9330-7f59207669b5 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:58:00,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:58:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:58:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:58:00,660 [278] [DEBUG] [app] Ending request: urn:request:577c481d-0e62-46e8-9330-7f59207669b5 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:577c481d-0e62-46e8-9330-7f59207669b5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:58:00,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:58:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:58:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:58:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:58:00,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:58:00,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:58:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:58:00,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:58:00,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:58:00,674 [279] [DEBUG] [app] Ending request: urn:request:921b64db-ff75-4d9c-8a73-51bb05583c38 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:921b64db-ff75-4d9c-8a73-51bb05583c38', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:58:00,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:58:00,675 [282] [DEBUG] [app] Ending request: urn:request:190ad1fb-3464-4790-b506-8f4b35366f53 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:190ad1fb-3464-4790-b506-8f4b35366f53', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:58:00,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:58:00,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:58:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:58:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:58:00,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:58:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:58:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotaregistrysizeworker stdout | 2024-04-22 03:58:00,838 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 03:58:02,371 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:58:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:58:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:16.552337+00:00 (in 13.995623 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:58:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:02 UTC)" (scheduled at 2024-04-22 03:58:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:58:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:58:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:58:03,581 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
notificationworker stdout | 2024-04-22 03:58:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:58:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:13.759375+00:00 (in 9.999496 seconds)
notificationworker stdout | 2024-04-22 03:58:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:58:13 UTC)" (scheduled at 2024-04-22 03:58:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:58:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:58:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 58, 3, 760278), True, datetime.datetime(2024, 4, 22, 3, 58, 3, 760278), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:58:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:58:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:58:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:58:13 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:58:03,939 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:58:04,059 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 03:58:04,565 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:58:04,570 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:58:04,572 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:58:05,176 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:58:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:58:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:26.873109+00:00 (in 21.000711 seconds)
securityworker stdout | 2024-04-22 03:58:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:35 UTC)" (scheduled at 2024-04-22 03:58:05.871852+00:00)
securityworker stdout | 2024-04-22 03:58:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:58:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:58:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:58:05,877 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:58:05,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:58:05,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:58:05,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:35 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:58:06,339 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:58:06,506 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:58:06,548 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
repositorygcworker stdout | 2024-04-22 03:58:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:58:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:13.555667+00:00 (in 7.002743 seconds)
repositorygcworker stdout | 2024-04-22 03:58:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:06 UTC)" (scheduled at 2024-04-22 03:58:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:58:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:58:06,553 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 58, 6, 553175), True, datetime.datetime(2024, 4, 22, 3, 58, 6, 553175), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:58:06,563 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:58:06,563 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:58:06,563 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:06 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 03:58:07,532 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:58:08,914 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:58:08,931 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:58:09,287 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:58:09,385 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
storagereplication stdout | 2024-04-22 03:58:10,622 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:58:10,835 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:58:10,841 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:58:10,844 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:58:10,847 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:58:10,850 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:58:10,853 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:58:10,857 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:58:10,860 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:58:10,863 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:58:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:58:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:41.264267+00:00 (in 29.999550 seconds)
autopruneworker stdout | 2024-04-22 03:58:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:41 UTC)" (scheduled at 2024-04-22 03:58:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:58:11,281 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758231280, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:58:11,285 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:58:11,285 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:58:11,285 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:58:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:58:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:06.552482+00:00 (in 52.996399 seconds)
repositorygcworker stdout | 2024-04-22 03:58:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:13 UTC)" (scheduled at 2024-04-22 03:58:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:58:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:58:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:58:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:58:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:19.762160+00:00 (in 6.002319 seconds)
notificationworker stdout | 2024-04-22 03:58:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:58:23 UTC)" (scheduled at 2024-04-22 03:58:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:58:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:58:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 58, 13, 760145), True, datetime.datetime(2024, 4, 22, 3, 58, 13, 760145), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:58:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:58:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:58:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:58:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:58:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:58:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:44.952062+00:00 (in 29.999511 seconds)
gcworker stdout | 2024-04-22 03:58:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:44 UTC)" (scheduled at 2024-04-22 03:58:14.952062+00:00)
gcworker stdout | 2024-04-22 03:58:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548694952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:58:14,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:58:14,964 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:58:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:58:15,653 [282] [DEBUG] [app] Starting request: urn:request:052aee22-1810-4194-bd70-08cff0fa32b1 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:58:15,653 [278] [DEBUG] [app] Starting request: urn:request:0e21fc33-5957-450f-83cc-caff3a339c10 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:58:15,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:58:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:58:15,656 [291] [DEBUG] [app] Starting request: urn:request:84bfb36f-f31a-47f4-b2f9-a1b24bf69f27 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:58:15,656 [284] [DEBUG] [app] Starting request: urn:request:1ce577eb-0a9a-4069-ab1b-f52d8324f0c6 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:58:15,656 [291] [DEBUG] [app] Ending request: urn:request:84bfb36f-f31a-47f4-b2f9-a1b24bf69f27 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:84bfb36f-f31a-47f4-b2f9-a1b24bf69f27', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:58:15,656 [284] [DEBUG] [app] Ending request: urn:request:1ce577eb-0a9a-4069-ab1b-f52d8324f0c6 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:1ce577eb-0a9a-4069-ab1b-f52d8324f0c6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:58:15,656 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:58:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:58:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:58:15,656 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:58:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:58:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:58:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:58:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:58:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:58:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:58:15,659 [282] [DEBUG] [app] Starting request: urn:request:43f2f116-cf53-49cf-8c35-252210048bf3 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:58:15,659 [281] [DEBUG] [app] Starting request: urn:request:9a860cc1-6951-4bd8-8193-e3c653c88046 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:58:15,660 [282] [DEBUG] [app] Ending request: urn:request:43f2f116-cf53-49cf-8c35-252210048bf3 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:43f2f116-cf53-49cf-8c35-252210048bf3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:58:15,660 [281] [DEBUG] [app] Ending request: urn:request:9a860cc1-6951-4bd8-8193-e3c653c88046 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9a860cc1-6951-4bd8-8193-e3c653c88046', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:58:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:58:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:58:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:58:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:58:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:58:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:58:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:58:15,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:58:15,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:58:15,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:58:15,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:58:15,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:58:15,674 [282] [DEBUG] [app] Ending request: urn:request:052aee22-1810-4194-bd70-08cff0fa32b1 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:052aee22-1810-4194-bd70-08cff0fa32b1', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:58:15,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:58:15,675 [278] [DEBUG] [app] Ending request: urn:request:0e21fc33-5957-450f-83cc-caff3a339c10 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:0e21fc33-5957-450f-83cc-caff3a339c10', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:58:15,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:58:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:58:15,675 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:58:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:58:15,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:58:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:58:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
securityscanningnotificationworker stdout | 2024-04-22 03:58:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:58:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:02.556208+00:00 (in 46.003332 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:58:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:16 UTC)" (scheduled at 2024-04-22 03:58:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:58:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:58:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 58, 16, 553303), True, datetime.datetime(2024, 4, 22, 3, 58, 16, 553303), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:58:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:58:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:58:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:58:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:58:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:47.052354+00:00 (in 29.999473 seconds)
buildlogsarchiver stdout | 2024-04-22 03:58:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:47 UTC)" (scheduled at 2024-04-22 03:58:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:58:17,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 58, 17, 53257), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:58:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:58:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:58:17,065 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:47 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:58:19,705 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
notificationworker stdout | 2024-04-22 03:58:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:58:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:23.759375+00:00 (in 3.996689 seconds)
notificationworker stdout | 2024-04-22 03:58:19,762 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:03:19 UTC)" (scheduled at 2024-04-22 03:58:19.762160+00:00)
notificationworker stdout | 2024-04-22 03:58:19,763 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 3, 58, 19, 763096), 'notification/%'])
notificationworker stdout | 2024-04-22 03:58:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:19 UTC)" (scheduled at 2024-04-22 03:58:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:58:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:58:19,764 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:19 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:58:19,773 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 58, 19, 763096), True, datetime.datetime(2024, 4, 22, 3, 58, 19, 763096), 0, 'notification/%'])
notificationworker stdout | 2024-04-22 03:58:19,776 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 3, 58, 19, 763096), True, datetime.datetime(2024, 4, 22, 3, 58, 19, 763096), 0, 'notification/%', False, datetime.datetime(2024, 4, 22, 3, 58, 19, 763096), 'notification/%'])
notificationworker stdout | 2024-04-22 03:58:19,778 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:58:19,778 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:03:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 03:58:21,182 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:58:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:58:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:43.057186+00:00 (in 20.997700 seconds)
namespacegcworker stdout | 2024-04-22 03:58:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:22 UTC)" (scheduled at 2024-04-22 03:58:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:58:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:58:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:58:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:58:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:33.759375+00:00 (in 9.999451 seconds)
notificationworker stdout | 2024-04-22 03:58:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:58:33 UTC)" (scheduled at 2024-04-22 03:58:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:58:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:58:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 58, 23, 760301), True, datetime.datetime(2024, 4, 22, 3, 58, 23, 760301), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:58:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:58:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:58:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:58:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 03:58:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:58:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:24.361582+00:00 (in 59.999449 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:58:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:24 UTC)" (scheduled at 2024-04-22 03:58:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:58:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:58:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:58:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:24 UTC)" executed successfully
builder stdout | 2024-04-22 03:58:24,815 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:58:26,481 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:58:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:58:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:35.871852+00:00 (in 8.998216 seconds)
securityworker stdout | 2024-04-22 03:58:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:56 UTC)" (scheduled at 2024-04-22 03:58:26.873109+00:00)
securityworker stdout | 2024-04-22 03:58:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:58:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:58:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:58:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:58:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:58:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:58:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:58:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:58:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:58:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:58:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:58:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:58:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 53, 26, 881358), 1, 2])
securityworker stdout | 2024-04-22 03:58:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:58:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:58:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 53, 26, 881358), 1, 2])
securityworker stdout | 2024-04-22 03:58:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:58:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:58:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:58:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:58:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:58:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:58:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:58:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:58:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:58:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:58:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:58:27,904 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:58:29,787 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:58:29,954 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
chunkcleanupworker stdout | 2024-04-22 03:58:29,959 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:58:29,962 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:58:29,965 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:58:29,968 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:58:29,970 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 03:58:30,653 [278] [DEBUG] [app] Starting request: urn:request:2b34a362-8c09-41a4-88c1-b6afc227726f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:58:30,653 [279] [DEBUG] [app] Starting request: urn:request:1e33e048-86a4-4841-a958-fba6728cc499 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:58:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:58:30,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:58:30,656 [284] [DEBUG] [app] Starting request: urn:request:1712af3d-1b16-4c04-8978-c2e572dda233 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:58:30,656 [288] [DEBUG] [app] Starting request: urn:request:3f551f63-bfb3-429f-b33c-b52423a7b0fc (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:58:30,657 [284] [DEBUG] [app] Ending request: urn:request:1712af3d-1b16-4c04-8978-c2e572dda233 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:1712af3d-1b16-4c04-8978-c2e572dda233', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:58:30,657 [288] [DEBUG] [app] Ending request: urn:request:3f551f63-bfb3-429f-b33c-b52423a7b0fc (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:3f551f63-bfb3-429f-b33c-b52423a7b0fc', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:58:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 03:58:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:58:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:58:30,657 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:58:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:58:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
gunicorn-web stdout | 2024-04-22 03:58:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:58:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:58:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:58:30,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:58:30,660 [282] [DEBUG] [app] Starting request: urn:request:3eda171d-e576-4f27-91b9-89ccd9032a49 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:58:30,660 [281] [DEBUG] [app] Starting request: urn:request:e61f3b0f-22f5-42b7-be22-1da666e726a7 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:58:30,660 [282] [DEBUG] [app] Ending request: urn:request:3eda171d-e576-4f27-91b9-89ccd9032a49 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3eda171d-e576-4f27-91b9-89ccd9032a49', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:58:30,660 [281] [DEBUG] [app] Ending request: urn:request:e61f3b0f-22f5-42b7-be22-1da666e726a7 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e61f3b0f-22f5-42b7-be22-1da666e726a7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:58:30,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:58:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:58:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:58:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:58:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:58:30,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:58:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:58:30,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:58:30,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:58:30,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:58:30,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:58:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:58:30,675 [279] [DEBUG] [app] Ending request: urn:request:1e33e048-86a4-4841-a958-fba6728cc499 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:1e33e048-86a4-4841-a958-fba6728cc499', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:58:30,675 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:58:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:58:30,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:58:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:58:30,675 [278] [DEBUG] [app] Ending request: urn:request:2b34a362-8c09-41a4-88c1-b6afc227726f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2b34a362-8c09-41a4-88c1-b6afc227726f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:58:30,675 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:58:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 03:58:30,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:58:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotaregistrysizeworker stdout | 2024-04-22 03:58:30,845 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 03:58:32,405 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:58:33,613 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
notificationworker stdout | 2024-04-22 03:58:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:58:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:43.759375+00:00 (in 9.999438 seconds)
notificationworker stdout | 2024-04-22 03:58:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:58:43 UTC)" (scheduled at 2024-04-22 03:58:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:58:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:58:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 58, 33, 760340), True, datetime.datetime(2024, 4, 22, 3, 58, 33, 760340), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:58:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:58:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:58:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:58:43 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:58:33,969 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:58:34,095 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 03:58:34,572 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:58:34,578 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:58:34,580 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:58:35,213 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:58:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:58:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:56.873109+00:00 (in 21.000724 seconds)
securityworker stdout | 2024-04-22 03:58:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:05 UTC)" (scheduled at 2024-04-22 03:58:35.871852+00:00)
securityworker stdout | 2024-04-22 03:58:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:58:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:58:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:58:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:58:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:58:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:58:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:58:36,375 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:58:36,515 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:58:36,585 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 03:58:37,540 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:58:38,950 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:58:38,966 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:58:39,323 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:58:39,422 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
exportactionlogsworker stdout | 2024-04-22 03:58:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:58:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:41.564959+00:00 (in 1.997543 seconds)
exportactionlogsworker stdout | 2024-04-22 03:58:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:39 UTC)" (scheduled at 2024-04-22 03:58:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:58:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:58:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:58:40,659 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:58:40,842 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:58:40,850 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:58:40,852 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:58:40,855 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:58:40,859 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:58:40,862 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:58:40,867 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:58:40,871 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:58:40,873 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:58:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:58:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:11.264267+00:00 (in 29.999418 seconds)
autopruneworker stdout | 2024-04-22 03:58:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:11 UTC)" (scheduled at 2024-04-22 03:58:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:58:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758261271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:58:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:58:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:58:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:58:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:58:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:39.566970+00:00 (in 58.001494 seconds)
exportactionlogsworker stdout | 2024-04-22 03:58:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:41 UTC)" (scheduled at 2024-04-22 03:58:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:58:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:58:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 58, 41, 565739), True, datetime.datetime(2024, 4, 22, 3, 58, 41, 565739), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:58:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:58:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:58:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:58:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:58:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:22.058978+00:00 (in 39.001283 seconds)
namespacegcworker stdout | 2024-04-22 03:58:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:43 UTC)" (scheduled at 2024-04-22 03:58:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:58:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:58:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 58, 43, 58041), True, datetime.datetime(2024, 4, 22, 3, 58, 43, 58041), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:58:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:58:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:58:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 03:59:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:58:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:58:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:58:53.759375+00:00 (in 9.999466 seconds)
notificationworker stdout | 2024-04-22 03:58:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:58:53 UTC)" (scheduled at 2024-04-22 03:58:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:58:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:58:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 58, 43, 760213), True, datetime.datetime(2024, 4, 22, 3, 58, 43, 760213), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:58:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:58:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:58:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:58:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:58:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:58:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:14.952062+00:00 (in 29.999544 seconds)
gcworker stdout | 2024-04-22 03:58:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:14 UTC)" (scheduled at 2024-04-22 03:58:44.952062+00:00)
gcworker stdout | 2024-04-22 03:58:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548724952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:58:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:58:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:58:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:58:45,652 [278] [DEBUG] [app] Starting request: urn:request:f17f8839-4a15-40b4-8bb2-bc7109d77b55 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:58:45,652 [279] [DEBUG] [app] Starting request: urn:request:b702bea7-cc3c-473b-893e-008f74474f91 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:58:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:58:45,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:58:45,656 [284] [DEBUG] [app] Starting request: urn:request:13c0092c-e944-4e88-b710-c592520d7111 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:58:45,656 [284] [DEBUG] [app] Ending request: urn:request:13c0092c-e944-4e88-b710-c592520d7111 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:13c0092c-e944-4e88-b710-c592520d7111', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:58:45,656 [289] [DEBUG] [app] Starting request: urn:request:49fe4300-2727-4a75-ad98-3a5b9cdc66bb (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:58:45,656 [289] [DEBUG] [app] Ending request: urn:request:49fe4300-2727-4a75-ad98-3a5b9cdc66bb (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:49fe4300-2727-4a75-ad98-3a5b9cdc66bb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:58:45,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:58:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:58:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:58:45,657 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:58:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:58:45,656 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:58:45,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:58:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 03:58:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:58:45,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:58:45,659 [281] [DEBUG] [app] Starting request: urn:request:442b8dd1-54a2-48fa-b677-844d27c77da4 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:58:45,659 [278] [DEBUG] [app] Starting request: urn:request:b30133f5-5122-417d-8e85-d5b2a3588758 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:58:45,659 [278] [DEBUG] [app] Ending request: urn:request:b30133f5-5122-417d-8e85-d5b2a3588758 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b30133f5-5122-417d-8e85-d5b2a3588758', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:58:45,659 [281] [DEBUG] [app] Ending request: urn:request:442b8dd1-54a2-48fa-b677-844d27c77da4 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:442b8dd1-54a2-48fa-b677-844d27c77da4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:58:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:58:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.000 159 0.001)
gunicorn-web stdout | 2024-04-22 03:58:45,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:58:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:58:45,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:58:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:58:45,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:58:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:58:45,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:58:45,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:58:45,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:58:45,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:58:45,674 [279] [DEBUG] [app] Ending request: urn:request:b702bea7-cc3c-473b-893e-008f74474f91 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b702bea7-cc3c-473b-893e-008f74474f91', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:58:45,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:58:45,674 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:58:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:58:45,674 [278] [DEBUG] [app] Ending request: urn:request:f17f8839-4a15-40b4-8bb2-bc7109d77b55 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f17f8839-4a15-40b4-8bb2-bc7109d77b55', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:58:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 03:58:45,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:58:45,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:58:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:58:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
buildlogsarchiver stdout | 2024-04-22 03:58:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:58:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:17.052354+00:00 (in 29.999454 seconds)
buildlogsarchiver stdout | 2024-04-22 03:58:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:17 UTC)" (scheduled at 2024-04-22 03:58:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:58:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 58, 47, 53269), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:58:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:58:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:58:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:58:49,741 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:58:51,219 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:58:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:58:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:03.759375+00:00 (in 9.999507 seconds)
notificationworker stdout | 2024-04-22 03:58:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:59:03 UTC)" (scheduled at 2024-04-22 03:58:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:58:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:58:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 58, 53, 760302), True, datetime.datetime(2024, 4, 22, 3, 58, 53, 760302), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:58:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:58:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:58:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:59:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:58:54,833 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:58:56,510 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:58:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:58:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:05.871852+00:00 (in 8.998227 seconds)
securityworker stdout | 2024-04-22 03:58:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:26 UTC)" (scheduled at 2024-04-22 03:58:56.873109+00:00)
securityworker stdout | 2024-04-22 03:58:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:58:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:58:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:58:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:58:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:58:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:58:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:58:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:58:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:58:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:58:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:58:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:58:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 53, 56, 881197), 1, 2])
securityworker stdout | 2024-04-22 03:58:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:58:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:58:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 53, 56, 881197), 1, 2])
securityworker stdout | 2024-04-22 03:58:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:58:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:58:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:58:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:58:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:58:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:58:56,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:58:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:58:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:58:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:58:57,939 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:58:59,823 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:58:59,962 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:58:59,970 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:58:59,973 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:58:59,976 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:58:59,978 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
chunkcleanupworker stdout | 2024-04-22 03:58:59,994 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:59:00,653 [282] [DEBUG] [app] Starting request: urn:request:2ebb5330-94ae-4b0b-ae15-363a1e3382fc (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:59:00,653 [278] [DEBUG] [app] Starting request: urn:request:c546212c-f11d-4f90-85b2-6c910eff7dee (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:59:00,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:59:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:59:00,656 [284] [DEBUG] [app] Starting request: urn:request:ee9e8cb3-73c2-486b-9568-82a1d92c5554 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:59:00,656 [291] [DEBUG] [app] Starting request: urn:request:a3bfe685-2cd3-4f1a-9a38-6e3f7152fd14 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:59:00,656 [284] [DEBUG] [app] Ending request: urn:request:ee9e8cb3-73c2-486b-9568-82a1d92c5554 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:ee9e8cb3-73c2-486b-9568-82a1d92c5554', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:59:00,656 [291] [DEBUG] [app] Ending request: urn:request:a3bfe685-2cd3-4f1a-9a38-6e3f7152fd14 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:a3bfe685-2cd3-4f1a-9a38-6e3f7152fd14', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:59:00,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:59:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:59:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:59:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:59:00,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:59:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:59:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:59:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:59:00,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:59:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:59:00,659 [278] [DEBUG] [app] Starting request: urn:request:b6473c89-4229-410a-83a4-e2ba33bf558b (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:59:00,659 [278] [DEBUG] [app] Ending request: urn:request:b6473c89-4229-410a-83a4-e2ba33bf558b (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b6473c89-4229-410a-83a4-e2ba33bf558b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:59:00,659 [281] [DEBUG] [app] Starting request: urn:request:fa46c21b-d204-4155-b6ed-300e5227900f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:59:00,659 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:59:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:59:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:59:00,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:59:00,660 [281] [DEBUG] [app] Ending request: urn:request:fa46c21b-d204-4155-b6ed-300e5227900f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:fa46c21b-d204-4155-b6ed-300e5227900f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:59:00,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:59:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:59:00,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:59:00,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:59:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:59:00,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:59:00,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:59:00,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:59:00,674 [278] [DEBUG] [app] Ending request: urn:request:c546212c-f11d-4f90-85b2-6c910eff7dee (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:c546212c-f11d-4f90-85b2-6c910eff7dee', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:59:00,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:59:00,674 [282] [DEBUG] [app] Ending request: urn:request:2ebb5330-94ae-4b0b-ae15-363a1e3382fc (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2ebb5330-94ae-4b0b-ae15-363a1e3382fc', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:59:00,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:59:00,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:59:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:59:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.023)
gunicorn-web stdout | 2024-04-22 03:59:00,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:59:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:59:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotaregistrysizeworker stdout | 2024-04-22 03:59:00,873 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 03:59:02,437 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 03:59:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:59:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:16.552337+00:00 (in 13.995622 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:59:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:02 UTC)" (scheduled at 2024-04-22 03:59:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:59:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 03:59:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:59:03,635 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
notificationworker stdout | 2024-04-22 03:59:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:59:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:13.759375+00:00 (in 9.999502 seconds)
notificationworker stdout | 2024-04-22 03:59:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:59:13 UTC)" (scheduled at 2024-04-22 03:59:03.759375+00:00)
notificationworker stdout | 2024-04-22 03:59:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:59:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 59, 3, 760164), True, datetime.datetime(2024, 4, 22, 3, 59, 3, 760164), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:59:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:59:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:59:03,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:59:13 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:59:03,985 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:59:04,117 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 03:59:04,580 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:59:04,586 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:59:04,588 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:59:05,249 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:59:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:59:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:26.873109+00:00 (in 21.000661 seconds)
securityworker stdout | 2024-04-22 03:59:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:35 UTC)" (scheduled at 2024-04-22 03:59:05.871852+00:00)
securityworker stdout | 2024-04-22 03:59:05,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:59:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:59:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:59:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:59:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:59:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:59:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:35 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:59:06,389 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:59:06,550 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
repositorygcworker stdout | 2024-04-22 03:59:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:59:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:13.555667+00:00 (in 7.002757 seconds)
repositorygcworker stdout | 2024-04-22 03:59:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:06 UTC)" (scheduled at 2024-04-22 03:59:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 03:59:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 03:59:06,553 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 59, 6, 553136), True, datetime.datetime(2024, 4, 22, 3, 59, 6, 553136), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 03:59:06,563 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 03:59:06,563 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 03:59:06,563 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:06 UTC)" executed successfully
globalpromstats stdout | 2024-04-22 03:59:06,615 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 03:59:07,557 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:59:08,987 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:59:08,998 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:59:09,331 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:59:09,449 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
storagereplication stdout | 2024-04-22 03:59:10,697 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:59:10,852 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:59:10,856 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:59:10,863 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:59:10,866 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:59:10,869 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:59:10,872 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:59:10,877 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:59:10,882 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:59:10,884 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:59:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:59:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:41.264267+00:00 (in 29.999379 seconds)
autopruneworker stdout | 2024-04-22 03:59:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:41 UTC)" (scheduled at 2024-04-22 03:59:11.264267+00:00)
autopruneworker stdout | 2024-04-22 03:59:11,273 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758291272, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:59:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:59:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:59:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:59:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 03:59:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:06.552482+00:00 (in 52.996319 seconds)
repositorygcworker stdout | 2024-04-22 03:59:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:13 UTC)" (scheduled at 2024-04-22 03:59:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 03:59:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 03:59:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:59:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:59:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:19.762424+00:00 (in 6.002607 seconds)
notificationworker stdout | 2024-04-22 03:59:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:59:23 UTC)" (scheduled at 2024-04-22 03:59:13.759375+00:00)
notificationworker stdout | 2024-04-22 03:59:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:59:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 59, 13, 760189), True, datetime.datetime(2024, 4, 22, 3, 59, 13, 760189), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:59:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:59:13,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:59:13,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:59:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:59:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:59:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:44.952062+00:00 (in 29.999540 seconds)
gcworker stdout | 2024-04-22 03:59:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:44 UTC)" (scheduled at 2024-04-22 03:59:14.952062+00:00)
gcworker stdout | 2024-04-22 03:59:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548754952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:59:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:59:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:59:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:59:15,653 [278] [DEBUG] [app] Starting request: urn:request:95302d72-f981-48cf-a527-e8dad9389bcc (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:59:15,654 [279] [DEBUG] [app] Starting request: urn:request:d401be00-6e9d-46bf-b973-7d018aa478fc (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:59:15,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:59:15,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:59:15,657 [286] [DEBUG] [app] Starting request: urn:request:52b16cd8-3c93-4be1-ba25-4d5cb174fdee (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:59:15,657 [284] [DEBUG] [app] Starting request: urn:request:72561962-b2e6-467e-8746-880268a44aa2 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:59:15,658 [284] [DEBUG] [app] Ending request: urn:request:72561962-b2e6-467e-8746-880268a44aa2 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:72561962-b2e6-467e-8746-880268a44aa2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:59:15,658 [286] [DEBUG] [app] Ending request: urn:request:52b16cd8-3c93-4be1-ba25-4d5cb174fdee (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:52b16cd8-3c93-4be1-ba25-4d5cb174fdee', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:59:15,658 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:59:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:59:15,658 [286] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:59:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:59:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:59:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:59:15,658 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:59:15,658 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:59:15,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:59:15,660 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:59:15,661 [278] [DEBUG] [app] Starting request: urn:request:ed164cdd-e318-4b0d-92e1-692233d122ac (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:59:15,661 [278] [DEBUG] [app] Ending request: urn:request:ed164cdd-e318-4b0d-92e1-692233d122ac (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:ed164cdd-e318-4b0d-92e1-692233d122ac', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:59:15,661 [281] [DEBUG] [app] Starting request: urn:request:386e7a75-430f-435d-b670-c1a2bcb8fbb2 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:59:15,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:59:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:59:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:59:15,661 [281] [DEBUG] [app] Ending request: urn:request:386e7a75-430f-435d-b670-c1a2bcb8fbb2 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:386e7a75-430f-435d-b670-c1a2bcb8fbb2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:59:15,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:59:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:59:15,662 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:59:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:59:15,662 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:59:15,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:59:15,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:59:15,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:59:15,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:59:15,675 [278] [DEBUG] [app] Ending request: urn:request:95302d72-f981-48cf-a527-e8dad9389bcc (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:95302d72-f981-48cf-a527-e8dad9389bcc', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:59:15,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:59:15,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:59:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:59:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:59:15,676 [279] [DEBUG] [app] Ending request: urn:request:d401be00-6e9d-46bf-b973-7d018aa478fc (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:d401be00-6e9d-46bf-b973-7d018aa478fc', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:59:15,676 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:59:15,676 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:59:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:59:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
securityscanningnotificationworker stdout | 2024-04-22 03:59:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 03:59:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:02.556208+00:00 (in 46.003321 seconds)
securityscanningnotificationworker stdout | 2024-04-22 03:59:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:16 UTC)" (scheduled at 2024-04-22 03:59:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 03:59:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 03:59:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 59, 16, 553321), True, datetime.datetime(2024, 4, 22, 3, 59, 16, 553321), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 03:59:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 03:59:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 03:59:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 03:59:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:59:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:47.052354+00:00 (in 29.999428 seconds)
buildlogsarchiver stdout | 2024-04-22 03:59:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:47 UTC)" (scheduled at 2024-04-22 03:59:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:59:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 59, 17, 53307), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:59:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:59:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:59:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:59:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:59:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:23.759375+00:00 (in 3.996401 seconds)
notificationworker stdout | 2024-04-22 03:59:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:19 UTC)" (scheduled at 2024-04-22 03:59:19.762424+00:00)
notificationworker stdout | 2024-04-22 03:59:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 03:59:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:59:19,777 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:59:21,255 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 03:59:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:59:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:43.057186+00:00 (in 20.997629 seconds)
namespacegcworker stdout | 2024-04-22 03:59:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:22 UTC)" (scheduled at 2024-04-22 03:59:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 03:59:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 03:59:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:59:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:59:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:33.759375+00:00 (in 9.999467 seconds)
notificationworker stdout | 2024-04-22 03:59:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:59:33 UTC)" (scheduled at 2024-04-22 03:59:23.759375+00:00)
notificationworker stdout | 2024-04-22 03:59:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:59:23,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 59, 23, 760184), True, datetime.datetime(2024, 4, 22, 3, 59, 23, 760184), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:59:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:59:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:59:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:59:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 03:59:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 03:59:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:24.361582+00:00 (in 59.999482 seconds)
quotaregistrysizeworker stdout | 2024-04-22 03:59:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:24 UTC)" (scheduled at 2024-04-22 03:59:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 03:59:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 03:59:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 03:59:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:24 UTC)" executed successfully
builder stdout | 2024-04-22 03:59:24,869 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:59:26,546 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:59:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:59:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:35.871852+00:00 (in 8.998179 seconds)
securityworker stdout | 2024-04-22 03:59:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:56 UTC)" (scheduled at 2024-04-22 03:59:26.873109+00:00)
securityworker stdout | 2024-04-22 03:59:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:59:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:59:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:59:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:59:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:59:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:59:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:59:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:59:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:59:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:59:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:59:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:59:26,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 54, 26, 880908), 1, 2])
securityworker stdout | 2024-04-22 03:59:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:59:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:59:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 54, 26, 880908), 1, 2])
securityworker stdout | 2024-04-22 03:59:26,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:59:26,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:59:26,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:59:26,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:59:26,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:59:26,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:59:26,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:59:26,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:59:26,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:59:26,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 03:59:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:59:27,976 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:59:29,860 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:59:29,971 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:59:29,978 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:59:29,981 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:59:29,984 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:59:29,987 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
chunkcleanupworker stdout | 2024-04-22 03:59:30,029 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 03:59:30,653 [278] [DEBUG] [app] Starting request: urn:request:95cc344d-bb66-4de7-849b-c3028c30b388 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:59:30,653 [281] [DEBUG] [app] Starting request: urn:request:c3e5ba2e-b29c-4436-86b5-f492aaaf87a2 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:59:30,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:59:30,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:59:30,656 [291] [DEBUG] [app] Starting request: urn:request:bc5e9f41-7aae-4b87-be68-972d86d96efc (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:59:30,656 [289] [DEBUG] [app] Starting request: urn:request:acbf08ac-0cf6-4f31-86df-7a2fd95b6e58 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:59:30,657 [291] [DEBUG] [app] Ending request: urn:request:bc5e9f41-7aae-4b87-be68-972d86d96efc (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:bc5e9f41-7aae-4b87-be68-972d86d96efc', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:59:30,657 [289] [DEBUG] [app] Ending request: urn:request:acbf08ac-0cf6-4f31-86df-7a2fd95b6e58 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:acbf08ac-0cf6-4f31-86df-7a2fd95b6e58', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:59:30,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:59:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:59:30,657 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:59:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:59:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:59:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 03:59:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:59:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:59:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:59:30,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:59:30,660 [278] [DEBUG] [app] Starting request: urn:request:a10505dd-dc6c-43aa-96c3-c2ebe87c35f7 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:59:30,660 [278] [DEBUG] [app] Ending request: urn:request:a10505dd-dc6c-43aa-96c3-c2ebe87c35f7 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a10505dd-dc6c-43aa-96c3-c2ebe87c35f7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:59:30,660 [279] [DEBUG] [app] Starting request: urn:request:6a9a99e7-ba08-4862-9e4e-bc1540b15001 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:59:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:59:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:59:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:59:30,660 [279] [DEBUG] [app] Ending request: urn:request:6a9a99e7-ba08-4862-9e4e-bc1540b15001 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:6a9a99e7-ba08-4862-9e4e-bc1540b15001', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:59:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:59:30,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:59:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:59:30,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:59:30,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:59:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 03:59:30,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:59:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:59:30,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:59:30,674 [278] [DEBUG] [app] Ending request: urn:request:95cc344d-bb66-4de7-849b-c3028c30b388 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:95cc344d-bb66-4de7-849b-c3028c30b388', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:59:30,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:59:30,675 [281] [DEBUG] [app] Ending request: urn:request:c3e5ba2e-b29c-4436-86b5-f492aaaf87a2 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:c3e5ba2e-b29c-4436-86b5-f492aaaf87a2', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:59:30,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:59:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 03:59:30,675 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:59:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:59:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:59:30,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:59:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotaregistrysizeworker stdout | 2024-04-22 03:59:30,905 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 03:59:32,465 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 03:59:33,670 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
notificationworker stdout | 2024-04-22 03:59:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:59:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:43.759375+00:00 (in 9.999489 seconds)
notificationworker stdout | 2024-04-22 03:59:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:59:43 UTC)" (scheduled at 2024-04-22 03:59:33.759375+00:00)
notificationworker stdout | 2024-04-22 03:59:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:59:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 59, 33, 760320), True, datetime.datetime(2024, 4, 22, 3, 59, 33, 760320), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:59:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:59:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:59:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:59:43 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:59:33,993 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 03:59:34,150 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 03:59:34,587 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 03:59:34,593 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 03:59:34,596 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 03:59:35,270 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 03:59:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:59:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:56.873109+00:00 (in 21.000628 seconds)
securityworker stdout | 2024-04-22 03:59:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:05 UTC)" (scheduled at 2024-04-22 03:59:35.871852+00:00)
securityworker stdout | 2024-04-22 03:59:35,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:59:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:59:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:59:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:59:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:59:35,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:59:35,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 03:59:36,426 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 03:59:36,561 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 03:59:36,649 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 03:59:37,593 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 03:59:39,013 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 03:59:39,034 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 03:59:39,368 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 03:59:39,465 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
exportactionlogsworker stdout | 2024-04-22 03:59:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:59:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:41.564959+00:00 (in 1.997471 seconds)
exportactionlogsworker stdout | 2024-04-22 03:59:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:39 UTC)" (scheduled at 2024-04-22 03:59:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 03:59:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 03:59:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 03:59:40,706 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 03:59:40,864 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 03:59:40,866 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 03:59:40,874 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 03:59:40,879 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 03:59:40,881 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 03:59:40,884 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 03:59:40,886 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 03:59:40,893 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 03:59:40,895 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 03:59:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 03:59:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:11.264267+00:00 (in 29.999452 seconds)
autopruneworker stdout | 2024-04-22 03:59:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:11 UTC)" (scheduled at 2024-04-22 03:59:41.264267+00:00)
autopruneworker stdout | 2024-04-22 03:59:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758321271, None, 1, 0])
autopruneworker stdout | 2024-04-22 03:59:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 03:59:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 03:59:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 03:59:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 03:59:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:39.566970+00:00 (in 58.001449 seconds)
exportactionlogsworker stdout | 2024-04-22 03:59:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:41 UTC)" (scheduled at 2024-04-22 03:59:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 03:59:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 03:59:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 59, 41, 565838), True, datetime.datetime(2024, 4, 22, 3, 59, 41, 565838), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 03:59:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 03:59:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 03:59:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 03:59:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 03:59:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:22.058978+00:00 (in 39.001293 seconds)
namespacegcworker stdout | 2024-04-22 03:59:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:43 UTC)" (scheduled at 2024-04-22 03:59:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 03:59:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 03:59:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 59, 43, 57973), True, datetime.datetime(2024, 4, 22, 3, 59, 43, 57973), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 03:59:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 03:59:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 03:59:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:00:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 03:59:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:59:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 03:59:53.759375+00:00 (in 9.999502 seconds)
notificationworker stdout | 2024-04-22 03:59:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:59:53 UTC)" (scheduled at 2024-04-22 03:59:43.759375+00:00)
notificationworker stdout | 2024-04-22 03:59:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:59:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 59, 43, 760163), True, datetime.datetime(2024, 4, 22, 3, 59, 43, 760163), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:59:43,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:59:43,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:59:43,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 03:59:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 03:59:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 03:59:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:14.952062+00:00 (in 29.999512 seconds)
gcworker stdout | 2024-04-22 03:59:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:14 UTC)" (scheduled at 2024-04-22 03:59:44.952062+00:00)
gcworker stdout | 2024-04-22 03:59:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548784952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 03:59:44,966 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 03:59:44,966 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 03:59:44,966 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 03:59:45,653 [278] [DEBUG] [app] Starting request: urn:request:a7e2ee06-15fd-4cb7-acd6-f077bcf745f1 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:59:45,653 [282] [DEBUG] [app] Starting request: urn:request:3e2059ce-004d-4c78-9a38-d8feba1f2933 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 03:59:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:59:45,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 03:59:45,656 [289] [DEBUG] [app] Starting request: urn:request:7c182991-9e26-42ec-bbc6-84f33ad4b6a9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:59:45,656 [284] [DEBUG] [app] Starting request: urn:request:ed15a92f-cd2b-4879-a153-9dc54814a494 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 03:59:45,657 [284] [DEBUG] [app] Ending request: urn:request:ed15a92f-cd2b-4879-a153-9dc54814a494 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:ed15a92f-cd2b-4879-a153-9dc54814a494', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 03:59:45,657 [289] [DEBUG] [app] Ending request: urn:request:7c182991-9e26-42ec-bbc6-84f33ad4b6a9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7c182991-9e26-42ec-bbc6-84f33ad4b6a9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:59:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:59:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 03:59:45,657 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:59:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 03:59:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:59:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:59:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:59:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:59:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:59:45,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 03:59:45,660 [278] [DEBUG] [app] Starting request: urn:request:4dc71f4a-7974-41e4-8617-e8b05a02e145 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:59:45,660 [281] [DEBUG] [app] Starting request: urn:request:0f7a5bba-55a4-4355-bffa-47c02939e164 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 03:59:45,660 [278] [DEBUG] [app] Ending request: urn:request:4dc71f4a-7974-41e4-8617-e8b05a02e145 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:4dc71f4a-7974-41e4-8617-e8b05a02e145', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:59:45,660 [281] [DEBUG] [app] Ending request: urn:request:0f7a5bba-55a4-4355-bffa-47c02939e164 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:0f7a5bba-55a4-4355-bffa-47c02939e164', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 03:59:45,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:59:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:59:45,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:03:59:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 03:59:45,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:59:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:03:59:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 03:59:45,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 03:59:45,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:59:45,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 03:59:45,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:59:45,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 03:59:45,674 [278] [DEBUG] [app] Ending request: urn:request:a7e2ee06-15fd-4cb7-acd6-f077bcf745f1 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a7e2ee06-15fd-4cb7-acd6-f077bcf745f1', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:59:45,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:59:45,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:59:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:59:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 03:59:45,675 [282] [DEBUG] [app] Ending request: urn:request:3e2059ce-004d-4c78-9a38-d8feba1f2933 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:3e2059ce-004d-4c78-9a38-d8feba1f2933', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 03:59:45,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 03:59:45,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:03:59:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:03:59:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
buildlogsarchiver stdout | 2024-04-22 03:59:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 03:59:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:17.052354+00:00 (in 29.999476 seconds)
buildlogsarchiver stdout | 2024-04-22 03:59:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:17 UTC)" (scheduled at 2024-04-22 03:59:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 03:59:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 3, 59, 47, 53245), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 03:59:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 03:59:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 03:59:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 03:59:49,787 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 03:59:51,281 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 03:59:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 03:59:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:03.759375+00:00 (in 9.999453 seconds)
notificationworker stdout | 2024-04-22 03:59:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:00:03 UTC)" (scheduled at 2024-04-22 03:59:53.759375+00:00)
notificationworker stdout | 2024-04-22 03:59:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 03:59:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 3, 59, 53, 760363), True, datetime.datetime(2024, 4, 22, 3, 59, 53, 760363), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 03:59:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 03:59:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 03:59:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:00:03 UTC)" executed successfully
builder stdout | 2024-04-22 03:59:54,892 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 03:59:56,583 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 03:59:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 03:59:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:05.871852+00:00 (in 8.998130 seconds)
securityworker stdout | 2024-04-22 03:59:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:26 UTC)" (scheduled at 2024-04-22 03:59:56.873109+00:00)
securityworker stdout | 2024-04-22 03:59:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:59:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 03:59:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:59:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 03:59:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:59:56,878 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 03:59:56,878 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 03:59:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 03:59:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 03:59:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 03:59:56,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:59:56,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:59:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 54, 56, 881568), 1, 2])
securityworker stdout | 2024-04-22 03:59:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:59:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:59:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 54, 56, 881568), 1, 2])
securityworker stdout | 2024-04-22 03:59:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 03:59:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 03:59:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:59:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 03:59:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 03:59:56,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 03:59:56,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 03:59:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 03:59:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 03:59:56,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 03:59:58,010 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 03:59:59,896 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 03:59:59,979 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 03:59:59,986 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 03:59:59,989 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 03:59:59,991 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 03:59:59,994 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
chunkcleanupworker stdout | 2024-04-22 04:00:00,060 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:00:00,653 [278] [DEBUG] [app] Starting request: urn:request:27653218-854d-445a-a63c-20a8ab208276 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:00:00,653 [282] [DEBUG] [app] Starting request: urn:request:bf29b85e-47c2-4dc4-be00-03963002a926 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:00:00,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:00:00,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:00:00,657 [284] [DEBUG] [app] Starting request: urn:request:feacb91d-ea99-4005-b84e-cccbd71b9447 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:00:00,657 [291] [DEBUG] [app] Starting request: urn:request:2f4f57ee-2eb7-4586-b735-940af68df292 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:00:00,657 [284] [DEBUG] [app] Ending request: urn:request:feacb91d-ea99-4005-b84e-cccbd71b9447 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:feacb91d-ea99-4005-b84e-cccbd71b9447', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:00:00,657 [291] [DEBUG] [app] Ending request: urn:request:2f4f57ee-2eb7-4586-b735-940af68df292 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:2f4f57ee-2eb7-4586-b735-940af68df292', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:00:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:00:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:00:00,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:00:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:00:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:00:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:00:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:00:00,658 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:00:00,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:00:00,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:00:00,661 [281] [DEBUG] [app] Starting request: urn:request:fe867c34-dfc4-4fa8-a4a0-a636db503f47 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:00:00,661 [279] [DEBUG] [app] Starting request: urn:request:1474fa0c-9c1f-4eb3-9394-f7e5c0edef37 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:00:00,661 [281] [DEBUG] [app] Ending request: urn:request:fe867c34-dfc4-4fa8-a4a0-a636db503f47 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:fe867c34-dfc4-4fa8-a4a0-a636db503f47', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:00:00,661 [279] [DEBUG] [app] Ending request: urn:request:1474fa0c-9c1f-4eb3-9394-f7e5c0edef37 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1474fa0c-9c1f-4eb3-9394-f7e5c0edef37', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:00:00,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:00:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:00:00,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:00:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:00:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:00:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:00:00,662 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:00:00,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:00:00,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:00:00,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:00:00,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:00:00,669 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:00:00,676 [278] [DEBUG] [app] Ending request: urn:request:27653218-854d-445a-a63c-20a8ab208276 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:27653218-854d-445a-a63c-20a8ab208276', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:00:00,676 [282] [DEBUG] [app] Ending request: urn:request:bf29b85e-47c2-4dc4-be00-03963002a926 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:bf29b85e-47c2-4dc4-be00-03963002a926', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:00:00,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:00:00,677 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:00:00,677 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:00:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:00:00,677 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:00:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:00:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:00:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
quotaregistrysizeworker stdout | 2024-04-22 04:00:00,925 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:00:02,481 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 04:00:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:00:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:16.552337+00:00 (in 13.995682 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:00:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:02 UTC)" (scheduled at 2024-04-22 04:00:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:00:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:00:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:00:03,682 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
notificationworker stdout | 2024-04-22 04:00:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:00:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:13.759375+00:00 (in 9.999491 seconds)
notificationworker stdout | 2024-04-22 04:00:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:00:13 UTC)" (scheduled at 2024-04-22 04:00:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:00:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:00:03,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 0, 3, 760180), True, datetime.datetime(2024, 4, 22, 4, 0, 3, 760180), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:00:03,778 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:00:03,778 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:00:03,778 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:00:13 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:00:04,024 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:00:04,186 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:00:04,594 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:00:04,599 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:00:04,603 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:00:05,306 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:00:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:00:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:26.873109+00:00 (in 21.000620 seconds)
securityworker stdout | 2024-04-22 04:00:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:35 UTC)" (scheduled at 2024-04-22 04:00:05.871852+00:00)
securityworker stdout | 2024-04-22 04:00:05,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:00:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:00:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:00:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:00:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:00:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:00:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:35 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:00:06,462 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
repositorygcworker stdout | 2024-04-22 04:00:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:00:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:13.555667+00:00 (in 7.002654 seconds)
repositorygcworker stdout | 2024-04-22 04:00:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:06 UTC)" (scheduled at 2024-04-22 04:00:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:00:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:00:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 0, 6, 553447), True, datetime.datetime(2024, 4, 22, 4, 0, 6, 553447), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:00:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:00:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:00:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:06 UTC)" executed successfully
autopruneworker stdout | 2024-04-22 04:00:06,597 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:00:06,685 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:00:07,629 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:00:09,027 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:00:09,058 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:00:09,404 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:00:09,476 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
storagereplication stdout | 2024-04-22 04:00:10,738 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 04:00:10,875 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:00:10,879 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:00:10,885 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:00:10,888 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:00:10,892 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:00:10,894 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:00:10,898 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:00:10,901 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:00:10,904 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 04:00:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:00:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:41.264267+00:00 (in 29.999461 seconds)
autopruneworker stdout | 2024-04-22 04:00:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:41 UTC)" (scheduled at 2024-04-22 04:00:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:00:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758351271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:00:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:00:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:00:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:00:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:00:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:06.552482+00:00 (in 52.996346 seconds)
repositorygcworker stdout | 2024-04-22 04:00:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:13 UTC)" (scheduled at 2024-04-22 04:00:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:00:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:00:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:00:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:00:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:19.762424+00:00 (in 6.002611 seconds)
notificationworker stdout | 2024-04-22 04:00:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:00:23 UTC)" (scheduled at 2024-04-22 04:00:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:00:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:00:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 0, 13, 760107), True, datetime.datetime(2024, 4, 22, 4, 0, 13, 760107), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:00:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:00:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:00:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:00:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:00:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:00:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:44.952062+00:00 (in 29.999495 seconds)
gcworker stdout | 2024-04-22 04:00:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:44 UTC)" (scheduled at 2024-04-22 04:00:14.952062+00:00)
gcworker stdout | 2024-04-22 04:00:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548814952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:00:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:00:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:00:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:00:15,652 [278] [DEBUG] [app] Starting request: urn:request:f9874ff9-844b-4cee-9356-ead2ae8ac6ef (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:00:15,652 [281] [DEBUG] [app] Starting request: urn:request:2aeabc37-843e-4335-bfa5-59b0c0f61e58 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:00:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:00:15,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:00:15,656 [291] [DEBUG] [app] Starting request: urn:request:66cc0352-c1f3-4d3c-9463-1777c01a236f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:00:15,656 [291] [DEBUG] [app] Ending request: urn:request:66cc0352-c1f3-4d3c-9463-1777c01a236f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:66cc0352-c1f3-4d3c-9463-1777c01a236f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:00:15,656 [284] [DEBUG] [app] Starting request: urn:request:9c8a9d14-4691-41d3-ad4f-33c84752b332 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:00:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:00:15,656 [284] [DEBUG] [app] Ending request: urn:request:9c8a9d14-4691-41d3-ad4f-33c84752b332 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:9c8a9d14-4691-41d3-ad4f-33c84752b332', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:00:15,656 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:00:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:00:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 04:00:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:00:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:00:15,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:00:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:00:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:00:15,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:00:15,659 [279] [DEBUG] [app] Starting request: urn:request:96c46685-4009-4429-aef0-ae5a28b3d4d5 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:00:15,659 [279] [DEBUG] [app] Ending request: urn:request:96c46685-4009-4429-aef0-ae5a28b3d4d5 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:96c46685-4009-4429-aef0-ae5a28b3d4d5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:00:15,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:00:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:00:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:00:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:00:15,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:00:15,660 [279] [DEBUG] [app] Starting request: urn:request:3303a21f-0862-4f34-a363-f27d9d44feb9 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:00:15,660 [279] [DEBUG] [app] Ending request: urn:request:3303a21f-0862-4f34-a363-f27d9d44feb9 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3303a21f-0862-4f34-a363-f27d9d44feb9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:00:15,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:00:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:00:15,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:00:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:00:15,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:00:15,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:00:15,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:00:15,674 [278] [DEBUG] [app] Ending request: urn:request:f9874ff9-844b-4cee-9356-ead2ae8ac6ef (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f9874ff9-844b-4cee-9356-ead2ae8ac6ef', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:00:15,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:00:15,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:00:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:00:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:00:15,675 [281] [DEBUG] [app] Ending request: urn:request:2aeabc37-843e-4335-bfa5-59b0c0f61e58 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2aeabc37-843e-4335-bfa5-59b0c0f61e58', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:00:15,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:00:15,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:00:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:00:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
securityscanningnotificationworker stdout | 2024-04-22 04:00:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:00:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:02.556208+00:00 (in 46.003354 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:00:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:16 UTC)" (scheduled at 2024-04-22 04:00:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:00:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:00:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 0, 16, 553285), True, datetime.datetime(2024, 4, 22, 4, 0, 16, 553285), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:00:16,563 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:00:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:00:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:00:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:00:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:47.052354+00:00 (in 29.999463 seconds)
buildlogsarchiver stdout | 2024-04-22 04:00:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:47 UTC)" (scheduled at 2024-04-22 04:00:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:00:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 0, 17, 53257), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:00:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:00:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:00:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:00:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:00:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:23.759375+00:00 (in 3.996446 seconds)
notificationworker stdout | 2024-04-22 04:00:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:19 UTC)" (scheduled at 2024-04-22 04:00:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:00:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:00:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:00:19,823 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:00:21,297 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 04:00:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:00:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:43.057186+00:00 (in 20.997636 seconds)
namespacegcworker stdout | 2024-04-22 04:00:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:22 UTC)" (scheduled at 2024-04-22 04:00:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:00:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:00:22,060 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:00:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:00:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:33.759375+00:00 (in 9.999500 seconds)
notificationworker stdout | 2024-04-22 04:00:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:00:33 UTC)" (scheduled at 2024-04-22 04:00:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:00:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:00:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 0, 23, 760186), True, datetime.datetime(2024, 4, 22, 4, 0, 23, 760186), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:00:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:00:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:00:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:00:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:00:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:00:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:24.361582+00:00 (in 59.999459 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:00:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:24 UTC)" (scheduled at 2024-04-22 04:00:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:00:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:00:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:00:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:00:24,898 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 04:00:26,609 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 04:00:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:00:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:35.871852+00:00 (in 8.998175 seconds)
securityworker stdout | 2024-04-22 04:00:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:56 UTC)" (scheduled at 2024-04-22 04:00:26.873109+00:00)
securityworker stdout | 2024-04-22 04:00:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:00:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:00:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:00:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:00:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:00:26,878 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:00:26,878 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:00:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:00:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:00:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:00:26,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:00:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:00:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 55, 26, 881624), 1, 2])
securityworker stdout | 2024-04-22 04:00:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:00:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:00:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 55, 26, 881624), 1, 2])
securityworker stdout | 2024-04-22 04:00:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:00:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:00:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:00:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:00:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:00:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:00:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:00:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:00:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:00:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:00:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:00:28,046 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 04:00:29,905 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 04:00:29,985 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:00:29,995 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:00:29,998 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:00:30,001 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:00:30,004 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
chunkcleanupworker stdout | 2024-04-22 04:00:30,068 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:00:30,653 [278] [DEBUG] [app] Starting request: urn:request:e19dad2e-8198-45a2-b088-4dcd88c79417 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:00:30,653 [281] [DEBUG] [app] Starting request: urn:request:68728053-32d7-46c1-9fec-1ef398325cd4 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:00:30,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:00:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:00:30,656 [292] [DEBUG] [app] Starting request: urn:request:b854f004-8b05-41ad-8180-6c723158325f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:00:30,656 [284] [DEBUG] [app] Starting request: urn:request:c8fbf010-3bba-4c75-b4a7-4e8f1ddab220 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:00:30,656 [292] [DEBUG] [app] Ending request: urn:request:b854f004-8b05-41ad-8180-6c723158325f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b854f004-8b05-41ad-8180-6c723158325f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:00:30,657 [284] [DEBUG] [app] Ending request: urn:request:c8fbf010-3bba-4c75-b4a7-4e8f1ddab220 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:c8fbf010-3bba-4c75-b4a7-4e8f1ddab220', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:00:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:00:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:00:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:00:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:00:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:00:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:00:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:00:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:00:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:00:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:00:30,659 [281] [DEBUG] [app] Starting request: urn:request:f9762a49-d932-4632-b90e-c1116bf0dc21 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:00:30,659 [281] [DEBUG] [app] Ending request: urn:request:f9762a49-d932-4632-b90e-c1116bf0dc21 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:f9762a49-d932-4632-b90e-c1116bf0dc21', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:00:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:00:30,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:00:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:00:30,660 [279] [DEBUG] [app] Starting request: urn:request:99b9ff71-d04a-4ae9-997c-ca53beb99f53 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:00:30,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:00:30,660 [279] [DEBUG] [app] Ending request: urn:request:99b9ff71-d04a-4ae9-997c-ca53beb99f53 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:99b9ff71-d04a-4ae9-997c-ca53beb99f53', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:00:30,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:00:30,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:00:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:00:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:00:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:00:30,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:00:30,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:00:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:00:30,674 [281] [DEBUG] [app] Ending request: urn:request:68728053-32d7-46c1-9fec-1ef398325cd4 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:68728053-32d7-46c1-9fec-1ef398325cd4', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:00:30,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:00:30,674 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:00:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:00:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:00:30,674 [278] [DEBUG] [app] Ending request: urn:request:e19dad2e-8198-45a2-b088-4dcd88c79417 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e19dad2e-8198-45a2-b088-4dcd88c79417', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:00:30,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:00:30,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:00:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:00:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotaregistrysizeworker stdout | 2024-04-22 04:00:30,955 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:00:32,510 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
buildlogsarchiver stdout | 2024-04-22 04:00:33,718 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
notificationworker stdout | 2024-04-22 04:00:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:00:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:43.759375+00:00 (in 9.999529 seconds)
notificationworker stdout | 2024-04-22 04:00:33,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:00:43 UTC)" (scheduled at 2024-04-22 04:00:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:00:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:00:33,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 0, 33, 760123), True, datetime.datetime(2024, 4, 22, 4, 0, 33, 760123), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:00:33,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:00:33,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:00:33,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:00:43 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:00:34,032 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:00:34,222 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:00:34,601 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:00:34,607 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:00:34,610 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:00:35,324 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:00:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:00:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:56.873109+00:00 (in 21.000772 seconds)
securityworker stdout | 2024-04-22 04:00:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:05 UTC)" (scheduled at 2024-04-22 04:00:35.871852+00:00)
securityworker stdout | 2024-04-22 04:00:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:00:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:00:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:00:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:00:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:00:35,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:00:35,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:00:36,470 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:00:36,613 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:00:36,720 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:00:37,666 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:00:39,062 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:00:39,080 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:00:39,441 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:00:39,513 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
exportactionlogsworker stdout | 2024-04-22 04:00:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:00:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:41.564959+00:00 (in 1.997436 seconds)
exportactionlogsworker stdout | 2024-04-22 04:00:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:39 UTC)" (scheduled at 2024-04-22 04:00:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:00:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:00:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:00:40,751 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 04:00:40,886 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:00:40,889 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:00:40,895 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:00:40,897 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:00:40,902 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:00:40,904 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:00:40,907 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:00:40,909 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:00:40,912 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 04:00:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:00:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:11.264267+00:00 (in 29.999427 seconds)
autopruneworker stdout | 2024-04-22 04:00:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:11 UTC)" (scheduled at 2024-04-22 04:00:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:00:41,274 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758381274, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:00:41,278 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:00:41,278 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:00:41,278 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:00:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:00:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:39.566970+00:00 (in 58.001432 seconds)
exportactionlogsworker stdout | 2024-04-22 04:00:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:41 UTC)" (scheduled at 2024-04-22 04:00:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:00:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:00:41,567 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 0, 41, 565826), True, datetime.datetime(2024, 4, 22, 4, 0, 41, 565826), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:00:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:00:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:00:41,578 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:00:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:00:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:22.058978+00:00 (in 39.001266 seconds)
namespacegcworker stdout | 2024-04-22 04:00:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:43 UTC)" (scheduled at 2024-04-22 04:00:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:00:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:00:43,059 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 0, 43, 58114), True, datetime.datetime(2024, 4, 22, 4, 0, 43, 58114), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:00:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:00:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:00:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:01:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:00:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:00:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:00:53.759375+00:00 (in 9.999506 seconds)
notificationworker stdout | 2024-04-22 04:00:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:00:53 UTC)" (scheduled at 2024-04-22 04:00:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:00:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:00:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 0, 43, 760158), True, datetime.datetime(2024, 4, 22, 4, 0, 43, 760158), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:00:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:00:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:00:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:00:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:00:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:00:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:14.952062+00:00 (in 29.999530 seconds)
gcworker stdout | 2024-04-22 04:00:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:14 UTC)" (scheduled at 2024-04-22 04:00:44.952062+00:00)
gcworker stdout | 2024-04-22 04:00:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548844952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:00:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:00:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:00:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:00:45,652 [278] [DEBUG] [app] Starting request: urn:request:a82738b2-732a-4c1d-8646-3f7804733d1b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:00:45,652 [281] [DEBUG] [app] Starting request: urn:request:e19a008e-f0ff-4b01-88cd-23c1e7b1b732 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:00:45,653 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:00:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:00:45,655 [291] [DEBUG] [app] Starting request: urn:request:40a1eb52-5edc-4856-87d1-015180841cbb (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:00:45,656 [291] [DEBUG] [app] Ending request: urn:request:40a1eb52-5edc-4856-87d1-015180841cbb (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:40a1eb52-5edc-4856-87d1-015180841cbb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:00:45,656 [284] [DEBUG] [app] Starting request: urn:request:817e0ae3-b1c1-4518-a711-7d5dc5c42dba (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:00:45,656 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:00:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:00:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:00:45,656 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 04:00:45,656 [284] [DEBUG] [app] Ending request: urn:request:817e0ae3-b1c1-4518-a711-7d5dc5c42dba (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:817e0ae3-b1c1-4518-a711-7d5dc5c42dba', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:00:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:00:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:00:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:00:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:00:45,657 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:00:45,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:00:45,659 [282] [DEBUG] [app] Starting request: urn:request:1df67aa8-50d4-4f4b-ace5-ff9dd3561e5c (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:00:45,659 [282] [DEBUG] [app] Ending request: urn:request:1df67aa8-50d4-4f4b-ace5-ff9dd3561e5c (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1df67aa8-50d4-4f4b-ace5-ff9dd3561e5c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:00:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:00:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:00:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 04:00:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:00:45,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:00:45,660 [279] [DEBUG] [app] Starting request: urn:request:b8ccfe30-aec9-487b-850e-4d2262be91f3 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:00:45,661 [279] [DEBUG] [app] Ending request: urn:request:b8ccfe30-aec9-487b-850e-4d2262be91f3 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b8ccfe30-aec9-487b-850e-4d2262be91f3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:00:45,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:00:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:00:45,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:00:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:00:45,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:00:45,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:00:45,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:00:45,674 [278] [DEBUG] [app] Ending request: urn:request:a82738b2-732a-4c1d-8646-3f7804733d1b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a82738b2-732a-4c1d-8646-3f7804733d1b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:00:45,674 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:00:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:00:45,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:00:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:00:45,674 [281] [DEBUG] [app] Ending request: urn:request:e19a008e-f0ff-4b01-88cd-23c1e7b1b732 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e19a008e-f0ff-4b01-88cd-23c1e7b1b732', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:00:45,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:00:45,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:00:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:00:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
buildlogsarchiver stdout | 2024-04-22 04:00:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:00:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:17.052354+00:00 (in 29.999444 seconds)
buildlogsarchiver stdout | 2024-04-22 04:00:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:17 UTC)" (scheduled at 2024-04-22 04:00:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:00:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 0, 47, 53158), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:00:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:00:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:00:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:00:49,859 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:00:51,314 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:00:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:00:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:03.759375+00:00 (in 9.999435 seconds)
notificationworker stdout | 2024-04-22 04:00:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:01:03 UTC)" (scheduled at 2024-04-22 04:00:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:00:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:00:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 0, 53, 760324), True, datetime.datetime(2024, 4, 22, 4, 0, 53, 760324), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:00:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:00:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:00:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:01:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:00:54,905 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 04:00:56,624 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 04:00:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:00:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:05.871852+00:00 (in 8.998253 seconds)
securityworker stdout | 2024-04-22 04:00:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:26 UTC)" (scheduled at 2024-04-22 04:00:56.873109+00:00)
securityworker stdout | 2024-04-22 04:00:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:00:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:00:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:00:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:00:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:00:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:00:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:00:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:00:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:00:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:00:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:00:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:00:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 55, 56, 881155), 1, 2])
securityworker stdout | 2024-04-22 04:00:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:00:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:00:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 55, 56, 881155), 1, 2])
securityworker stdout | 2024-04-22 04:00:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:00:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:00:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:00:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:00:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:00:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:00:56,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:00:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:00:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:00:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:00:58,064 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 04:00:59,942 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 04:00:59,994 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:01:00,002 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:01:00,005 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:01:00,008 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:01:00,010 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
chunkcleanupworker stdout | 2024-04-22 04:01:00,104 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:01:00,653 [278] [DEBUG] [app] Starting request: urn:request:3fda7d89-6aa5-4de5-91dc-605305f50e91 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:01:00,653 [282] [DEBUG] [app] Starting request: urn:request:01bc93a4-1cfe-4fae-a6d3-7417a65a0888 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:01:00,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:01:00,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:01:00,656 [292] [DEBUG] [app] Starting request: urn:request:3815de29-0a47-4ebf-b4b6-18feb0ad510b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:01:00,656 [284] [DEBUG] [app] Starting request: urn:request:41c7909c-8961-4802-a6a4-ba78d7c49c6a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:01:00,657 [284] [DEBUG] [app] Ending request: urn:request:41c7909c-8961-4802-a6a4-ba78d7c49c6a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:41c7909c-8961-4802-a6a4-ba78d7c49c6a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:01:00,657 [292] [DEBUG] [app] Ending request: urn:request:3815de29-0a47-4ebf-b4b6-18feb0ad510b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:3815de29-0a47-4ebf-b4b6-18feb0ad510b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:01:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:01:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:01:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:01:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:01:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:01:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:01:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:01:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:01:00,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:01:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:01:00,660 [278] [DEBUG] [app] Starting request: urn:request:a764352a-9a46-41a7-889e-fce4226c01a7 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:01:00,660 [281] [DEBUG] [app] Starting request: urn:request:31376015-3630-443e-bdc8-ab81cac8c7ca (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:01:00,660 [278] [DEBUG] [app] Ending request: urn:request:a764352a-9a46-41a7-889e-fce4226c01a7 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a764352a-9a46-41a7-889e-fce4226c01a7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:01:00,660 [281] [DEBUG] [app] Ending request: urn:request:31376015-3630-443e-bdc8-ab81cac8c7ca (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:31376015-3630-443e-bdc8-ab81cac8c7ca', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:01:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:01:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:01:00,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:01:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:01:00,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:01:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:01:00,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:01:00,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:01:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:01:00,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:01:00,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:01:00,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:01:00,675 [282] [DEBUG] [app] Ending request: urn:request:01bc93a4-1cfe-4fae-a6d3-7417a65a0888 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:01bc93a4-1cfe-4fae-a6d3-7417a65a0888', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:01:00,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:01:00,676 [278] [DEBUG] [app] Ending request: urn:request:3fda7d89-6aa5-4de5-91dc-605305f50e91 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:3fda7d89-6aa5-4de5-91dc-605305f50e91', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:01:00,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:01:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:01:00,676 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:01:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 04:01:00,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:01:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:01:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
quotaregistrysizeworker stdout | 2024-04-22 04:01:00,978 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:01:02,547 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
securityscanningnotificationworker stdout | 2024-04-22 04:01:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:01:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:16.552337+00:00 (in 13.995617 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:01:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:02 UTC)" (scheduled at 2024-04-22 04:01:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:01:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:01:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:02 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:01:03,755 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
notificationworker stdout | 2024-04-22 04:01:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:01:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:13.759375+00:00 (in 9.999526 seconds)
notificationworker stdout | 2024-04-22 04:01:03,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:01:13 UTC)" (scheduled at 2024-04-22 04:01:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:01:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:01:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 1, 3, 760128), True, datetime.datetime(2024, 4, 22, 4, 1, 3, 760128), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:01:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:01:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:01:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:01:13 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:01:04,069 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:01:04,259 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:01:04,609 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:01:04,614 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:01:04,617 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:01:05,361 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:01:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:01:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:26.873109+00:00 (in 21.000802 seconds)
securityworker stdout | 2024-04-22 04:01:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:35 UTC)" (scheduled at 2024-04-22 04:01:05.871852+00:00)
securityworker stdout | 2024-04-22 04:01:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:01:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:01:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:01:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:01:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:01:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:01:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:35 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:01:06,507 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
repositorygcworker stdout | 2024-04-22 04:01:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:01:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:13.555667+00:00 (in 7.002763 seconds)
repositorygcworker stdout | 2024-04-22 04:01:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:06 UTC)" (scheduled at 2024-04-22 04:01:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:01:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:01:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 1, 6, 553261), True, datetime.datetime(2024, 4, 22, 4, 1, 6, 553261), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:01:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:01:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:01:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:06 UTC)" executed successfully
autopruneworker stdout | 2024-04-22 04:01:06,624 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:01:06,744 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:01:07,702 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:01:09,098 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:01:09,115 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:01:09,463 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:01:09,519 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
storagereplication stdout | 2024-04-22 04:01:10,787 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 04:01:10,899 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:01:10,901 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:01:10,904 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:01:10,906 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:01:10,911 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:01:10,914 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:01:10,918 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:01:10,920 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:01:10,923 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 04:01:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:01:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:41.264267+00:00 (in 29.999454 seconds)
autopruneworker stdout | 2024-04-22 04:01:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:41 UTC)" (scheduled at 2024-04-22 04:01:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:01:11,273 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758411272, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:01:11,277 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:01:11,277 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:01:11,277 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:01:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:01:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:51.555445+00:00 (in 37.999301 seconds)
repositorygcworker stdout | 2024-04-22 04:01:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:13 UTC)" (scheduled at 2024-04-22 04:01:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:01:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:01:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:01:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:01:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:19.762424+00:00 (in 6.002599 seconds)
notificationworker stdout | 2024-04-22 04:01:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:01:23 UTC)" (scheduled at 2024-04-22 04:01:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:01:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:01:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 1, 13, 760123), True, datetime.datetime(2024, 4, 22, 4, 1, 13, 760123), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:01:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:01:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:01:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:01:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:01:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:01:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:44.952062+00:00 (in 29.999485 seconds)
gcworker stdout | 2024-04-22 04:01:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:44 UTC)" (scheduled at 2024-04-22 04:01:14.952062+00:00)
gcworker stdout | 2024-04-22 04:01:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548874953, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:01:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:01:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:01:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:01:15,653 [279] [DEBUG] [app] Starting request: urn:request:478c1202-8fa8-4e40-97f8-3f423c6c8524 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:01:15,653 [282] [DEBUG] [app] Starting request: urn:request:0910716c-dbda-47c0-ac2e-90f42a6e6e53 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:01:15,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:01:15,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:01:15,657 [290] [DEBUG] [app] Starting request: urn:request:8ac096e1-7964-4a7f-aa06-dd6ebac78fbc (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:01:15,657 [292] [DEBUG] [app] Starting request: urn:request:47c0139e-2f26-45bd-8374-0b233241a93c (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:01:15,657 [290] [DEBUG] [app] Ending request: urn:request:8ac096e1-7964-4a7f-aa06-dd6ebac78fbc (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:8ac096e1-7964-4a7f-aa06-dd6ebac78fbc', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:01:15,657 [292] [DEBUG] [app] Ending request: urn:request:47c0139e-2f26-45bd-8374-0b233241a93c (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:47c0139e-2f26-45bd-8374-0b233241a93c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:01:15,658 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:01:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:01:15,658 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:01:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:01:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:01:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-web stdout | 2024-04-22 04:01:15,658 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:01:15,658 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:01:15,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:01:15,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:01:15,660 [279] [DEBUG] [app] Starting request: urn:request:b59c1a87-8f82-44b9-98f3-21861b9ee046 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:01:15,660 [278] [DEBUG] [app] Starting request: urn:request:d841d39c-0ca1-45cf-bd20-db92e8be8ce6 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:01:15,660 [279] [DEBUG] [app] Ending request: urn:request:b59c1a87-8f82-44b9-98f3-21861b9ee046 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b59c1a87-8f82-44b9-98f3-21861b9ee046', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:01:15,661 [278] [DEBUG] [app] Ending request: urn:request:d841d39c-0ca1-45cf-bd20-db92e8be8ce6 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d841d39c-0ca1-45cf-bd20-db92e8be8ce6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:01:15,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:01:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:01:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.000 159 0.001)
gunicorn-web stdout | 2024-04-22 04:01:15,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:01:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:01:15,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:01:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:01:15,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:01:15,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:01:15,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:01:15,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:01:15,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:01:15,675 [282] [DEBUG] [app] Ending request: urn:request:0910716c-dbda-47c0-ac2e-90f42a6e6e53 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:0910716c-dbda-47c0-ac2e-90f42a6e6e53', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:01:15,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:01:15,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:01:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:01:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.022)
gunicorn-web stdout | 2024-04-22 04:01:15,675 [279] [DEBUG] [app] Ending request: urn:request:478c1202-8fa8-4e40-97f8-3f423c6c8524 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:478c1202-8fa8-4e40-97f8-3f423c6c8524', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:01:15,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:01:15,676 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:01:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:01:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
securityscanningnotificationworker stdout | 2024-04-22 04:01:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:01:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:02.556208+00:00 (in 46.003309 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:01:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:16 UTC)" (scheduled at 2024-04-22 04:01:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:01:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:01:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 1, 16, 553334), True, datetime.datetime(2024, 4, 22, 4, 1, 16, 553334), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:01:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:01:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:01:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:01:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:01:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:47.052354+00:00 (in 29.999425 seconds)
buildlogsarchiver stdout | 2024-04-22 04:01:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:47 UTC)" (scheduled at 2024-04-22 04:01:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:01:17,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 1, 17, 53312), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:01:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:01:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:01:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:01:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:01:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:23.759375+00:00 (in 3.996423 seconds)
notificationworker stdout | 2024-04-22 04:01:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:19 UTC)" (scheduled at 2024-04-22 04:01:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:01:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:01:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:01:19,895 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:01:21,328 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 04:01:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:01:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:43.057186+00:00 (in 20.997687 seconds)
namespacegcworker stdout | 2024-04-22 04:01:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:22 UTC)" (scheduled at 2024-04-22 04:01:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:01:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:01:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:01:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:01:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:33.759375+00:00 (in 9.999449 seconds)
notificationworker stdout | 2024-04-22 04:01:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:01:33 UTC)" (scheduled at 2024-04-22 04:01:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:01:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:01:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 1, 23, 760278), True, datetime.datetime(2024, 4, 22, 4, 1, 23, 760278), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:01:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:01:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:01:23,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:01:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:01:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:01:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:24.361582+00:00 (in 59.999453 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:01:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:24 UTC)" (scheduled at 2024-04-22 04:01:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:01:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:01:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:01:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:01:24,941 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 04:01:26,658 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 04:01:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:01:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:35.871852+00:00 (in 8.998242 seconds)
securityworker stdout | 2024-04-22 04:01:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:56 UTC)" (scheduled at 2024-04-22 04:01:26.873109+00:00)
securityworker stdout | 2024-04-22 04:01:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:01:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:01:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:01:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:01:26,878 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:01:26,878 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:01:26,878 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:01:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:01:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:01:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:01:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:01:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:01:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 56, 26, 881590), 1, 2])
securityworker stdout | 2024-04-22 04:01:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:01:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:01:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 56, 26, 881590), 1, 2])
securityworker stdout | 2024-04-22 04:01:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:01:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:01:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:01:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:01:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:01:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:01:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:01:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:01:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:01:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:01:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:01:28,072 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 04:01:29,976 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 04:01:30,002 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:01:30,009 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:01:30,012 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:01:30,015 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:01:30,017 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
chunkcleanupworker stdout | 2024-04-22 04:01:30,128 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:01:30,653 [278] [DEBUG] [app] Starting request: urn:request:5cda411c-06c3-4a36-a83a-1a8bf0d6cb39 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:01:30,653 [281] [DEBUG] [app] Starting request: urn:request:3335e451-42aa-4693-bde6-92e5afcd7c24 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:01:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:01:30,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:01:30,656 [291] [DEBUG] [app] Starting request: urn:request:8476cb3c-75db-4261-ab2a-c59b55c20651 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:01:30,656 [291] [DEBUG] [app] Ending request: urn:request:8476cb3c-75db-4261-ab2a-c59b55c20651 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:8476cb3c-75db-4261-ab2a-c59b55c20651', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:01:30,656 [290] [DEBUG] [app] Starting request: urn:request:c591ea98-e3ac-47e6-9e60-82b582032a02 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:01:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:01:30,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:01:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:01:30,657 [290] [DEBUG] [app] Ending request: urn:request:c591ea98-e3ac-47e6-9e60-82b582032a02 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:c591ea98-e3ac-47e6-9e60-82b582032a02', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:01:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 04:01:30,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:01:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:01:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:01:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:01:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:01:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:01:30,659 [278] [DEBUG] [app] Starting request: urn:request:a10e861e-1c01-476d-8102-0ac1240b0bdf (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:01:30,659 [278] [DEBUG] [app] Ending request: urn:request:a10e861e-1c01-476d-8102-0ac1240b0bdf (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a10e861e-1c01-476d-8102-0ac1240b0bdf', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:01:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:01:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:01:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:01:30,660 [279] [DEBUG] [app] Starting request: urn:request:9409842f-eb90-4a06-adec-dd1b93d30a1f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:01:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:01:30,660 [279] [DEBUG] [app] Ending request: urn:request:9409842f-eb90-4a06-adec-dd1b93d30a1f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9409842f-eb90-4a06-adec-dd1b93d30a1f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:01:30,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:01:30,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:01:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:01:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:01:30,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:01:30,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:01:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:01:30,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:01:30,675 [278] [DEBUG] [app] Ending request: urn:request:5cda411c-06c3-4a36-a83a-1a8bf0d6cb39 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:5cda411c-06c3-4a36-a83a-1a8bf0d6cb39', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:01:30,675 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:01:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:01:30,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:01:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:01:30,675 [281] [DEBUG] [app] Ending request: urn:request:3335e451-42aa-4693-bde6-92e5afcd7c24 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:3335e451-42aa-4693-bde6-92e5afcd7c24', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:01:30,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:01:30,676 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:01:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:01:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
quotaregistrysizeworker stdout | 2024-04-22 04:01:30,997 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:01:32,568 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:01:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:01:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:43.759375+00:00 (in 9.999420 seconds)
notificationworker stdout | 2024-04-22 04:01:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:01:43 UTC)" (scheduled at 2024-04-22 04:01:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:01:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:01:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 1, 33, 760445), True, datetime.datetime(2024, 4, 22, 4, 1, 33, 760445), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:01:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:01:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:01:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:01:43 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:01:33,790 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:01:34,100 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:01:34,295 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:01:34,617 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:01:34,622 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:01:34,625 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:01:35,395 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:01:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:01:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:56.873109+00:00 (in 21.000783 seconds)
securityworker stdout | 2024-04-22 04:01:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:05 UTC)" (scheduled at 2024-04-22 04:01:35.871852+00:00)
securityworker stdout | 2024-04-22 04:01:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:01:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:01:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:01:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:01:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:01:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:01:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:01:36,524 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:01:36,660 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:01:36,753 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:01:37,738 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:01:39,118 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:01:39,145 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:01:39,491 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:01:39,552 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
exportactionlogsworker stdout | 2024-04-22 04:01:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:01:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:41.564959+00:00 (in 1.997482 seconds)
exportactionlogsworker stdout | 2024-04-22 04:01:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:39 UTC)" (scheduled at 2024-04-22 04:01:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:01:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:01:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:39 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:01:40,824 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 04:01:40,909 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:01:40,912 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:01:40,915 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:01:40,918 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:01:40,921 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:01:40,925 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:01:40,928 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:01:40,930 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:01:40,933 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 04:01:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:01:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:11.264267+00:00 (in 29.999441 seconds)
autopruneworker stdout | 2024-04-22 04:01:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:11 UTC)" (scheduled at 2024-04-22 04:01:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:01:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758441272, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:01:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:01:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:01:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:01:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:01:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:53.566665+00:00 (in 12.001150 seconds)
exportactionlogsworker stdout | 2024-04-22 04:01:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:41 UTC)" (scheduled at 2024-04-22 04:01:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:01:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:01:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 1, 41, 565817), True, datetime.datetime(2024, 4, 22, 4, 1, 41, 565817), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:01:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:01:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:01:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:01:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:01:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:22.058978+00:00 (in 39.001361 seconds)
namespacegcworker stdout | 2024-04-22 04:01:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:43 UTC)" (scheduled at 2024-04-22 04:01:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:01:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:01:43,059 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 1, 43, 58108), True, datetime.datetime(2024, 4, 22, 4, 1, 43, 58108), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:01:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:01:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:01:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:02:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:01:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:01:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:01:53.759375+00:00 (in 9.999454 seconds)
notificationworker stdout | 2024-04-22 04:01:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:01:53 UTC)" (scheduled at 2024-04-22 04:01:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:01:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:01:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 1, 43, 760221), True, datetime.datetime(2024, 4, 22, 4, 1, 43, 760221), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:01:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:01:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:01:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:01:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:01:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:01:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:14.952062+00:00 (in 29.999523 seconds)
gcworker stdout | 2024-04-22 04:01:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:14 UTC)" (scheduled at 2024-04-22 04:01:44.952062+00:00)
gcworker stdout | 2024-04-22 04:01:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548904952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:01:44,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:01:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:01:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:01:45,652 [278] [DEBUG] [app] Starting request: urn:request:b30b0852-379d-4099-8a2f-3d84801b0b3a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:01:45,652 [282] [DEBUG] [app] Starting request: urn:request:f5c929b3-f5e7-48ca-9aab-2c7f2323e642 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:01:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:01:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:01:45,656 [284] [DEBUG] [app] Starting request: urn:request:0255c665-9085-4203-a4a5-627a21a2d732 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:01:45,656 [292] [DEBUG] [app] Starting request: urn:request:0af30bdd-1e49-4eb4-bebe-c3a5289e5a69 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:01:45,656 [284] [DEBUG] [app] Ending request: urn:request:0255c665-9085-4203-a4a5-627a21a2d732 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:0255c665-9085-4203-a4a5-627a21a2d732', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:01:45,656 [292] [DEBUG] [app] Ending request: urn:request:0af30bdd-1e49-4eb4-bebe-c3a5289e5a69 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:0af30bdd-1e49-4eb4-bebe-c3a5289e5a69', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:01:45,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:01:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:01:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:01:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:01:45,656 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:01:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:01:45,656 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:01:45,656 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:01:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:01:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:01:45,659 [279] [DEBUG] [app] Starting request: urn:request:67783f0f-a4ee-4dc7-a189-9cae1e9912bb (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:01:45,659 [281] [DEBUG] [app] Starting request: urn:request:7199ecb2-25f5-45dc-85c4-dd129f42f3b7 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:01:45,659 [281] [DEBUG] [app] Ending request: urn:request:7199ecb2-25f5-45dc-85c4-dd129f42f3b7 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:7199ecb2-25f5-45dc-85c4-dd129f42f3b7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:01:45,659 [279] [DEBUG] [app] Ending request: urn:request:67783f0f-a4ee-4dc7-a189-9cae1e9912bb (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:67783f0f-a4ee-4dc7-a189-9cae1e9912bb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:01:45,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:01:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:01:45,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:01:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:01:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:01:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:01:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:01:45,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:01:45,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:01:45,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:01:45,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:01:45,673 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:01:45,676 [278] [DEBUG] [app] Ending request: urn:request:b30b0852-379d-4099-8a2f-3d84801b0b3a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b30b0852-379d-4099-8a2f-3d84801b0b3a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:01:45,676 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:01:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 04:01:45,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:01:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:01:45,681 [282] [DEBUG] [app] Ending request: urn:request:f5c929b3-f5e7-48ca-9aab-2c7f2323e642 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f5c929b3-f5e7-48ca-9aab-2c7f2323e642', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:01:45,681 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:01:45,682 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:01:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:01:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.030 118 0.030)
buildlogsarchiver stdout | 2024-04-22 04:01:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:01:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:17.052354+00:00 (in 29.999476 seconds)
buildlogsarchiver stdout | 2024-04-22 04:01:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:17 UTC)" (scheduled at 2024-04-22 04:01:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:01:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 1, 47, 53266), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:01:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:01:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:01:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:01:49,906 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:01:51,348 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
repositorygcworker stdout | 2024-04-22 04:01:51,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:01:51,555 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:06.552482+00:00 (in 14.996542 seconds)
repositorygcworker stdout | 2024-04-22 04:01:51,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:06:51 UTC)" (scheduled at 2024-04-22 04:01:51.555445+00:00)
repositorygcworker stdout | 2024-04-22 04:01:51,557 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 1, 51, 556355), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 04:01:51,566 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 1, 51, 556355), True, datetime.datetime(2024, 4, 22, 4, 1, 51, 556355), 0, 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 04:01:51,569 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 1, 51, 556355), True, datetime.datetime(2024, 4, 22, 4, 1, 51, 556355), 0, 'repositorygc/%', False, datetime.datetime(2024, 4, 22, 4, 1, 51, 556355), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 04:01:51,571 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:01:51,572 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:06:51 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:01:53,566 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:01:53,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:39.566970+00:00 (in 45.999784 seconds)
exportactionlogsworker stdout | 2024-04-22 04:01:53,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:06:53 UTC)" (scheduled at 2024-04-22 04:01:53.566665+00:00)
exportactionlogsworker stdout | 2024-04-22 04:01:53,568 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 1, 53, 567584), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 04:01:53,578 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 1, 53, 567584), True, datetime.datetime(2024, 4, 22, 4, 1, 53, 567584), 0, 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 04:01:53,580 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 1, 53, 567584), True, datetime.datetime(2024, 4, 22, 4, 1, 53, 567584), 0, 'exportactionlogs/%', False, datetime.datetime(2024, 4, 22, 4, 1, 53, 567584), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 04:01:53,582 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:01:53,583 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:06:53 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:01:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:01:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:03.759375+00:00 (in 9.999490 seconds)
notificationworker stdout | 2024-04-22 04:01:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:02:03 UTC)" (scheduled at 2024-04-22 04:01:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:01:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:01:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 1, 53, 760325), True, datetime.datetime(2024, 4, 22, 4, 1, 53, 760325), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:01:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:01:53,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:01:53,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:02:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:01:54,978 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 04:01:56,694 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 04:01:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:01:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:05.871852+00:00 (in 8.998216 seconds)
securityworker stdout | 2024-04-22 04:01:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:26 UTC)" (scheduled at 2024-04-22 04:01:56.873109+00:00)
securityworker stdout | 2024-04-22 04:01:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:01:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:01:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:01:56,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:01:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:01:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:01:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:01:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:01:56,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:01:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:01:56,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:01:56,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:01:56,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 56, 56, 880704), 1, 2])
securityworker stdout | 2024-04-22 04:01:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:01:56,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:01:56,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 56, 56, 880704), 1, 2])
securityworker stdout | 2024-04-22 04:01:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:01:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:01:56,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:01:56,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:01:56,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:01:56,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:01:56,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:01:56,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:01:56,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:01:56,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:01:58,091 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 04:01:59,986 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 04:02:00,009 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:02:00,016 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:02:00,019 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:02:00,022 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:02:00,024 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
chunkcleanupworker stdout | 2024-04-22 04:02:00,143 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:02:00,653 [278] [DEBUG] [app] Starting request: urn:request:6d2a01aa-5582-4720-a2fa-a61148c107be (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:02:00,653 [282] [DEBUG] [app] Starting request: urn:request:6e848af1-f36a-4ed0-8840-af018d82fb28 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:02:00,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:02:00,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:02:00,656 [292] [DEBUG] [app] Starting request: urn:request:87d1e1a6-e13d-4df5-8a42-9f803fa93e00 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:02:00,656 [290] [DEBUG] [app] Starting request: urn:request:1b2582c3-1e6d-4dcb-a632-c993841e59e4 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:02:00,657 [292] [DEBUG] [app] Ending request: urn:request:87d1e1a6-e13d-4df5-8a42-9f803fa93e00 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:87d1e1a6-e13d-4df5-8a42-9f803fa93e00', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:02:00,657 [290] [DEBUG] [app] Ending request: urn:request:1b2582c3-1e6d-4dcb-a632-c993841e59e4 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:1b2582c3-1e6d-4dcb-a632-c993841e59e4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:02:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:02:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:02:00,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:02:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:02:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:02:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:02:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:02:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:02:00,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:02:00,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:02:00,660 [278] [DEBUG] [app] Starting request: urn:request:4c5dbdaf-8763-4269-9e0e-0cff399f50ca (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:02:00,660 [278] [DEBUG] [app] Ending request: urn:request:4c5dbdaf-8763-4269-9e0e-0cff399f50ca (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:4c5dbdaf-8763-4269-9e0e-0cff399f50ca', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:02:00,660 [281] [DEBUG] [app] Starting request: urn:request:7c349d85-1d6c-4505-beac-4702047de1a0 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:02:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:02:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:02:00,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:02:00,660 [281] [DEBUG] [app] Ending request: urn:request:7c349d85-1d6c-4505-beac-4702047de1a0 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:7c349d85-1d6c-4505-beac-4702047de1a0', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:02:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:02:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:02:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:02:00,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:02:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:02:00,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:02:00,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:02:00,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:02:00,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:02:00,675 [278] [DEBUG] [app] Ending request: urn:request:6d2a01aa-5582-4720-a2fa-a61148c107be (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:6d2a01aa-5582-4720-a2fa-a61148c107be', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:02:00,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:02:00,675 [282] [DEBUG] [app] Ending request: urn:request:6e848af1-f36a-4ed0-8840-af018d82fb28 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:6e848af1-f36a-4ed0-8840-af018d82fb28', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:02:00,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:02:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:02:00,676 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:02:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.024)
gunicorn-web stdout | 2024-04-22 04:02:00,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:02:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:02:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
quotaregistrysizeworker stdout | 2024-04-22 04:02:01,010 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:02:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:02:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:16.552337+00:00 (in 13.995606 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:02:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:02 UTC)" (scheduled at 2024-04-22 04:02:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:02:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:02:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:02:02,594 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:02:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:02:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:13.759375+00:00 (in 9.999451 seconds)
notificationworker stdout | 2024-04-22 04:02:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:02:13 UTC)" (scheduled at 2024-04-22 04:02:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:02:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:02:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 2, 3, 760254), True, datetime.datetime(2024, 4, 22, 4, 2, 3, 760254), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:02:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:02:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:02:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:02:13 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:02:03,827 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:02:04,127 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:02:04,331 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:02:04,627 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:02:04,631 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:02:04,633 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:02:05,432 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:02:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:02:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:26.873109+00:00 (in 21.000760 seconds)
securityworker stdout | 2024-04-22 04:02:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:35 UTC)" (scheduled at 2024-04-22 04:02:05.871852+00:00)
securityworker stdout | 2024-04-22 04:02:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:02:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:02:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:02:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:02:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:02:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:02:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:35 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:02:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:02:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:13.555667+00:00 (in 7.002608 seconds)
repositorygcworker stdout | 2024-04-22 04:02:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:06 UTC)" (scheduled at 2024-04-22 04:02:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:02:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:02:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 2, 6, 553376), True, datetime.datetime(2024, 4, 22, 4, 2, 6, 553376), 0, 'repositorygc/%', 50, 1, 0])
servicekey stdout | 2024-04-22 04:02:06,557 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
repositorygcworker stdout | 2024-04-22 04:02:06,563 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:02:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:02:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:06 UTC)" executed successfully
autopruneworker stdout | 2024-04-22 04:02:06,669 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:02:06,789 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:02:07,775 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:02:09,143 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:02:09,181 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:02:09,527 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:02:09,589 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
storagereplication stdout | 2024-04-22 04:02:10,860 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 04:02:10,919 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:02:10,922 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:02:10,926 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:02:10,928 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:02:10,931 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:02:10,933 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:02:10,940 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:02:10,943 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:02:10,946 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 04:02:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:02:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:41.264267+00:00 (in 29.999460 seconds)
autopruneworker stdout | 2024-04-22 04:02:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:41 UTC)" (scheduled at 2024-04-22 04:02:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:02:11,273 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758471272, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:02:11,277 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:02:11,277 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:02:11,277 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:02:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:02:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:06.552482+00:00 (in 52.996260 seconds)
repositorygcworker stdout | 2024-04-22 04:02:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:13 UTC)" (scheduled at 2024-04-22 04:02:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:02:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:02:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:02:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:02:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:19.762424+00:00 (in 6.002601 seconds)
notificationworker stdout | 2024-04-22 04:02:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:02:23 UTC)" (scheduled at 2024-04-22 04:02:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:02:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:02:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 2, 13, 760204), True, datetime.datetime(2024, 4, 22, 4, 2, 13, 760204), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:02:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:02:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:02:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:02:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:02:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:02:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:44.952062+00:00 (in 29.999550 seconds)
gcworker stdout | 2024-04-22 04:02:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:44 UTC)" (scheduled at 2024-04-22 04:02:14.952062+00:00)
gcworker stdout | 2024-04-22 04:02:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548934952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:02:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:02:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:02:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:02:15,653 [278] [DEBUG] [app] Starting request: urn:request:cf38f18b-459e-4e2d-8a3b-80c1dbaf5a96 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:02:15,653 [282] [DEBUG] [app] Starting request: urn:request:af77f1fc-12f8-4324-8b42-b36b0e06d2c6 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:02:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:02:15,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:02:15,656 [284] [DEBUG] [app] Starting request: urn:request:b9fb0cc2-d0be-4fa0-8791-1330ad1603f4 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:02:15,656 [292] [DEBUG] [app] Starting request: urn:request:7a5efa78-3745-45e4-acbb-d28d2d41dc32 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:02:15,656 [284] [DEBUG] [app] Ending request: urn:request:b9fb0cc2-d0be-4fa0-8791-1330ad1603f4 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b9fb0cc2-d0be-4fa0-8791-1330ad1603f4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:02:15,656 [292] [DEBUG] [app] Ending request: urn:request:7a5efa78-3745-45e4-acbb-d28d2d41dc32 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7a5efa78-3745-45e4-acbb-d28d2d41dc32', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:02:15,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:02:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:02:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:02:15,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:02:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:02:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:02:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:02:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:02:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:02:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:02:15,659 [278] [DEBUG] [app] Starting request: urn:request:4eb3d21f-ab27-4519-8edc-fb720a09d2fa (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:02:15,659 [278] [DEBUG] [app] Ending request: urn:request:4eb3d21f-ab27-4519-8edc-fb720a09d2fa (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:4eb3d21f-ab27-4519-8edc-fb720a09d2fa', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:02:15,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:02:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:02:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:02:15,660 [279] [DEBUG] [app] Starting request: urn:request:7d05f4dc-77f1-400e-a800-a396d50a8f12 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:02:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:02:15,660 [279] [DEBUG] [app] Ending request: urn:request:7d05f4dc-77f1-400e-a800-a396d50a8f12 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:7d05f4dc-77f1-400e-a800-a396d50a8f12', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:02:15,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:02:15,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:02:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:02:15,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:02:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:02:15,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:02:15,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:02:15,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:02:15,674 [278] [DEBUG] [app] Ending request: urn:request:cf38f18b-459e-4e2d-8a3b-80c1dbaf5a96 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:cf38f18b-459e-4e2d-8a3b-80c1dbaf5a96', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:02:15,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:02:15,675 [282] [DEBUG] [app] Ending request: urn:request:af77f1fc-12f8-4324-8b42-b36b0e06d2c6 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:af77f1fc-12f8-4324-8b42-b36b0e06d2c6', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:02:15,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:02:15,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:02:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:02:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:02:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:02:15,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:02:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
securityscanningnotificationworker stdout | 2024-04-22 04:02:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:02:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:21.555879+00:00 (in 5.002976 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:02:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:16 UTC)" (scheduled at 2024-04-22 04:02:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:02:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:02:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 2, 16, 553322), True, datetime.datetime(2024, 4, 22, 4, 2, 16, 553322), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:02:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:02:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:02:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:02:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:02:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:47.052354+00:00 (in 29.999444 seconds)
buildlogsarchiver stdout | 2024-04-22 04:02:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:47 UTC)" (scheduled at 2024-04-22 04:02:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:02:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 2, 17, 53263), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:02:17,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:02:17,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:02:17,063 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:02:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:02:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:23.759375+00:00 (in 3.996435 seconds)
notificationworker stdout | 2024-04-22 04:02:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:19 UTC)" (scheduled at 2024-04-22 04:02:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:02:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:02:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:02:19,918 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:02:21,385 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
securityscanningnotificationworker stdout | 2024-04-22 04:02:21,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:02:21,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:02.556208+00:00 (in 40.999801 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:02:21,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:07:21 UTC)" (scheduled at 2024-04-22 04:02:21.555879+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:02:21,557 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 2, 21, 556701), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 04:02:21,567 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 2, 21, 556701), True, datetime.datetime(2024, 4, 22, 4, 2, 21, 556701), 0, 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 04:02:21,569 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 2, 21, 556701), True, datetime.datetime(2024, 4, 22, 4, 2, 21, 556701), 0, 'secscanv4/%', False, datetime.datetime(2024, 4, 22, 4, 2, 21, 556701), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 04:02:21,571 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:02:21,572 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:07:21 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:02:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:02:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:38.058708+00:00 (in 15.999201 seconds)
namespacegcworker stdout | 2024-04-22 04:02:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:22 UTC)" (scheduled at 2024-04-22 04:02:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:02:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:02:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:02:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:02:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:33.759375+00:00 (in 9.999429 seconds)
notificationworker stdout | 2024-04-22 04:02:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:02:33 UTC)" (scheduled at 2024-04-22 04:02:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:02:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:02:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 2, 23, 760276), True, datetime.datetime(2024, 4, 22, 4, 2, 23, 760276), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:02:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:02:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:02:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:02:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:02:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:02:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:24.361582+00:00 (in 59.999462 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:02:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:24 UTC)" (scheduled at 2024-04-22 04:02:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:02:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:02:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:02:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:02:25,008 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 04:02:26,731 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 04:02:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:02:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:35.871852+00:00 (in 8.998220 seconds)
securityworker stdout | 2024-04-22 04:02:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:56 UTC)" (scheduled at 2024-04-22 04:02:26.873109+00:00)
securityworker stdout | 2024-04-22 04:02:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:02:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:02:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:02:26,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:02:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:02:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:02:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:02:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:02:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:02:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:02:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:02:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:02:26,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 57, 26, 880846), 1, 2])
securityworker stdout | 2024-04-22 04:02:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:02:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:02:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 57, 26, 880846), 1, 2])
securityworker stdout | 2024-04-22 04:02:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:02:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:02:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:02:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:02:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:02:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:02:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:02:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:02:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:02:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:02:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:02:28,100 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 04:02:30,016 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 04:02:30,019 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:02:30,023 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:02:30,026 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:02:30,028 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:02:30,031 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
chunkcleanupworker stdout | 2024-04-22 04:02:30,178 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:02:30,653 [279] [DEBUG] [app] Starting request: urn:request:58551494-225e-41b9-92d0-9db3b97f796c (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:02:30,653 [281] [DEBUG] [app] Starting request: urn:request:76ea31fb-6ddc-4a68-9185-f817797a9288 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:02:30,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:02:30,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:02:30,656 [284] [DEBUG] [app] Starting request: urn:request:03daf3de-74c0-4c87-9913-5d604d23c6d7 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:02:30,656 [291] [DEBUG] [app] Starting request: urn:request:249239dd-e098-4f2c-8117-3f6d55118d9a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:02:30,657 [284] [DEBUG] [app] Ending request: urn:request:03daf3de-74c0-4c87-9913-5d604d23c6d7 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:03daf3de-74c0-4c87-9913-5d604d23c6d7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:02:30,657 [291] [DEBUG] [app] Ending request: urn:request:249239dd-e098-4f2c-8117-3f6d55118d9a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:249239dd-e098-4f2c-8117-3f6d55118d9a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:02:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:02:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:02:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:02:30,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:02:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:02:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:02:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:02:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:02:30,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:02:30,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:02:30,660 [278] [DEBUG] [app] Starting request: urn:request:ae87359c-c077-4bf2-b2a1-b625d9559376 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:02:30,660 [278] [DEBUG] [app] Ending request: urn:request:ae87359c-c077-4bf2-b2a1-b625d9559376 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:ae87359c-c077-4bf2-b2a1-b625d9559376', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:02:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:02:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:02:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:02:30,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:02:30,661 [282] [DEBUG] [app] Starting request: urn:request:167bf19a-6999-4004-9535-1809f0f39e10 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:02:30,661 [282] [DEBUG] [app] Ending request: urn:request:167bf19a-6999-4004-9535-1809f0f39e10 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:167bf19a-6999-4004-9535-1809f0f39e10', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:02:30,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:02:30,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:02:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:02:30,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:02:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:02:30,662 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:02:30,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:02:30,669 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:02:30,676 [279] [DEBUG] [app] Ending request: urn:request:58551494-225e-41b9-92d0-9db3b97f796c (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:58551494-225e-41b9-92d0-9db3b97f796c', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:02:30,676 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:02:30,676 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:02:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:02:30,676 [281] [DEBUG] [app] Ending request: urn:request:76ea31fb-6ddc-4a68-9185-f817797a9288 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:76ea31fb-6ddc-4a68-9185-f817797a9288', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:02:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 04:02:30,677 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:02:30,677 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:02:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:02:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
quotaregistrysizeworker stdout | 2024-04-22 04:02:31,019 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:02:32,614 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:02:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:02:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:43.759375+00:00 (in 9.999505 seconds)
notificationworker stdout | 2024-04-22 04:02:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:02:43 UTC)" (scheduled at 2024-04-22 04:02:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:02:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:02:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 2, 33, 760291), True, datetime.datetime(2024, 4, 22, 4, 2, 33, 760291), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:02:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:02:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:02:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:02:43 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:02:33,862 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:02:34,161 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:02:34,368 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:02:34,636 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:02:34,640 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:02:34,643 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:02:35,448 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:02:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:02:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:56.873109+00:00 (in 21.000736 seconds)
securityworker stdout | 2024-04-22 04:02:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:05 UTC)" (scheduled at 2024-04-22 04:02:35.871852+00:00)
securityworker stdout | 2024-04-22 04:02:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:02:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:02:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:02:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:02:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:02:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:02:35,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:02:36,585 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:02:36,704 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:02:36,825 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:02:37,808 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
namespacegcworker stdout | 2024-04-22 04:02:38,058 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:02:38,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:43.057186+00:00 (in 4.998002 seconds)
namespacegcworker stdout | 2024-04-22 04:02:38,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:07:38 UTC)" (scheduled at 2024-04-22 04:02:38.058708+00:00)
namespacegcworker stdout | 2024-04-22 04:02:38,060 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 2, 38, 59576), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 04:02:38,070 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 2, 38, 59576), True, datetime.datetime(2024, 4, 22, 4, 2, 38, 59576), 0, 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 04:02:38,072 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 2, 38, 59576), True, datetime.datetime(2024, 4, 22, 4, 2, 38, 59576), 0, 'namespacegc/%', False, datetime.datetime(2024, 4, 22, 4, 2, 38, 59576), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 04:02:38,074 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:02:38,075 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:07:38 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:02:39,151 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:02:39,219 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:02:39,537 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
exportactionlogsworker stdout | 2024-04-22 04:02:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:02:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:41.564959+00:00 (in 1.997435 seconds)
exportactionlogsworker stdout | 2024-04-22 04:02:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:39 UTC)" (scheduled at 2024-04-22 04:02:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:02:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:02:39,568 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:39 UTC)" executed successfully
manifestbackfillworker stdout | 2024-04-22 04:02:39,626 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
storagereplication stdout | 2024-04-22 04:02:40,881 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 04:02:40,929 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:02:40,932 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:02:40,935 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:02:40,938 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:02:40,940 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:02:40,943 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:02:40,951 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:02:40,954 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:02:40,957 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 04:02:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:02:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:11.264267+00:00 (in 29.999506 seconds)
autopruneworker stdout | 2024-04-22 04:02:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:11 UTC)" (scheduled at 2024-04-22 04:02:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:02:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758501271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:02:41,277 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:02:41,277 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:02:41,277 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:02:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:02:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:39.566970+00:00 (in 58.001498 seconds)
exportactionlogsworker stdout | 2024-04-22 04:02:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:41 UTC)" (scheduled at 2024-04-22 04:02:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:02:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:02:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 2, 41, 565842), True, datetime.datetime(2024, 4, 22, 4, 2, 41, 565842), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:02:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:02:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:02:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:02:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:02:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:22.058978+00:00 (in 39.001215 seconds)
namespacegcworker stdout | 2024-04-22 04:02:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:43 UTC)" (scheduled at 2024-04-22 04:02:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:02:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:02:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 2, 43, 58190), True, datetime.datetime(2024, 4, 22, 4, 2, 43, 58190), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:02:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:02:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:02:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:03:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:02:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:02:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:02:53.759375+00:00 (in 9.999537 seconds)
notificationworker stdout | 2024-04-22 04:02:43,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:02:53 UTC)" (scheduled at 2024-04-22 04:02:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:02:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:02:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 2, 43, 760094), True, datetime.datetime(2024, 4, 22, 4, 2, 43, 760094), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:02:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:02:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:02:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:02:53 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:02:44,680 [278] [DEBUG] [app] Starting request: urn:request:44251753-5613-4e4e-b41e-7e2bb55cb1ed (/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:02:44,688 [278] [DEBUG] [endpoints.api.discovery] Unable to find method for POST in class <class 'endpoints.api.repository.RepositoryTrust'>
gunicorn-web stdout | 2024-04-22 04:02:44,713 [278] [DEBUG] [app] Ending request: urn:request:44251753-5613-4e4e-b41e-7e2bb55cb1ed (/) {'endpoint': 'web.index', 'request_id': 'urn:request:44251753-5613-4e4e-b41e-7e2bb55cb1ed', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/', 'path': '/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:02:44,714 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:02:44 +0000] "GET / HTTP/1.0" 200 93195 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:44 +0000] "GET / HTTP/1.1" 200 14249 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.035 812 0.035)
gcworker stdout | 2024-04-22 04:02:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:02:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:14.952062+00:00 (in 29.999522 seconds)
gcworker stdout | 2024-04-22 04:02:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:14 UTC)" (scheduled at 2024-04-22 04:02:44.952062+00:00)
gcworker stdout | 2024-04-22 04:02:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548964952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:02:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:02:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:02:44,966 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:14 UTC)" executed successfully
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:45 +0000] "GET /static/ldn/font-awesome.css-a166e3c966c6.css HTTP/1.1" 200 8417 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1012 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:45 +0000] "GET /static/ldn/jquery.js-3c5c5966471e.js HTTP/1.1" 200 102811 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 990 -)
gunicorn-web stdout | 2024-04-22 04:02:45,653 [278] [DEBUG] [app] Starting request: urn:request:32f57dc0-083e-4b54-bdaa-9b321783d50b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:02:45,653 [281] [DEBUG] [app] Starting request: urn:request:ff2a7f63-cc35-4537-9fcf-1c7015428109 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:02:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:02:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:02:45,656 [292] [DEBUG] [app] Starting request: urn:request:3827dc90-0477-4401-83e2-eeb89d12d734 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:02:45,656 [291] [DEBUG] [app] Starting request: urn:request:173d4f14-3354-420b-a4fe-0fa013b60257 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:02:45,657 [292] [DEBUG] [app] Ending request: urn:request:3827dc90-0477-4401-83e2-eeb89d12d734 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:3827dc90-0477-4401-83e2-eeb89d12d734', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:02:45,657 [291] [DEBUG] [app] Ending request: urn:request:173d4f14-3354-420b-a4fe-0fa013b60257 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:173d4f14-3354-420b-a4fe-0fa013b60257', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:02:45,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:02:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:02:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:02:45,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:02:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:02:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:02:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:02:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:02:45,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:02:45,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:02:45,660 [282] [DEBUG] [app] Starting request: urn:request:df67fdcc-c64b-4d20-987d-d1538856d096 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:02:45,660 [282] [DEBUG] [app] Ending request: urn:request:df67fdcc-c64b-4d20-987d-d1538856d096 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:df67fdcc-c64b-4d20-987d-d1538856d096', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:02:45,660 [281] [DEBUG] [app] Starting request: urn:request:9c477441-01cb-47a9-b110-e1180ce87b75 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:02:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:02:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:02:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:02:45,661 [281] [DEBUG] [app] Ending request: urn:request:9c477441-01cb-47a9-b110-e1180ce87b75 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9c477441-01cb-47a9-b110-e1180ce87b75', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:02:45,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:02:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:02:45,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:02:45,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:02:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:02:45,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:02:45,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:02:45,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:02:45,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:02:45,675 [281] [DEBUG] [app] Ending request: urn:request:ff2a7f63-cc35-4537-9fcf-1c7015428109 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:ff2a7f63-cc35-4537-9fcf-1c7015428109', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:02:45,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:02:45,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:02:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:02:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:02:45,676 [278] [DEBUG] [app] Ending request: urn:request:32f57dc0-083e-4b54-bdaa-9b321783d50b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:32f57dc0-083e-4b54-bdaa-9b321783d50b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:02:45,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:02:45,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:02:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:02:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:45 +0000] "GET /static/ldn/ng-tags-input.min.css-7782190f81cd.css HTTP/1.1" 200 1079 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1017 -)
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:02:45 +0000] "GET /static/ldn/cssfamilySourceSansPro300400700-30cd793a4b9b.css HTTP/1.1" 200 235 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1027 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:45 +0000] "GET /static/ldn/bootstrap-datetimepicker.min.css-4b15a4ede750.css HTTP/1.1" 200 1482 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1028 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:45 +0000] "GET /static/ldn/bootstrap.min.css-13f668494557.css HTTP/1.1" 200 24440 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1013 -)
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:02:45 +0000] "GET /static/ldn/cal-heatmap.css-904c3b9e8a60.css HTTP/1.1" 200 799 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1011 -)
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:02:46 +0000] "GET /static/ldn/bootstrap.min.js-0e773844b374.js HTTP/1.1" 200 11303 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 997 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:46 +0000] "GET /static/ldn/angular.min.js-f0f4228b82f7.js HTTP/1.1" 200 63500 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 995 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:46 +0000] "GET /static/ldn/angular-route.min.js-590b72b0eb88.js HTTP/1.1" 200 2248 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1001 -)
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:02:46 +0000] "GET /static/ldn/angular-sanitize.min.js-ff589de0ec1b.js HTTP/1.1" 200 3128 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1004 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:46 +0000] "GET /static/ldn/angular-animate.min.js-636f7a51b2e1.js HTTP/1.1" 200 10309 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1003 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:46 +0000] "GET /static/ldn/angular-cookies.min.js-2455ea25d522.js HTTP/1.1" 200 826 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1003 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:46 +0000] "GET /static/ldn/momentjs-66a52705d33f.js HTTP/1.1" 200 19477 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 989 -)
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:02:46 +0000] "GET /static/ldn/bootstrap-datepicker.min.js-3e3d8e141d5e.js HTTP/1.1" 200 9323 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1008 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:46 +0000] "GET /static/ldn/bootstrap-datetimepicker.min.js-6612bb423b71.js HTTP/1.1" 200 10832 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1012 -)
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:02:46 +0000] "GET /static/ldn/bootbox4.1.0underscorejs1.5.2restangular1.2.0d3js3.3.3-6d47ddfef9c5.js HTTP/1.1" 200 71199 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1035 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:46 +0000] "GET /static/ldn/raven.min.js-ecd480647a39.js HTTP/1.1" 200 9505 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 993 -)
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:02:46 +0000] "GET /static/ldn/cal-heatmap.min.js-8ffad728269a.js HTTP/1.1" 200 13004 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 999 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:46 +0000] "GET /static/ldn/angular-recaptcha.min.js-23859fca3602.js HTTP/1.1" 200 1793 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1005 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:47 +0000] "GET /static/ldn/ng-tags-input.min.js-fa3026ba8409.js HTTP/1.1" 200 6102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1001 -)
buildlogsarchiver stdout | 2024-04-22 04:02:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:02:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:17.052354+00:00 (in 29.999407 seconds)
buildlogsarchiver stdout | 2024-04-22 04:02:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:17 UTC)" (scheduled at 2024-04-22 04:02:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:02:47,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 2, 47, 53283), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:02:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:02:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:02:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:17 UTC)" executed successfully
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:47 +0000] "GET /static/ldn/typeahead.bundle.min.js-716151ca4e5d.js HTTP/1.1" 200 16673 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1004 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:47 +0000] "GET /static/build/main-quay-frontend-3d66b1aa00f3f01d8b3f.bundle.js HTTP/1.1" 200 726755 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.024 1016 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:47 +0000] "GET /static/standalonelib/jquery.overscroll.min.js HTTP/1.1" 200 3491 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 999 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:49 +0000] "GET /static/img/RedHat.svg HTTP/1.1" 200 1245 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 996 -)
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:02:49 +0000] "GET /static/build/135-quay-frontend.chunk.js HTTP/1.1" 200 975 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 993 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:49 +0000] "GET /static/build/18-quay-frontend.chunk.js HTTP/1.1" 200 997 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 992 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:49 +0000] "GET /static/build/83-quay-frontend.chunk.js HTTP/1.1" 200 1717 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 992 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:49 +0000] "GET /static/build/112-quay-frontend.chunk.js HTTP/1.1" 200 767 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 993 -)
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:02:49 +0000] "GET /static/build/181-quay-frontend.chunk.js HTTP/1.1" 200 952 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 993 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:49 +0000] "GET /static/build/152-quay-frontend.chunk.js HTTP/1.1" 200 313 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 993 -)
gunicorn-web stdout | 2024-04-22 04:02:49,405 [278] [DEBUG] [app] Starting request: urn:request:cfd6aaa0-cbd8-4cde-ac2a-91bb347f3421 (/api/v1/user/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:02:49,405 [279] [DEBUG] [app] Starting request: urn:request:97c9f9e2-ebe6-4eeb-b92f-d25c0344de05 (/api/v1/messages) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:02:49,406 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."content", "t1"."uuid", "t1"."severity", "t1"."media_type_id", "t2"."id", "t2"."name" FROM "messages" AS "t1" INNER JOIN "mediatype" AS "t2" ON ("t1"."media_type_id" = "t2"."id")', [])
gunicorn-web stdout | 2024-04-22 04:02:49,406 [278] [DEBUG] [app] Ending request: urn:request:cfd6aaa0-cbd8-4cde-ac2a-91bb347f3421 (/api/v1/user/) {'endpoint': 'api.user', 'request_id': 'urn:request:cfd6aaa0-cbd8-4cde-ac2a-91bb347f3421', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/', 'path': '/api/v1/user/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:02:49,407 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:02:49 +0000] "GET /api/v1/user/ HTTP/1.0" 401 311 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:49 +0000] "GET /api/v1/user/ HTTP/1.1" 401 311 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.003 1106 0.003)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:49 +0000] "GET /static/img/RH_Logo_Quay_Black_UX-horizontal.svg HTTP/1.1" 200 3222 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1022 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:49 +0000] "GET /static/fonts/fontawesome-webfont.woff2?v=4.7.0 HTTP/1.1" 200 77160 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/static/ldn/font-awesome.css-a166e3c966c6.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1093 -)
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:02:49 +0000] "GET /static/img/network-tile.png HTTP/1.1" 200 6289 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1002 -)
gunicorn-web stdout | 2024-04-22 04:02:49,416 [279] [DEBUG] [app] Ending request: urn:request:97c9f9e2-ebe6-4eeb-b92f-d25c0344de05 (/api/v1/messages) {'endpoint': 'api.globalusermessages', 'request_id': 'urn:request:97c9f9e2-ebe6-4eeb-b92f-d25c0344de05', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/messages', 'path': '/api/v1/messages', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:02:49,416 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:02:49,417 [279] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:02:49 +0000] "GET /api/v1/messages HTTP/1.0" 200 17 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:02:49 +0000] "GET /api/v1/messages HTTP/1.1" 200 17 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.013 1109 0.013)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:49 +0000] "GET /static/img/quay_favicon.png HTTP/1.1" 200 3558 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1022 -)
expiredappspecifictokenworker stdout | 2024-04-22 04:02:49,928 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:02:51,418 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
gunicorn-web stdout | 2024-04-22 04:02:51,839 [282] [DEBUG] [app] Starting request: urn:request:0c562ad2-be8b-4fc6-86ea-31b924708e59 (/api/v1/signin) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:02:51,841 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) OR ("t1"."email" = %s)) LIMIT %s OFFSET %s', ['whuquay', 'whuquay', 1, 0])
gunicorn-web stdout | 2024-04-22 04:02:52,088 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:02:52,091 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:02:52,093 [282] [DEBUG] [endpoints.common] Successfully signed in as user whuquay with uuid a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,093 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:02:52,094 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,095 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['whuquay', 1, 0])
gunicorn-web stdout | 2024-04-22 04:02:52,097 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "logentrykind" AS "t1"', [])
gunicorn-web stdout | 2024-04-22 04:02:52,101 [282] [DEBUG] [peewee] ('INSERT INTO "logentry3" ("kind_id", "account_id", "performer_id", "repository_id", "datetime", "ip", "metadata_json") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "logentry3"."id"', [97, 1, None, None, datetime.datetime(2024, 4, 22, 4, 2, 52, 94266), '10.131.0.9', '{"type": "quayauth", "useragent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"}'])
gunicorn-web stdout | 2024-04-22 04:02:52,107 [282] [DEBUG] [app] Ending request: urn:request:0c562ad2-be8b-4fc6-86ea-31b924708e59 (/api/v1/signin) {'endpoint': 'api.signin', 'request_id': 'urn:request:0c562ad2-be8b-4fc6-86ea-31b924708e59', 'remote_addr': '10.131.0.9', 'http_method': 'POST', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/signin', 'path': '/api/v1/signin', 'parameters': {}, 'json_body': {'username': 'whuquay', 'password': '[FILTERED]'}, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:02:52,108 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:02:52,108 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:02:52 +0000] "POST /api/v1/signin HTTP/1.0" 200 18 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:52 +0000] "POST /api/v1/signin HTTP/1.1" 200 18 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.271 1339 0.270)
gunicorn-web stdout | 2024-04-22 04:02:52,464 [278] [DEBUG] [app] Starting request: urn:request:641cac1c-66ee-4748-9d09-6aeeb0f3f79c (/api/v1/user/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:02:52,464 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,465 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,466 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:02:52,475 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:02:52,475 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:02:52,475 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,476 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,476 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:02:52,476 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:02:52,476 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:02:52,477 [278] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" INNER JOIN "team" AS "t2" ON ("t2"."organization_id" = "t1"."id") INNER JOIN "teammember" AS "t3" ON ("t3"."team_id" = "t2"."id") INNER JOIN "user" AS "t4" ON ("t4"."id" = "t3"."user_id") WHERE (("t1"."organization" = %s) AND ("t4"."username" = %s))', [True, 'whuquay'])
gunicorn-web stdout | 2024-04-22 04:02:52,482 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,483 [278] [DEBUG] [peewee] ('SELECT "t1"."service_ident", "t2"."name", "t1"."metadata_json" FROM "federatedlogin" AS "t1" INNER JOIN "loginservice" AS "t2" ON ("t1"."service_id" = "t2"."id") WHERE (("t2"."name" != %s) AND ("t1"."user_id" = %s))', ['quayrobot', 1])
gunicorn-web stdout | 2024-04-22 04:02:52,486 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."kind_id" FROM "userprompt" AS "t1" INNER JOIN "userpromptkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE ("t1"."user_id" = %s)', [1])
gunicorn-web stdout | 2024-04-22 04:02:52,489 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['whuquay', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:02:52,492 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['whuquay'])
gunicorn-web stdout | 2024-04-22 04:02:52,494 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['whuquay', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:02:52,497 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['whuquay'])
gunicorn-web stdout | 2024-04-22 04:02:52,499 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."size_bytes", "t1"."backfill_start_ms", "t1"."backfill_complete" FROM "quotanamespacesize" AS "t1" WHERE ("t1"."namespace_user_id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:02:52,501 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,501 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,501 [278] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:02:52,502 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,502 [278] [DEBUG] [app] Ending request: urn:request:641cac1c-66ee-4748-9d09-6aeeb0f3f79c (/api/v1/user/) {'endpoint': 'api.user', 'request_id': 'urn:request:641cac1c-66ee-4748-9d09-6aeeb0f3f79c', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/', 'path': '/api/v1/user/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:02:52,503 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:02:52,503 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:02:52 +0000] "GET /api/v1/user/ HTTP/1.0" 200 726 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:52 +0000] "GET /api/v1/user/ HTTP/1.1" 200 726 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.040 1377 0.040)
gunicorn-web stdout | 2024-04-22 04:02:52,824 [278] [DEBUG] [app] Starting request: urn:request:4fe81016-02a0-4a76-919a-468f64adb27c (/api/v1/user/apptoken) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:02:52,824 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,824 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,825 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:02:52,827 [282] [DEBUG] [app] Starting request: urn:request:b63b34f3-a2c5-4c59-8634-aaaf8473d617 (/api/v1/user/notifications) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:02:52,828 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,828 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,828 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:02:52,834 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:02:52,834 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:02:52,834 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,834 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:02:52,834 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,834 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:02:52,834 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:02:52,834 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:02:52,835 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."uuid", "t1"."title", "t1"."token_name", "t1"."token_secret", "t1"."created", "t1"."expiration", "t1"."last_accessed" FROM "appspecificauthtoken" AS "t1" WHERE ((("t1"."user_id" = %s) AND ("t1"."expiration" <= %s)) AND ("t1"."expiration" > %s))', [1, datetime.datetime(2024, 4, 24, 23, 14, 52, 834975), datetime.datetime(2024, 4, 22, 4, 2, 52, 835036)])
gunicorn-web stdout | 2024-04-22 04:02:52,837 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:02:52,837 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:02:52,837 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,837 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:02:52,837 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,837 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:02:52,837 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:02:52,837 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:02:52,837 [278] [DEBUG] [app] Ending request: urn:request:4fe81016-02a0-4a76-919a-468f64adb27c (/api/v1/user/apptoken) {'endpoint': 'api.apptokens', 'request_id': 'urn:request:4fe81016-02a0-4a76-919a-468f64adb27c', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/apptoken?expiring=true', 'path': '/api/v1/user/apptoken', 'parameters': {'expiring': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:02:52,838 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:02:52,838 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:02:52 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:52 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.1" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.015 1419 0.015)
gunicorn-web stdout | 2024-04-22 04:02:52,839 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."dismissed" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."dismissed" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', [False, 1, False, 1, 'admin', 6])
gunicorn-web stdout | 2024-04-22 04:02:52,844 [282] [DEBUG] [app] Ending request: urn:request:b63b34f3-a2c5-4c59-8634-aaaf8473d617 (/api/v1/user/notifications) {'endpoint': 'api.usernotificationlist', 'request_id': 'urn:request:b63b34f3-a2c5-4c59-8634-aaaf8473d617', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/notifications', 'path': '/api/v1/user/notifications', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:02:52,844 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:52 +0000] "GET /api/v1/user/notifications HTTP/1.1" 200 43 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.019 1410 0.019)
gunicorn-web stdout | 2024-04-22 04:02:52,845 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:02:52 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 43 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:02:52,989 [282] [DEBUG] [app] Starting request: urn:request:b8448e19-6c48-4b51-b7f5-2d815fac15fa (/api/v1/repository) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:02:52,989 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,989 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,989 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:02:52,990 [279] [DEBUG] [app] Starting request: urn:request:7d0fae4a-c7ca-4504-9143-aa21b029a754 (/api/v1/repository) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:02:52,990 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,990 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,991 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:02:52,998 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:02:52,998 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:02:52,998 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,999 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:52,999 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:02:52,999 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:02:52,999 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:02:52,999 [282] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:02:52,999 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:02:52,999 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:02:53,000 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:02:53,000 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['whuquay', 1, 0])
gunicorn-web stdout | 2024-04-22 04:02:53,000 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1"', [])
gunicorn-web stdout | 2024-04-22 04:02:53,002 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1"', [])
gunicorn-web stdout | 2024-04-22 04:02:53,004 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name", "t1"."id" AS "rid" FROM "repository" AS "t1" INNER JOIN "star" AS "t4" ON ("t4"."repository_id" = "t1"."id") INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "visibility" AS "t3" ON ("t1"."visibility_id" = "t3"."id") WHERE ((("t4"."user_id" = %s) AND ("t1"."kind_id" = %s)) AND ("t1"."state" != %s))', [1, 1, 3])
gunicorn-web stdout | 2024-04-22 04:02:53,004 [282] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."name", "t1"."id" AS "rid", "t1"."description", "t2"."username", "t1"."visibility_id", "t1"."kind_id", "t1"."state" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") LEFT OUTER JOIN "repositorypermission" AS "t3" ON ("t3"."repository_id" = "t1"."id") WHERE ((("t1"."state" != %s) AND ("t1"."kind_id" = %s)) AND ("t2"."username" = %s)) ORDER BY rid LIMIT %s', [3, 1, 'whuquay', 101])
gunicorn-web stdout | 2024-04-22 04:02:53,008 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name", "t1"."id" AS "rid" FROM "repository" AS "t1" INNER JOIN "star" AS "t4" ON ("t4"."repository_id" = "t1"."id") INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "visibility" AS "t3" ON ("t1"."visibility_id" = "t3"."id") WHERE ((("t4"."user_id" = %s) AND ("t1"."kind_id" = %s)) AND ("t1"."state" != %s))', [1, 1, 3])
gunicorn-web stdout | 2024-04-22 04:02:53,009 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name", "t1"."id" AS "rid" FROM "repository" AS "t1" INNER JOIN "star" AS "t4" ON ("t4"."repository_id" = "t1"."id") INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "visibility" AS "t3" ON ("t1"."visibility_id" = "t3"."id") WHERE ((("t4"."user_id" = %s) AND ("t1"."kind_id" = %s)) AND ("t1"."state" != %s))', [1, 1, 3])
gunicorn-web stdout | 2024-04-22 04:02:53,011 [279] [DEBUG] [app] Ending request: urn:request:7d0fae4a-c7ca-4504-9143-aa21b029a754 (/api/v1/repository) {'endpoint': 'api.repositorylist', 'request_id': 'urn:request:7d0fae4a-c7ca-4504-9143-aa21b029a754', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository?last_modified=true&popularity=true&starred=true', 'path': '/api/v1/repository', 'parameters': {'last_modified': 'true', 'popularity': 'true', 'starred': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:02:53,011 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:02:53,012 [279] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:02:53 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/1.0" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:02:53 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/1.1" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.023 1461 0.023)
gunicorn-web stdout | 2024-04-22 04:02:53,012 [282] [DEBUG] [app] Ending request: urn:request:b8448e19-6c48-4b51-b7f5-2d815fac15fa (/api/v1/repository) {'endpoint': 'api.repositorylist', 'request_id': 'urn:request:b8448e19-6c48-4b51-b7f5-2d815fac15fa', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository?last_modified=true&namespace=whuquay&popularity=true&quota=true&state=true', 'path': '/api/v1/repository', 'parameters': {'last_modified': 'true', 'namespace': 'whuquay', 'popularity': 'true', 'quota': 'true', 'state': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:02:53,013 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:02:53,013 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:02:53 +0000] "GET /api/v1/repository?last_modified=true&namespace=whuquay&popularity=true&quota=true&state=true HTTP/1.0" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:53 +0000] "GET /api/v1/repository?last_modified=true&namespace=whuquay&popularity=true&quota=true&state=true HTTP/1.1" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.025 1488 0.025)
notificationworker stdout | 2024-04-22 04:02:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:02:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:03.759375+00:00 (in 9.999537 seconds)
notificationworker stdout | 2024-04-22 04:02:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:03:03 UTC)" (scheduled at 2024-04-22 04:02:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:02:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:02:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 2, 53, 760243), True, datetime.datetime(2024, 4, 22, 4, 2, 53, 760243), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:02:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:02:53,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:02:53,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:03:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:02:55,045 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 04:02:56,767 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 04:02:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:02:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:05.871852+00:00 (in 8.998224 seconds)
securityworker stdout | 2024-04-22 04:02:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:26 UTC)" (scheduled at 2024-04-22 04:02:56.873109+00:00)
securityworker stdout | 2024-04-22 04:02:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:02:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:02:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:02:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:02:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:02:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:02:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:02:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:02:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:02:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:02:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:02:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:02:56,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 57, 56, 880795), 1, 2])
securityworker stdout | 2024-04-22 04:02:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:02:56,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:02:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 57, 56, 880795), 1, 2])
securityworker stdout | 2024-04-22 04:02:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:02:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:02:56,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:02:56,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:02:56,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:02:56,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:02:56,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:02:56,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:02:56,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:02:56,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:26 UTC)" executed successfully
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:02:56 +0000] "GET /static/build/489e5e00e1a9a80f88d55281894a87ff.woff HTTP/1.1" 200 7280 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1344 -)
repositorygcworker stdout | 2024-04-22 04:02:58,129 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
teamsyncworker stdout | 2024-04-22 04:03:00,024 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 04:03:00,027 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:03:00,030 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:03:00,034 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:03:00,037 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:03:00,040 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
chunkcleanupworker stdout | 2024-04-22 04:03:00,192 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:03:00,653 [278] [DEBUG] [app] Starting request: urn:request:2e5206f7-ebd0-44ff-95bc-c368cc336a14 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:03:00,653 [282] [DEBUG] [app] Starting request: urn:request:56cba09a-eea7-46f9-9631-46f0adfbf6a2 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:03:00,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:03:00,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:03:00,656 [292] [DEBUG] [app] Starting request: urn:request:aa2c8b15-da4d-474d-b48f-c9d5cefb5b41 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:03:00,657 [291] [DEBUG] [app] Starting request: urn:request:4313fdb3-e764-40c1-87e2-579046dce6c9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:03:00,657 [292] [DEBUG] [app] Ending request: urn:request:aa2c8b15-da4d-474d-b48f-c9d5cefb5b41 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:aa2c8b15-da4d-474d-b48f-c9d5cefb5b41', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:03:00,657 [291] [DEBUG] [app] Ending request: urn:request:4313fdb3-e764-40c1-87e2-579046dce6c9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:4313fdb3-e764-40c1-87e2-579046dce6c9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:03:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:03:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:03:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:03:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:03:00,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:03:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:03:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:03:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:03:00,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:03:00,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:03:00,660 [278] [DEBUG] [app] Starting request: urn:request:d4de515b-95d1-4dcc-bc92-599b79f878ae (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:03:00,660 [281] [DEBUG] [app] Starting request: urn:request:d3da8de9-62c2-46f4-8e60-f2f891b1bf69 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:03:00,661 [278] [DEBUG] [app] Ending request: urn:request:d4de515b-95d1-4dcc-bc92-599b79f878ae (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d4de515b-95d1-4dcc-bc92-599b79f878ae', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:03:00,661 [281] [DEBUG] [app] Ending request: urn:request:d3da8de9-62c2-46f4-8e60-f2f891b1bf69 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d3da8de9-62c2-46f4-8e60-f2f891b1bf69', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:03:00,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:03:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:03:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:03:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:03:00,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:03:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:03:00,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:03:00,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:03:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:03:00,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:03:00,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:03:00,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:03:00,675 [282] [DEBUG] [app] Ending request: urn:request:56cba09a-eea7-46f9-9631-46f0adfbf6a2 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:56cba09a-eea7-46f9-9631-46f0adfbf6a2', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:03:00,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:00,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:03:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:03:00,676 [278] [DEBUG] [app] Ending request: urn:request:2e5206f7-ebd0-44ff-95bc-c368cc336a14 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2e5206f7-ebd0-44ff-95bc-c368cc336a14', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:03:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 04:03:00,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:00,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:03:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:03:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
quotaregistrysizeworker stdout | 2024-04-22 04:03:01,027 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:03:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:03:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:16.552337+00:00 (in 13.995601 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:03:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:02 UTC)" (scheduled at 2024-04-22 04:03:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:03:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:03:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:03:02,631 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:03:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:03:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:13.759375+00:00 (in 9.999534 seconds)
notificationworker stdout | 2024-04-22 04:03:03,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:03:13 UTC)" (scheduled at 2024-04-22 04:03:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:03:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:03:03,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 3, 3, 760129), True, datetime.datetime(2024, 4, 22, 4, 3, 3, 760129), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:03:03,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:03:03,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:03:03,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:03:13 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:03:03,898 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:03:04,181 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:03:04,403 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:03:04,644 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:03:04,648 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:03:04,654 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:03:05,456 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:03:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:03:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:26.873109+00:00 (in 21.000759 seconds)
securityworker stdout | 2024-04-22 04:03:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:35 UTC)" (scheduled at 2024-04-22 04:03:05.871852+00:00)
securityworker stdout | 2024-04-22 04:03:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:03:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:03:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:03:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:03:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:03:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:03:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:35 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:03:06,515 [281] [DEBUG] [app] Starting request: urn:request:c8f54bcb-1241-4d4e-96e5-d6a85fd4d398 (/api/v1/organization/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:03:06,515 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,515 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,516 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:06,526 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:06,526 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:06,526 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,527 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:03:06,527 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,527 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:06,527 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:06,527 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:06,528 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:06,531 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['build_test', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:06,534 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) OR ("t1"."email" = %s)) LIMIT %s OFFSET %s', ['build_test', 'bogus1@bougs.com', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:06,536 [281] [DEBUG] [data.model.user] Email and username are unique!
gunicorn-web stdout | 2024-04-22 04:03:06,537 [281] [DEBUG] [peewee] ('INSERT INTO "user" ("uuid", "username", "email", "verified", "organization", "robot", "invoice_email", "invalid_login_attempts", "last_invalid_login", "removed_tag_expiration_s", "enabled", "maximum_queued_builds_count", "creation_date") VALUES (%s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s) RETURNING "user"."id"', ['eb4c7b0e-ee31-410e-9967-c2d6258495e4', 'build_test', 'bogus1@bougs.com', False, False, False, False, 0, datetime.datetime(2024, 4, 22, 4, 3, 6, 536899), 1209600, True, None, datetime.datetime(2024, 4, 22, 4, 3, 6, 536902)])
gunicorn-web stdout | 2024-04-22 04:03:06,538 [281] [DEBUG] [peewee] ('UPDATE "user" SET "uuid" = %s, "username" = %s, "email" = %s, "verified" = %s, "organization" = %s, "robot" = %s, "invoice_email" = %s, "invalid_login_attempts" = %s, "last_invalid_login" = %s, "removed_tag_expiration_s" = %s, "enabled" = %s, "maximum_queued_builds_count" = %s, "creation_date" = %s WHERE ("user"."id" = %s)', ['eb4c7b0e-ee31-410e-9967-c2d6258495e4', 'build_test', 'bogus1@bougs.com', False, True, False, False, 0, datetime.datetime(2024, 4, 22, 4, 3, 6, 536899), 1209600, True, None, datetime.datetime(2024, 4, 22, 4, 3, 6, 536902), 2])
gunicorn-web stdout | 2024-04-22 04:03:06,539 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['admin', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:06,541 [281] [DEBUG] [peewee] ('INSERT INTO "team" ("name", "organization_id", "role_id", "description") VALUES (%s, %s, %s, %s) RETURNING "team"."id"', ['owners', 2, 1, ''])
gunicorn-web stdout | 2024-04-22 04:03:06,543 [281] [DEBUG] [peewee] ('INSERT INTO "teammember" ("user_id", "team_id") VALUES (%s, %s) RETURNING "teammember"."id"', [1, 1])
gunicorn-web stdout | 2024-04-22 04:03:06,548 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:06,550 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "logentrykind" AS "t1"', [])
repositorygcworker stdout | 2024-04-22 04:03:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:03:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:13.555667+00:00 (in 7.002692 seconds)
repositorygcworker stdout | 2024-04-22 04:03:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:06 UTC)" (scheduled at 2024-04-22 04:03:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:03:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
gunicorn-web stdout | 2024-04-22 04:03:06,553 [281] [DEBUG] [peewee] ('INSERT INTO "logentry3" ("kind_id", "account_id", "performer_id", "repository_id", "datetime", "ip", "metadata_json") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "logentry3"."id"', [80, 2, 1, None, datetime.datetime(2024, 4, 22, 4, 3, 6, 547431), '10.131.0.9', '{"email": "bogus1@bougs.com", "namespace": "build_test"}'])
repositorygcworker stdout | 2024-04-22 04:03:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 3, 6, 553366), True, datetime.datetime(2024, 4, 22, 4, 3, 6, 553366), 0, 'repositorygc/%', 50, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:06,560 [281] [DEBUG] [app] Ending request: urn:request:c8f54bcb-1241-4d4e-96e5-d6a85fd4d398 (/api/v1/organization/) {'endpoint': 'api.organizationlist', 'request_id': 'urn:request:c8f54bcb-1241-4d4e-96e5-d6a85fd4d398', 'remote_addr': '10.131.0.9', 'http_method': 'POST', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/organization/', 'path': '/api/v1/organization/', 'parameters': {}, 'json_body': {'name': 'build_test', 'email': 'bogus1@bougs.com'}, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:06,561 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:06,561 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:03:06 +0000] "POST /api/v1/organization/ HTTP/1.0" 201 10 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organizations/new/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:06 +0000] "POST /api/v1/organization/ HTTP/1.1" 201 10 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organizations/new/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.047 1639 0.047)
repositorygcworker stdout | 2024-04-22 04:03:06,563 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:03:06,563 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:03:06,563 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:06 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:03:06,620 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:03:06,734 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:03:06,861 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
gunicorn-web stdout | 2024-04-22 04:03:06,888 [282] [DEBUG] [app] Starting request: urn:request:de451a7b-c695-4e36-8704-8bb1ab57f989 (/api/v1/user/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:03:06,888 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,888 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,889 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:06,895 [281] [DEBUG] [app] Starting request: urn:request:af16916c-1eba-4f26-952d-9afafd6b82eb (/api/v1/organization/build_test) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:03:06,895 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,895 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,895 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:06,899 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:06,899 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:06,899 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,899 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,899 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:06,899 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:06,899 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:06,900 [282] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" INNER JOIN "team" AS "t2" ON ("t2"."organization_id" = "t1"."id") INNER JOIN "teammember" AS "t3" ON ("t3"."team_id" = "t2"."id") INNER JOIN "user" AS "t4" ON ("t4"."id" = "t3"."user_id") WHERE (("t1"."organization" = %s) AND ("t4"."username" = %s))', [True, 'whuquay'])
gunicorn-web stdout | 2024-04-22 04:03:06,904 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,904 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:06,905 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:06,905 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,905 [282] [DEBUG] [peewee] ('SELECT "t1"."service_ident", "t2"."name", "t1"."metadata_json" FROM "federatedlogin" AS "t1" INNER JOIN "loginservice" AS "t2" ON ("t1"."service_id" = "t2"."id") WHERE (("t2"."name" != %s) AND ("t1"."user_id" = %s))', ['quayrobot', 1])
gunicorn-web stdout | 2024-04-22 04:03:06,905 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:06,907 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."kind_id" FROM "userprompt" AS "t1" INNER JOIN "userpromptkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE ("t1"."user_id" = %s)', [1])
gunicorn-web stdout | 2024-04-22 04:03:06,907 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,907 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:06,907 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:06,907 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:06,909 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:03:06,910 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['whuquay', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:06,912 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['whuquay'])
gunicorn-web stdout | 2024-04-22 04:03:06,912 [281] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:06,912 [281] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:06,912 [281] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:06,912 [281] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:06,913 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t2" ON ("t1"."role_id" = "t2"."id") WHERE ("t1"."organization_id" = %s)', [2])
gunicorn-web stdout | 2024-04-22 04:03:06,914 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['whuquay', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:06,915 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1"', [])
gunicorn-web stdout | 2024-04-22 04:03:06,917 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['whuquay'])
gunicorn-web stdout | 2024-04-22 04:03:06,917 [281] [DEBUG] [peewee] ('SELECT "t1"."team_id", Count("t1"."id") FROM "repositorypermission" AS "t1" WHERE ("t1"."team_id" IN (%s)) GROUP BY "t1"."team_id"', [1])
gunicorn-web stdout | 2024-04-22 04:03:06,919 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."size_bytes", "t1"."backfill_start_ms", "t1"."backfill_complete" FROM "quotanamespacesize" AS "t1" WHERE ("t1"."namespace_user_id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:06,920 [281] [DEBUG] [peewee] ('SELECT "t1"."team_id", Count("t1"."id") FROM "teammember" AS "t1" WHERE ("t1"."team_id" IN (%s)) GROUP BY "t1"."team_id"', [1])
gunicorn-web stdout | 2024-04-22 04:03:06,921 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,921 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,921 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,922 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,922 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,922 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['build_test'])
gunicorn-web stdout | 2024-04-22 04:03:06,922 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:03:06,924 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['build_test', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:06,925 [282] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:06,925 [282] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:06,925 [282] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:06,925 [282] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:06,925 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,925 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,925 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:06,926 [282] [DEBUG] [app] Ending request: urn:request:de451a7b-c695-4e36-8704-8bb1ab57f989 (/api/v1/user/) {'endpoint': 'api.user', 'request_id': 'urn:request:de451a7b-c695-4e36-8704-8bb1ab57f989', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/', 'path': '/api/v1/user/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:06,926 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:06,927 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:03:06 +0000] "GET /api/v1/user/ HTTP/1.0" 200 987 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organizations/new/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:06 +0000] "GET /api/v1/user/ HTTP/1.1" 200 987 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organizations/new/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.039 1442 0.039)
gunicorn-web stdout | 2024-04-22 04:03:06,927 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['build_test'])
gunicorn-web stdout | 2024-04-22 04:03:06,929 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."size_bytes", "t1"."backfill_start_ms", "t1"."backfill_complete" FROM "quotanamespacesize" AS "t1" WHERE ("t1"."namespace_user_id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:06,932 [281] [DEBUG] [app] Ending request: urn:request:af16916c-1eba-4f26-952d-9afafd6b82eb (/api/v1/organization/build_test) {'endpoint': 'api.organization', 'request_id': 'urn:request:af16916c-1eba-4f26-952d-9afafd6b82eb', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/organization/build_test', 'path': '/api/v1/organization/build_test', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:06,932 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:06 +0000] "GET /api/v1/organization/build_test HTTP/1.1" 200 803 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.039 1465 0.039)
gunicorn-web stdout | 2024-04-22 04:03:06,932 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:03:06 +0000] "GET /api/v1/organization/build_test HTTP/1.0" 200 803 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:03:07,243 [282] [DEBUG] [app] Starting request: urn:request:0a1e3702-c6ae-41ce-9457-5902bf8b72b4 (/api/v1/user/apptoken) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:03:07,243 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,243 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,244 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:07,248 [281] [DEBUG] [app] Starting request: urn:request:573cec31-2315-466b-a34f-5412bebbe018 (/api/v1/user/notifications) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:03:07,248 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,248 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,248 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:07,254 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:07,254 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:07,254 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,254 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:03:07,254 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,254 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,254 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,254 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,255 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."uuid", "t1"."title", "t1"."token_name", "t1"."token_secret", "t1"."created", "t1"."expiration", "t1"."last_accessed" FROM "appspecificauthtoken" AS "t1" WHERE ((("t1"."user_id" = %s) AND ("t1"."expiration" <= %s)) AND ("t1"."expiration" > %s))', [1, datetime.datetime(2024, 4, 24, 23, 15, 7, 254849), datetime.datetime(2024, 4, 22, 4, 3, 7, 254901)])
gunicorn-web stdout | 2024-04-22 04:03:07,257 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:07,257 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:07,257 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,257 [282] [DEBUG] [app] Ending request: urn:request:0a1e3702-c6ae-41ce-9457-5902bf8b72b4 (/api/v1/user/apptoken) {'endpoint': 'api.apptokens', 'request_id': 'urn:request:0a1e3702-c6ae-41ce-9457-5902bf8b72b4', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/apptoken?expiring=true', 'path': '/api/v1/user/apptoken', 'parameters': {'expiring': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:07,257 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:03:07,257 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,257 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,258 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,258 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,258 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:07 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.1" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.016 1469 0.016)
gunicorn-web stdout | 2024-04-22 04:03:07,258 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:03:07 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:03:07,259 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."dismissed" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."dismissed" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', [False, 1, False, 1, 'admin', 6])
gunicorn-web stdout | 2024-04-22 04:03:07,264 [281] [DEBUG] [app] Ending request: urn:request:573cec31-2315-466b-a34f-5412bebbe018 (/api/v1/user/notifications) {'endpoint': 'api.usernotificationlist', 'request_id': 'urn:request:573cec31-2315-466b-a34f-5412bebbe018', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/notifications', 'path': '/api/v1/user/notifications', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:07,265 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:07,265 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:03:07 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 43 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:07 +0000] "GET /api/v1/user/notifications HTTP/1.1" 200 43 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.019 1460 0.018)
gunicorn-web stdout | 2024-04-22 04:03:07,306 [282] [DEBUG] [app] Starting request: urn:request:246f8087-ca60-4c74-8c37-395ef16b66aa (/api/v1/organization/build_test/proxycache) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:03:07,306 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,306 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,306 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:07,306 [278] [DEBUG] [app] Starting request: urn:request:f9092949-bf9a-49e0-b1ad-421d619745ca (/api/v1/organization/build_test/quota) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:07,307 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,307 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,307 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:07,315 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:07,315 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:07,315 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,316 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,316 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,316 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,316 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,316 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:07,316 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:07,316 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,316 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,316 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,316 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,316 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,317 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:03:07,318 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:03:07,320 [282] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,320 [282] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,320 [282] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,320 [282] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:07,321 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."organization_id", "t1"."creation_date", "t1"."upstream_registry", "t1"."upstream_registry_username", "t1"."upstream_registry_password", "t1"."expiration_s", "t1"."insecure" FROM "proxycacheconfig" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") WHERE (("t2"."username" = %s) AND ("t2"."organization" = %s)) LIMIT %s OFFSET %s', ['build_test', True, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:07,321 [278] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,321 [278] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,321 [278] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,321 [278] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:07,322 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:07,324 [282] [DEBUG] [app] Ending request: urn:request:246f8087-ca60-4c74-8c37-395ef16b66aa (/api/v1/organization/build_test/proxycache) {'endpoint': 'api.organizationproxycacheconfig', 'request_id': 'urn:request:246f8087-ca60-4c74-8c37-395ef16b66aa', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/organization/build_test/proxycache', 'path': '/api/v1/organization/build_test/proxycache', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:07,324 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:07,324 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['build_test'])
gunicorn-web stdout | 2024-04-22 04:03:07,325 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:03:07 +0000] "GET /api/v1/organization/build_test/proxycache HTTP/1.0" 200 62 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:07 +0000] "GET /api/v1/organization/build_test/proxycache HTTP/1.1" 200 62 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.019 1476 0.019)
gunicorn-web stdout | 2024-04-22 04:03:07,327 [278] [DEBUG] [app] Ending request: urn:request:f9092949-bf9a-49e0-b1ad-421d619745ca (/api/v1/organization/build_test/quota) {'endpoint': 'api.organizationquotalist', 'request_id': 'urn:request:f9092949-bf9a-49e0-b1ad-421d619745ca', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/organization/build_test/quota', 'path': '/api/v1/organization/build_test/quota', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:07,327 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:07,327 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:07 +0000] "GET /api/v1/organization/build_test/quota HTTP/1.0" 200 3 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:07 +0000] "GET /api/v1/organization/build_test/quota HTTP/1.1" 200 3 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.022 1471 0.022)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:07 +0000] "GET /static/img/creditcards/credit.png HTTP/1.1" 200 1776 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1382 -)
gunicorn-web stdout | 2024-04-22 04:03:07,357 [278] [DEBUG] [app] Starting request: urn:request:e6f40bdf-ae25-4bce-8261-e7ebf636f28b (/api/v1/organization/build_test/prototypes) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:07,357 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,357 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,357 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:07,366 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:07,366 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:07,366 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,366 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,366 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,366 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,366 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,367 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:03:07,371 [278] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,371 [278] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,371 [278] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,371 [278] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:07,371 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:07,374 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."org_id", "t1"."uuid", "t1"."activating_user_id", "t1"."delegate_user_id", "t1"."delegate_team_id", "t1"."role_id" FROM "permissionprototype" AS "t1" LEFT OUTER JOIN "user" AS "t2" ON ("t2"."id" = "t1"."activating_user_id") LEFT OUTER JOIN "user" AS "t3" ON ("t3"."id" = "t1"."delegate_user_id") LEFT OUTER JOIN "team" AS "t4" ON ("t4"."id" = "t1"."delegate_team_id") LEFT OUTER JOIN "role" AS "t5" ON ("t5"."id" = "t1"."role_id") WHERE ("t1"."org_id" = %s)', [2])
gunicorn-web stdout | 2024-04-22 04:03:07,378 [278] [DEBUG] [app] Ending request: urn:request:e6f40bdf-ae25-4bce-8261-e7ebf636f28b (/api/v1/organization/build_test/prototypes) {'endpoint': 'api.permissionprototypelist', 'request_id': 'urn:request:e6f40bdf-ae25-4bce-8261-e7ebf636f28b', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/organization/build_test/prototypes', 'path': '/api/v1/organization/build_test/prototypes', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:07,378 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:07,378 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:07 +0000] "GET /api/v1/organization/build_test/prototypes HTTP/1.0" 200 19 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:07 +0000] "GET /api/v1/organization/build_test/prototypes HTTP/1.1" 200 19 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.022 1509 0.022)
gunicorn-web stdout | 2024-04-22 04:03:07,567 [282] [DEBUG] [app] Starting request: urn:request:f55df2ce-5525-4a8d-946b-d411195b1821 (/api/v1/repository) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:03:07,567 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,568 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,568 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:07,577 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:07,577 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:07,577 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,577 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:07,578 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,578 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,578 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:07,578 [282] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:07,578 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['whuquay', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:07,580 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['public', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:07,583 [282] [DEBUG] [peewee] ('(SELECT DISTINCT "t1"."name", "t1"."id" AS "rid", "t1"."description", "t2"."username", "t1"."visibility_id", "t1"."kind_id", "t1"."state" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") LEFT OUTER JOIN "repositorypermission" AS "t3" ON ("t3"."repository_id" = "t1"."id") WHERE (((("t1"."state" != %s) AND ("t1"."kind_id" = %s)) AND ("t2"."username" = %s)) AND ("t1"."visibility_id" = %s))) UNION (SELECT DISTINCT "t4"."name", "t4"."id" AS "rid", "t4"."description", "t5"."username", "t4"."visibility_id", "t4"."kind_id", "t4"."state" FROM "repository" AS "t4" INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "repositorypermission" AS "t6" ON ("t6"."repository_id" = "t4"."id") WHERE ((("t4"."state" != %s) AND ("t4"."kind_id" = %s)) AND ("t5"."username" = %s))) ORDER BY rid LIMIT %s', [3, 1, 'build_test', 1, 3, 1, 'build_test', 101])
gunicorn-web stdout | 2024-04-22 04:03:07,588 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name", "t1"."id" AS "rid" FROM "repository" AS "t1" INNER JOIN "star" AS "t4" ON ("t4"."repository_id" = "t1"."id") INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "visibility" AS "t3" ON ("t1"."visibility_id" = "t3"."id") WHERE ((("t4"."user_id" = %s) AND ("t1"."kind_id" = %s)) AND ("t1"."state" != %s))', [1, 1, 3])
gunicorn-web stdout | 2024-04-22 04:03:07,590 [282] [DEBUG] [app] Ending request: urn:request:f55df2ce-5525-4a8d-946b-d411195b1821 (/api/v1/repository) {'endpoint': 'api.repositorylist', 'request_id': 'urn:request:f55df2ce-5525-4a8d-946b-d411195b1821', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository?last_modified=true&namespace=build_test&popularity=true&public=true&quota=true', 'path': '/api/v1/repository', 'parameters': {'last_modified': 'true', 'namespace': 'build_test', 'popularity': 'true', 'public': 'true', 'quota': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:07,591 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:07,591 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:03:07 +0000] "GET /api/v1/repository?last_modified=true&namespace=build_test&popularity=true&public=true&quota=true HTTP/1.0" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:07 +0000] "GET /api/v1/repository?last_modified=true&namespace=build_test&popularity=true&public=true&quota=true HTTP/1.1" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.024 1564 0.024)
blobuploadcleanupworker stdout | 2024-04-22 04:03:07,846 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:03:09,181 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:03:09,236 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:03:09,568 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:03:09,662 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:10 +0000] "GET /react/?_=1713758589563 HTTP/1.1" 302 145 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1485 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:10 +0000] "GET /?_=1713758589563 HTTP/1.1" 200 402 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1496 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:10 +0000] "GET /main.css HTTP/1.1" 200 2890 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758589563" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1360 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:10 +0000] "GET /main.bundle.js HTTP/1.1" 200 229483 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758589563" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1352 -)
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:10 +0000] "GET /vendor.css HTTP/1.1" 200 220125 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758589563" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1362 -)
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:10 +0000] "GET /vendor.bundle.js HTTP/1.1" 200 556250 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758589563" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1354 -)
storagereplication stdout | 2024-04-22 04:03:10,918 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 04:03:10,937 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:03:10,942 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:03:10,944 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:03:10,949 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:03:10,953 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:03:10,955 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:03:10,961 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:03:10,964 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:03:10,967 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 04:03:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:03:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:41.264267+00:00 (in 29.999516 seconds)
autopruneworker stdout | 2024-04-22 04:03:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:41 UTC)" (scheduled at 2024-04-22 04:03:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:03:11,271 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758531271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:03:11,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:03:11,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:03:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:41 UTC)" executed successfully
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:13 +0000] "GET /images/favicon.png HTTP/1.1" 200 15998 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758589563" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1396 -)
repositorygcworker stdout | 2024-04-22 04:03:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:03:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:06.552482+00:00 (in 52.996364 seconds)
repositorygcworker stdout | 2024-04-22 04:03:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:13 UTC)" (scheduled at 2024-04-22 04:03:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:03:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:03:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:13 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:03:13,747 [281] [DEBUG] [app] Starting request: urn:request:48ae8636-4984-4422-bf73-1843230fc037 (/csrf_token) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:13,747 [281] [DEBUG] [app] Ending request: urn:request:48ae8636-4984-4422-bf73-1843230fc037 (/csrf_token) {'endpoint': 'web.csrf_token', 'request_id': 'urn:request:48ae8636-4984-4422-bf73-1843230fc037', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/csrf_token', 'path': '/csrf_token', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:13 +0000] "GET /csrf_token HTTP/1.1" 200 82 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758589563" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.002 1427 0.002)
gunicorn-web stdout | 2024-04-22 04:03:13,748 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:13 +0000] "GET /csrf_token HTTP/1.0" 200 82 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758589563" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:03:13,750 [278] [DEBUG] [app] Starting request: urn:request:bdc6e60b-0641-4d68-bd62-86bd9ad702c4 (/csrf_token) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:03:13,751 [278] [DEBUG] [app] Ending request: urn:request:bdc6e60b-0641-4d68-bd62-86bd9ad702c4 (/csrf_token) {'endpoint': 'web.csrf_token', 'request_id': 'urn:request:bdc6e60b-0641-4d68-bd62-86bd9ad702c4', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/csrf_token', 'path': '/csrf_token', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:13 +0000] "GET /csrf_token HTTP/1.1" 200 82 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758589563" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.002 1427 0.002)
gunicorn-web stdout | 2024-04-22 04:03:13,751 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:03:13 +0000] "GET /csrf_token HTTP/1.0" 200 82 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758589563" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
notificationworker stdout | 2024-04-22 04:03:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:03:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:19.762160+00:00 (in 6.002293 seconds)
notificationworker stdout | 2024-04-22 04:03:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:03:23 UTC)" (scheduled at 2024-04-22 04:03:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:03:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:03:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 3, 13, 760286), True, datetime.datetime(2024, 4, 22, 4, 3, 13, 760286), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:03:13,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:03:13,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:03:13,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:03:23 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:03:14,062 [282] [DEBUG] [app] Starting request: urn:request:7f569b8f-1ab8-4062-81fe-5f1b0791cdda (/api/v1/user/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:03:14,063 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:14,063 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:14,064 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:14,066 [281] [DEBUG] [app] Starting request: urn:request:f01a696c-69a9-4ba4-8c1f-3e24c97bc2fe (/config) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:03:14,066 [281] [DEBUG] [app] Ending request: urn:request:f01a696c-69a9-4ba4-8c1f-3e24c97bc2fe (/config) {'endpoint': 'web.config', 'request_id': 'urn:request:f01a696c-69a9-4ba4-8c1f-3e24c97bc2fe', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/config', 'path': '/config', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:14 +0000] "GET /config HTTP/1.1" 200 3660 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758589563" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.002 1503 0.002)
gunicorn-web stdout | 2024-04-22 04:03:14,067 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:03:14 +0000] "GET /config HTTP/1.0" 200 3660 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758589563" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:03:14,073 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:14,074 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:14,074 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:14,074 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:14,074 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:14,074 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:14,074 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:14,075 [282] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" INNER JOIN "team" AS "t2" ON ("t2"."organization_id" = "t1"."id") INNER JOIN "teammember" AS "t3" ON ("t3"."team_id" = "t2"."id") INNER JOIN "user" AS "t4" ON ("t4"."id" = "t3"."user_id") WHERE (("t1"."organization" = %s) AND ("t4"."username" = %s))', [True, 'whuquay'])
gunicorn-web stdout | 2024-04-22 04:03:14,079 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:14,080 [282] [DEBUG] [peewee] ('SELECT "t1"."service_ident", "t2"."name", "t1"."metadata_json" FROM "federatedlogin" AS "t1" INNER JOIN "loginservice" AS "t2" ON ("t1"."service_id" = "t2"."id") WHERE (("t2"."name" != %s) AND ("t1"."user_id" = %s))', ['quayrobot', 1])
gunicorn-web stdout | 2024-04-22 04:03:14,082 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."kind_id" FROM "userprompt" AS "t1" INNER JOIN "userpromptkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE ("t1"."user_id" = %s)', [1])
gunicorn-web stdout | 2024-04-22 04:03:14,085 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['whuquay', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:14,087 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['whuquay'])
gunicorn-web stdout | 2024-04-22 04:03:14,090 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['whuquay', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:14,092 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['whuquay'])
gunicorn-web stdout | 2024-04-22 04:03:14,094 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."size_bytes", "t1"."backfill_start_ms", "t1"."backfill_complete" FROM "quotanamespacesize" AS "t1" WHERE ("t1"."namespace_user_id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:14,096 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:14,097 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:14,098 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:03:14,101 [282] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:14,101 [282] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:14,101 [282] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:14,101 [282] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:14,101 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:14,101 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:14,101 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:14,102 [282] [DEBUG] [app] Ending request: urn:request:7f569b8f-1ab8-4062-81fe-5f1b0791cdda (/api/v1/user/) {'endpoint': 'api.user', 'request_id': 'urn:request:7f569b8f-1ab8-4062-81fe-5f1b0791cdda', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/', 'path': '/api/v1/user/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:14,103 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:14,103 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:03:14 +0000] "GET /api/v1/user/ HTTP/1.0" 200 987 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758589563" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:14 +0000] "GET /api/v1/user/ HTTP/1.1" 200 987 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758589563" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.042 1509 0.042)
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:14 +0000] "GET /assets/RedHatText-Regular..woff2 HTTP/1.1" 200 25844 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/vendor.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1432 -)
gcworker stdout | 2024-04-22 04:03:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:03:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:44.952062+00:00 (in 29.999514 seconds)
gcworker stdout | 2024-04-22 04:03:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:44 UTC)" (scheduled at 2024-04-22 04:03:14.952062+00:00)
gcworker stdout | 2024-04-22 04:03:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712548994952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:03:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:03:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:03:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:03:15,151 [278] [DEBUG] [app] Starting request: urn:request:d8851e3f-9ec9-4b0a-a428-c011bc5a05fa (/api/v1/superuser/organizations/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:15,152 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,152 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,152 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:15 +0000] "GET /assets/RedHatDisplay-Medium..woff2 HTTP/1.1" 200 26664 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/vendor.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1415 -)
gunicorn-web stdout | 2024-04-22 04:03:15,161 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:15,161 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:15,161 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,161 [278] [DEBUG] [endpoints.api] Checking fresh login for user whuquay: Last login at 2024-04-22 04:02:52+00:00
gunicorn-web stdout | 2024-04-22 04:03:15,161 [281] [DEBUG] [app] Starting request: urn:request:552dc01d-321f-4606-8046-4587fcb4dffb (/api/v1/superuser/users/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:15,161 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,161 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,161 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,162 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,162 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,162 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,162 [278] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:15,162 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:15,162 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((("t1"."organization" = %s) AND ("t1"."robot" = %s)) AND ("t1"."id" NOT IN (SELECT "t2"."namespace_id" FROM "deletednamespace" AS "t2")))', [True, False])
gunicorn-web stdout | 2024-04-22 04:03:15,165 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['build_test'])
gunicorn-web stdout | 2024-04-22 04:03:15,168 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['build_test', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:15,170 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['build_test'])
gunicorn-web stdout | 2024-04-22 04:03:15,171 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:15,171 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:15,171 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,172 [281] [DEBUG] [endpoints.api] Checking fresh login for user whuquay: Last login at 2024-04-22 04:02:52+00:00
gunicorn-web stdout | 2024-04-22 04:03:15,172 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,172 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,172 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,172 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."size_bytes", "t1"."backfill_start_ms", "t1"."backfill_complete" FROM "quotanamespacesize" AS "t1" WHERE ("t1"."namespace_user_id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:15,172 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,172 [281] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:15,173 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((("t1"."organization" = %s) AND ("t1"."robot" = %s)) AND ("t1"."id" NOT IN (SELECT "t2"."namespace_id" FROM "deletednamespace" AS "t2")))', [False, False])
gunicorn-web stdout | 2024-04-22 04:03:15,174 [278] [DEBUG] [app] Ending request: urn:request:d8851e3f-9ec9-4b0a-a428-c011bc5a05fa (/api/v1/superuser/organizations/) {'endpoint': 'api.superuserorganizationlist', 'request_id': 'urn:request:d8851e3f-9ec9-4b0a-a428-c011bc5a05fa', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/superuser/organizations/', 'path': '/api/v1/superuser/organizations/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:15,175 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:15,175 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:15 +0000] "GET /api/v1/superuser/organizations/ HTTP/1.0" 200 355 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:15 +0000] "GET /api/v1/superuser/organizations/ HTTP/1.1" 200 355 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.025 1505 0.025)
gunicorn-web stdout | 2024-04-22 04:03:15,176 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['whuquay'])
gunicorn-web stdout | 2024-04-22 04:03:15,178 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['whuquay', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:15,180 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['whuquay'])
gunicorn-web stdout | 2024-04-22 04:03:15,183 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."size_bytes", "t1"."backfill_start_ms", "t1"."backfill_complete" FROM "quotanamespacesize" AS "t1" WHERE ("t1"."namespace_user_id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:15,185 [281] [DEBUG] [app] Ending request: urn:request:552dc01d-321f-4606-8046-4587fcb4dffb (/api/v1/superuser/users/) {'endpoint': 'api.superuserlist', 'request_id': 'urn:request:552dc01d-321f-4606-8046-4587fcb4dffb', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/superuser/users/', 'path': '/api/v1/superuser/users/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:15,186 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:15,186 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:15 +0000] "GET /api/v1/superuser/users/ HTTP/1.0" 200 440 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:15 +0000] "GET /api/v1/superuser/users/ HTTP/1.1" 200 440 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.026 1497 0.026)
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:15 +0000] "GET /assets/RedHatText-Medium..woff2 HTTP/1.1" 200 26880 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/vendor.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1412 -)
gunicorn-web stdout | 2024-04-22 04:03:15,506 [279] [DEBUG] [app] Starting request: urn:request:574044ba-556c-408f-8a8c-38a7322231f4 (/api/v1/organization/build_test/members) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:15,506 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,506 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,507 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:15,515 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:15,515 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:15,515 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,516 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,516 [279] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,516 [279] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,516 [279] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,517 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:03:15,520 [279] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,520 [279] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,521 [279] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,521 [279] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:15,521 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:15,524 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "teammember" AS "t3" INNER JOIN "team" AS "t1" ON ("t3"."team_id" = "t1"."id") INNER JOIN "user" AS "t2" ON ("t3"."user_id" = "t2"."id") WHERE ("t1"."organization_id" = %s)', [2])
gunicorn-web stdout | 2024-04-22 04:03:15,528 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t1"."user_id" = "t3"."id") WHERE (("t2"."namespace_user_id" = %s) AND ("t3"."robot" = %s))', [2, False])
gunicorn-web stdout | 2024-04-22 04:03:15,531 [279] [DEBUG] [app] Ending request: urn:request:574044ba-556c-408f-8a8c-38a7322231f4 (/api/v1/organization/build_test/members) {'endpoint': 'api.organizationmemberlist', 'request_id': 'urn:request:574044ba-556c-408f-8a8c-38a7322231f4', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/organization/build_test/members', 'path': '/api/v1/organization/build_test/members', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:15,531 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:15,532 [279] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:15 +0000] "GET /api/v1/organization/build_test/members HTTP/1.0" 200 387 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:15 +0000] "GET /api/v1/organization/build_test/members HTTP/1.1" 200 387 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.028 1512 0.028)
gunicorn-web stdout | 2024-04-22 04:03:15,653 [282] [DEBUG] [app] Starting request: urn:request:f9940592-105f-4463-9d80-6ddca4b23c26 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:03:15,653 [278] [DEBUG] [app] Starting request: urn:request:233b480e-726d-4055-b0f7-4d83559b209f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:03:15,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:03:15,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:03:15,656 [292] [DEBUG] [app] Starting request: urn:request:b4f24d88-24a0-4c23-8c00-8a8d5e7f4ba6 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:03:15,656 [289] [DEBUG] [app] Starting request: urn:request:706cd663-afc6-4e7f-9e33-0957f3df9218 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:03:15,657 [292] [DEBUG] [app] Ending request: urn:request:b4f24d88-24a0-4c23-8c00-8a8d5e7f4ba6 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b4f24d88-24a0-4c23-8c00-8a8d5e7f4ba6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:03:15,657 [289] [DEBUG] [app] Ending request: urn:request:706cd663-afc6-4e7f-9e33-0957f3df9218 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:706cd663-afc6-4e7f-9e33-0957f3df9218', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:03:15,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:03:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:03:15,657 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:03:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:03:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:03:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:03:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:03:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:03:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:03:15,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:03:15,660 [278] [DEBUG] [app] Starting request: urn:request:e0f780ad-a166-4e0b-a3c6-24bbeea7e95f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:03:15,660 [278] [DEBUG] [app] Ending request: urn:request:e0f780ad-a166-4e0b-a3c6-24bbeea7e95f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e0f780ad-a166-4e0b-a3c6-24bbeea7e95f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:03:15,660 [281] [DEBUG] [app] Starting request: urn:request:d9f010c5-8f4a-4378-a428-3d283cd8751e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:03:15,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:03:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:03:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:03:15,660 [281] [DEBUG] [app] Ending request: urn:request:d9f010c5-8f4a-4378-a428-3d283cd8751e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d9f010c5-8f4a-4378-a428-3d283cd8751e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:03:15,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:03:15,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:03:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:03:15,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:03:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:03:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:03:15,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:03:15,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:03:15,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:03:15,674 [278] [DEBUG] [app] Ending request: urn:request:233b480e-726d-4055-b0f7-4d83559b209f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:233b480e-726d-4055-b0f7-4d83559b209f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:03:15,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:15,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:03:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:03:15,675 [282] [DEBUG] [app] Ending request: urn:request:f9940592-105f-4463-9d80-6ddca4b23c26 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f9940592-105f-4463-9d80-6ddca4b23c26', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:03:15,675 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:03:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:03:15,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:03:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:03:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:03:15,692 [278] [DEBUG] [app] Starting request: urn:request:38ebb835-df49-4aa8-b9ca-45482b7bacb4 (/api/v1/organization/whuquay/members) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:15,692 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,692 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,692 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:15,701 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:15,701 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:15,701 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,702 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,702 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,702 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,702 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,702 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'whuquay', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:15,705 [278] [DEBUG] [app] Ending request: urn:request:38ebb835-df49-4aa8-b9ca-45482b7bacb4 (/api/v1/organization/whuquay/members) {'endpoint': 'api.organizationmemberlist', 'request_id': 'urn:request:38ebb835-df49-4aa8-b9ca-45482b7bacb4', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/organization/whuquay/members', 'path': '/api/v1/organization/whuquay/members', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:15,705 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:15,706 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:15 +0000] "GET /api/v1/organization/whuquay/members HTTP/1.0" 404 244 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:15 +0000] "GET /api/v1/organization/whuquay/members HTTP/1.1" 404 244 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.015 1509 0.015)
gunicorn-web stdout | 2024-04-22 04:03:15,841 [278] [DEBUG] [app] Starting request: urn:request:fc965215-ea16-4b34-96e9-0c53373a2579 (/api/v1/organization/whuquay/robots) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:15,842 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,842 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,842 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:15,851 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:15,851 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:15,851 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,851 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,851 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,851 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,851 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:15,851 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,851 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:15,852 [278] [DEBUG] [peewee] ('SELECT "t1"."username", "t1"."creation_date", "t1"."last_accessed", "t2"."token", "t3"."description", "t3"."unstructured_json", "t4"."name", "t5"."name" FROM "user" AS "t1" LEFT OUTER JOIN "robotaccountmetadata" AS "t3" ON ("t3"."robot_account_id" = "t1"."id") INNER JOIN "robotaccounttoken" AS "t2" ON ("t2"."robot_account_id" = "t1"."id") LEFT OUTER JOIN "repositorypermission" AS "t6" ON ("t6"."user_id" = "t2"."robot_account_id") LEFT OUTER JOIN "repository" AS "t4" ON ("t6"."repository_id" = "t4"."id") LEFT OUTER JOIN "teammember" AS "t7" ON ("t7"."user_id" = "t1"."id") LEFT OUTER JOIN "team" AS "t5" ON ("t7"."team_id" = "t5"."id") WHERE (("t1"."robot" = %s) AND ("t1"."username" ILIKE %s)) ORDER BY "t1"."last_accessed" DESC', [True, 'whuquay+%'])
gunicorn-web stdout | 2024-04-22 04:03:15,857 [278] [DEBUG] [app] Ending request: urn:request:fc965215-ea16-4b34-96e9-0c53373a2579 (/api/v1/organization/whuquay/robots) {'endpoint': 'api.orgrobotlist', 'request_id': 'urn:request:fc965215-ea16-4b34-96e9-0c53373a2579', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/organization/whuquay/robots?permissions=true&token=false', 'path': '/api/v1/organization/whuquay/robots', 'parameters': {'permissions': 'true', 'token': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:15,857 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:15,858 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:15 +0000] "GET /api/v1/organization/whuquay/robots?permissions=true&token=false HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:15 +0000] "GET /api/v1/organization/whuquay/robots?permissions=true&token=false HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.016 1537 0.017)
gunicorn-web stdout | 2024-04-22 04:03:16,022 [281] [DEBUG] [app] Starting request: urn:request:2852dcc6-8a54-42f7-9971-6c09b52965e0 (/api/v1/repository) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:16,022 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,022 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,023 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:16,032 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:16,032 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:16,032 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,032 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,033 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,033 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,033 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,033 [281] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:16,033 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['whuquay', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:16,035 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1"', [])
gunicorn-web stdout | 2024-04-22 04:03:16,038 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['public', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:16,041 [281] [DEBUG] [peewee] ('(SELECT DISTINCT "t1"."name", "t1"."id" AS "rid", "t1"."description", "t2"."username", "t1"."visibility_id", "t1"."kind_id", "t1"."state" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") LEFT OUTER JOIN "repositorypermission" AS "t3" ON ("t3"."repository_id" = "t1"."id") WHERE (((("t1"."state" != %s) AND ("t1"."kind_id" = %s)) AND ("t2"."username" = %s)) AND ("t1"."visibility_id" = %s))) UNION (SELECT DISTINCT "t4"."name", "t4"."id" AS "rid", "t4"."description", "t5"."username", "t4"."visibility_id", "t4"."kind_id", "t4"."state" FROM "repository" AS "t4" INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "repositorypermission" AS "t6" ON ("t6"."repository_id" = "t4"."id") WHERE ((("t4"."state" != %s) AND ("t4"."kind_id" = %s)) AND ("t5"."username" = %s))) ORDER BY rid LIMIT %s', [3, 1, 'whuquay', 1, 3, 1, 'whuquay', 101])
gunicorn-web stdout | 2024-04-22 04:03:16,045 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name", "t1"."id" AS "rid" FROM "repository" AS "t1" INNER JOIN "star" AS "t4" ON ("t4"."repository_id" = "t1"."id") INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "visibility" AS "t3" ON ("t1"."visibility_id" = "t3"."id") WHERE ((("t4"."user_id" = %s) AND ("t1"."kind_id" = %s)) AND ("t1"."state" != %s))', [1, 1, 3])
gunicorn-web stdout | 2024-04-22 04:03:16,047 [281] [DEBUG] [app] Ending request: urn:request:2852dcc6-8a54-42f7-9971-6c09b52965e0 (/api/v1/repository) {'endpoint': 'api.repositorylist', 'request_id': 'urn:request:2852dcc6-8a54-42f7-9971-6c09b52965e0', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository?last_modified=true&namespace=whuquay&public=true', 'path': '/api/v1/repository', 'parameters': {'last_modified': 'true', 'namespace': 'whuquay', 'public': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:16,048 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:16,048 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:16 +0000] "GET /api/v1/repository?last_modified=true&namespace=whuquay&public=true HTTP/1.0" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:16 +0000] "GET /api/v1/repository?last_modified=true&namespace=whuquay&public=true HTTP/1.1" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.027 1540 0.027)
gunicorn-web stdout | 2024-04-22 04:03:16,209 [282] [DEBUG] [app] Starting request: urn:request:e5546e35-622a-4981-ac38-6e0a647146b9 (/api/v1/organization/build_test) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:03:16,209 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,209 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,210 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:16,219 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:16,219 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:16,219 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,220 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:16,222 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,222 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,223 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,223 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,223 [278] [DEBUG] [app] Starting request: urn:request:58ea346b-534d-42cc-8955-55b4e5a74c30 (/api/v1/organization/build_test/robots) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:03:16,223 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,223 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,224 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:16,224 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:03:16,227 [282] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,228 [282] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,228 [282] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,228 [282] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:16,228 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t2" ON ("t1"."role_id" = "t2"."id") WHERE ("t1"."organization_id" = %s)', [2])
gunicorn-web stdout | 2024-04-22 04:03:16,230 [281] [DEBUG] [app] Starting request: urn:request:d180a422-1cfb-48bf-89a5-4032c1210763 (/api/v1/repository) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:16,230 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1"', [])
gunicorn-web stdout | 2024-04-22 04:03:16,230 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,230 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,231 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:16,232 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:16,232 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:16,232 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,233 [282] [DEBUG] [peewee] ('SELECT "t1"."team_id", Count("t1"."id") FROM "repositorypermission" AS "t1" WHERE ("t1"."team_id" IN (%s)) GROUP BY "t1"."team_id"', [1])
gunicorn-web stdout | 2024-04-22 04:03:16,233 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,233 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,233 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,233 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,234 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:03:16,235 [282] [DEBUG] [peewee] ('SELECT "t1"."team_id", Count("t1"."id") FROM "teammember" AS "t1" WHERE ("t1"."team_id" IN (%s)) GROUP BY "t1"."team_id"', [1])
gunicorn-web stdout | 2024-04-22 04:03:16,237 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,237 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,237 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,237 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['build_test'])
gunicorn-web stdout | 2024-04-22 04:03:16,238 [278] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,238 [278] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,238 [278] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,238 [278] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:16,238 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,238 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,239 [278] [DEBUG] [peewee] ('SELECT "t1"."username", "t1"."creation_date", "t1"."last_accessed", "t2"."token", "t3"."description", "t3"."unstructured_json", "t4"."name", "t5"."name" FROM "user" AS "t1" LEFT OUTER JOIN "robotaccountmetadata" AS "t3" ON ("t3"."robot_account_id" = "t1"."id") INNER JOIN "robotaccounttoken" AS "t2" ON ("t2"."robot_account_id" = "t1"."id") LEFT OUTER JOIN "repositorypermission" AS "t6" ON ("t6"."user_id" = "t2"."robot_account_id") LEFT OUTER JOIN "repository" AS "t4" ON ("t6"."repository_id" = "t4"."id") LEFT OUTER JOIN "teammember" AS "t7" ON ("t7"."user_id" = "t1"."id") LEFT OUTER JOIN "team" AS "t5" ON ("t7"."team_id" = "t5"."id") WHERE (("t1"."robot" = %s) AND ("t1"."username" ILIKE %s)) ORDER BY "t1"."last_accessed" DESC', [True, 'build_test+%'])
gunicorn-web stdout | 2024-04-22 04:03:16,239 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:16,240 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:16,240 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,240 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:16,240 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,240 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,240 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['build_test', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:16,240 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:16,240 [281] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:16,241 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['whuquay', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:16,242 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['build_test'])
gunicorn-web stdout | 2024-04-22 04:03:16,243 [278] [DEBUG] [app] Ending request: urn:request:58ea346b-534d-42cc-8955-55b4e5a74c30 (/api/v1/organization/build_test/robots) {'endpoint': 'api.orgrobotlist', 'request_id': 'urn:request:58ea346b-534d-42cc-8955-55b4e5a74c30', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/organization/build_test/robots?permissions=true&token=false', 'path': '/api/v1/organization/build_test/robots', 'parameters': {'permissions': 'true', 'token': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:16,243 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:16,243 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:03:16 +0000] "GET /api/v1/organization/build_test/robots?permissions=true&token=false HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:16 +0000] "GET /api/v1/organization/build_test/robots?permissions=true&token=false HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.021 1540 0.021)
gunicorn-web stdout | 2024-04-22 04:03:16,244 [281] [DEBUG] [peewee] ('(SELECT DISTINCT "t1"."name", "t1"."id" AS "rid", "t1"."description", "t2"."username", "t1"."visibility_id", "t1"."kind_id", "t1"."state" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") LEFT OUTER JOIN "repositorypermission" AS "t3" ON ("t3"."repository_id" = "t1"."id") WHERE (((("t1"."state" != %s) AND ("t1"."kind_id" = %s)) AND ("t2"."username" = %s)) AND ("t1"."visibility_id" = %s))) UNION (SELECT DISTINCT "t4"."name", "t4"."id" AS "rid", "t4"."description", "t5"."username", "t4"."visibility_id", "t4"."kind_id", "t4"."state" FROM "repository" AS "t4" INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "repositorypermission" AS "t6" ON ("t6"."repository_id" = "t4"."id") WHERE ((("t4"."state" != %s) AND ("t4"."kind_id" = %s)) AND ("t5"."username" = %s))) ORDER BY rid LIMIT %s', [3, 1, 'build_test', 1, 3, 1, 'build_test', 101])
gunicorn-web stdout | 2024-04-22 04:03:16,245 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."size_bytes", "t1"."backfill_start_ms", "t1"."backfill_complete" FROM "quotanamespacesize" AS "t1" WHERE ("t1"."namespace_user_id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:16,248 [282] [DEBUG] [app] Ending request: urn:request:e5546e35-622a-4981-ac38-6e0a647146b9 (/api/v1/organization/build_test) {'endpoint': 'api.organization', 'request_id': 'urn:request:e5546e35-622a-4981-ac38-6e0a647146b9', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/organization/build_test', 'path': '/api/v1/organization/build_test', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:16,248 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:16,249 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name", "t1"."id" AS "rid" FROM "repository" AS "t1" INNER JOIN "star" AS "t4" ON ("t4"."repository_id" = "t1"."id") INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "visibility" AS "t3" ON ("t1"."visibility_id" = "t3"."id") WHERE ((("t4"."user_id" = %s) AND ("t1"."kind_id" = %s)) AND ("t1"."state" != %s))', [1, 1, 3])
gunicorn-web stdout | 2024-04-22 04:03:16,249 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:03:16 +0000] "GET /api/v1/organization/build_test HTTP/1.0" 200 803 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:16 +0000] "GET /api/v1/organization/build_test HTTP/1.1" 200 803 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.041 1504 0.041)
gunicorn-web stdout | 2024-04-22 04:03:16,252 [281] [DEBUG] [app] Ending request: urn:request:d180a422-1cfb-48bf-89a5-4032c1210763 (/api/v1/repository) {'endpoint': 'api.repositorylist', 'request_id': 'urn:request:d180a422-1cfb-48bf-89a5-4032c1210763', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository?last_modified=true&namespace=build_test&public=true', 'path': '/api/v1/repository', 'parameters': {'last_modified': 'true', 'namespace': 'build_test', 'public': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:16,252 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:16 +0000] "GET /api/v1/repository?last_modified=true&namespace=build_test&public=true HTTP/1.1" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.023 1543 0.024)
gunicorn-web stdout | 2024-04-22 04:03:16,253 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:16 +0000] "GET /api/v1/repository?last_modified=true&namespace=build_test&public=true HTTP/1.0" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
securityscanningnotificationworker stdout | 2024-04-22 04:03:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:03:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:02.556208+00:00 (in 46.003268 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:03:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:16 UTC)" (scheduled at 2024-04-22 04:03:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:03:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:03:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 3, 16, 553328), True, datetime.datetime(2024, 4, 22, 4, 3, 16, 553328), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:03:16,563 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:03:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:03:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:03:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:03:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:47.052354+00:00 (in 29.999490 seconds)
buildlogsarchiver stdout | 2024-04-22 04:03:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:47 UTC)" (scheduled at 2024-04-22 04:03:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:03:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 3, 17, 53253), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:03:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:03:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:03:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:03:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:03:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:23.759375+00:00 (in 3.996653 seconds)
notificationworker stdout | 2024-04-22 04:03:19,762 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:08:19 UTC)" (scheduled at 2024-04-22 04:03:19.762160+00:00)
notificationworker stdout | 2024-04-22 04:03:19,763 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 3, 19, 763037), 'notification/%'])
notificationworker stdout | 2024-04-22 04:03:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:19 UTC)" (scheduled at 2024-04-22 04:03:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:03:19,764 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:03:19,764 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:19 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:03:19,773 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 3, 19, 763037), True, datetime.datetime(2024, 4, 22, 4, 3, 19, 763037), 0, 'notification/%'])
notificationworker stdout | 2024-04-22 04:03:19,776 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 3, 19, 763037), True, datetime.datetime(2024, 4, 22, 4, 3, 19, 763037), 0, 'notification/%', False, datetime.datetime(2024, 4, 22, 4, 3, 19, 763037), 'notification/%'])
notificationworker stdout | 2024-04-22 04:03:19,778 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:03:19,778 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:08:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:03:19,966 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:03:21,436 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 04:03:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:03:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:43.057186+00:00 (in 20.997621 seconds)
namespacegcworker stdout | 2024-04-22 04:03:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:22 UTC)" (scheduled at 2024-04-22 04:03:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:03:22,060 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:03:22,060 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:03:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:03:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:33.759375+00:00 (in 9.999451 seconds)
notificationworker stdout | 2024-04-22 04:03:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:03:33 UTC)" (scheduled at 2024-04-22 04:03:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:03:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:03:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 3, 23, 760351), True, datetime.datetime(2024, 4, 22, 4, 3, 23, 760351), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:03:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:03:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:03:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:03:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:03:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:03:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:24.361582+00:00 (in 59.999448 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:03:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:24 UTC)" (scheduled at 2024-04-22 04:03:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:03:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:03:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:03:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:03:25,080 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 04:03:26,783 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 04:03:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:03:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:35.871852+00:00 (in 8.998222 seconds)
securityworker stdout | 2024-04-22 04:03:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:56 UTC)" (scheduled at 2024-04-22 04:03:26.873109+00:00)
securityworker stdout | 2024-04-22 04:03:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:03:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:03:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:03:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:03:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:03:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:03:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:03:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:03:26,882 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:03:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:03:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:03:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:03:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 58, 26, 881872), 1, 2])
securityworker stdout | 2024-04-22 04:03:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:03:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:03:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 58, 26, 881872), 1, 2])
securityworker stdout | 2024-04-22 04:03:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:03:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:03:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:03:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:03:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:03:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:03:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:03:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:03:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:03:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:03:56 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:03:28,166 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:03:30,038 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:03:30,041 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:03:30,044 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:03:30,046 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:03:30,048 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
teamsyncworker stdout | 2024-04-22 04:03:30,060 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:03:30,211 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:03:30,653 [282] [DEBUG] [app] Starting request: urn:request:c7596b8a-53f9-4e14-937c-792aaa959a87 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:03:30,653 [279] [DEBUG] [app] Starting request: urn:request:41e41ad0-dfd3-46eb-96d5-9f4abd45e1ea (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:03:30,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:03:30,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:03:30,656 [284] [DEBUG] [app] Starting request: urn:request:30fb3ce3-d400-44f5-ba1a-3e7d713ae454 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:03:30,657 [292] [DEBUG] [app] Starting request: urn:request:c7304df0-9aed-483f-8842-9ab167d8ebc8 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:03:30,657 [284] [DEBUG] [app] Ending request: urn:request:30fb3ce3-d400-44f5-ba1a-3e7d713ae454 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:30fb3ce3-d400-44f5-ba1a-3e7d713ae454', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:03:30,657 [292] [DEBUG] [app] Ending request: urn:request:c7304df0-9aed-483f-8842-9ab167d8ebc8 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:c7304df0-9aed-483f-8842-9ab167d8ebc8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:03:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:03:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:03:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:03:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:03:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:03:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:03:30,658 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:03:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:03:30,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:03:30,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:03:30,660 [278] [DEBUG] [app] Starting request: urn:request:22d357da-cead-4875-8951-d62028d834be (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:03:30,660 [278] [DEBUG] [app] Ending request: urn:request:22d357da-cead-4875-8951-d62028d834be (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:22d357da-cead-4875-8951-d62028d834be', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:03:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:03:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:03:30,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:03:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:03:30,661 [281] [DEBUG] [app] Starting request: urn:request:844a8c19-9067-42f6-9fe0-999e927d3e45 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:03:30,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:03:30,661 [281] [DEBUG] [app] Ending request: urn:request:844a8c19-9067-42f6-9fe0-999e927d3e45 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:844a8c19-9067-42f6-9fe0-999e927d3e45', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:03:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:03:30,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:03:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:03:30,662 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:03:30,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:03:30,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:03:30,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:03:30,675 [279] [DEBUG] [app] Ending request: urn:request:41e41ad0-dfd3-46eb-96d5-9f4abd45e1ea (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:41e41ad0-dfd3-46eb-96d5-9f4abd45e1ea', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:03:30,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:30,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:03:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:03:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:03:30,676 [282] [DEBUG] [app] Ending request: urn:request:c7596b8a-53f9-4e14-937c-792aaa959a87 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:c7596b8a-53f9-4e14-937c-792aaa959a87', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:03:30,676 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:03:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 04:03:30,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:03:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotaregistrysizeworker stdout | 2024-04-22 04:03:31,056 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:03:32,648 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:03:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:03:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:43.759375+00:00 (in 9.999495 seconds)
notificationworker stdout | 2024-04-22 04:03:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:03:43 UTC)" (scheduled at 2024-04-22 04:03:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:03:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:03:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 3, 33, 760283), True, datetime.datetime(2024, 4, 22, 4, 3, 33, 760283), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:03:33,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:03:33,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:03:33,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:03:43 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:03:33,935 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:03:34,211 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:03:34,441 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:03:34,652 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:03:34,656 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:03:34,661 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:03:35,465 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:03:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:03:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:56.873109+00:00 (in 21.000762 seconds)
securityworker stdout | 2024-04-22 04:03:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:05 UTC)" (scheduled at 2024-04-22 04:03:35.871852+00:00)
securityworker stdout | 2024-04-22 04:03:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:03:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:03:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:03:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:03:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:03:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:03:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:03:36,644 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:03:36,763 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:03:36,898 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:03:37,882 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:03:39,212 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:03:39,248 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
exportactionlogsworker stdout | 2024-04-22 04:03:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:03:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:41.564959+00:00 (in 1.997452 seconds)
exportactionlogsworker stdout | 2024-04-22 04:03:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:39 UTC)" (scheduled at 2024-04-22 04:03:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:03:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:03:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:39 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:03:39,600 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:03:39,700 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:03:40,946 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:03:40,952 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
storagereplication stdout | 2024-04-22 04:03:40,955 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-registry stdout | 2024-04-22 04:03:40,957 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:03:40,961 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:03:40,964 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:03:40,966 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:03:40,969 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:03:40,973 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:03:40,975 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 04:03:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:03:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:11.264267+00:00 (in 29.999529 seconds)
autopruneworker stdout | 2024-04-22 04:03:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:11 UTC)" (scheduled at 2024-04-22 04:03:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:03:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758561271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:03:41,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:03:41,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:03:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:03:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:03:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:39.566970+00:00 (in 58.001497 seconds)
exportactionlogsworker stdout | 2024-04-22 04:03:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:41 UTC)" (scheduled at 2024-04-22 04:03:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:03:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:03:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 3, 41, 565740), True, datetime.datetime(2024, 4, 22, 4, 3, 41, 565740), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:03:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:03:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:03:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:03:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:03:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:22.058978+00:00 (in 39.001291 seconds)
namespacegcworker stdout | 2024-04-22 04:03:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:43 UTC)" (scheduled at 2024-04-22 04:03:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:03:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:03:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 3, 43, 58093), True, datetime.datetime(2024, 4, 22, 4, 3, 43, 58093), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:03:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:03:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:03:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:04:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:03:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:03:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:03:53.759375+00:00 (in 9.999497 seconds)
notificationworker stdout | 2024-04-22 04:03:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:03:53 UTC)" (scheduled at 2024-04-22 04:03:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:03:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:03:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 3, 43, 760130), True, datetime.datetime(2024, 4, 22, 4, 3, 43, 760130), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:03:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:03:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:03:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:03:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:03:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:03:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:14.952062+00:00 (in 29.999471 seconds)
gcworker stdout | 2024-04-22 04:03:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:14 UTC)" (scheduled at 2024-04-22 04:03:44.952062+00:00)
gcworker stdout | 2024-04-22 04:03:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549024953, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:03:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:03:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:03:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:03:45,653 [282] [DEBUG] [app] Starting request: urn:request:665874a9-3c62-4272-b4f8-54320357f45b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:03:45,653 [281] [DEBUG] [app] Starting request: urn:request:afc3353b-7ee7-41a8-a36a-5d348da8fffd (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:03:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:03:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:03:45,656 [292] [DEBUG] [app] Starting request: urn:request:a1411486-978d-448d-a98f-2d1271ff8765 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:03:45,656 [284] [DEBUG] [app] Starting request: urn:request:58b56bcd-bcf8-42ff-a059-201e154f366b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:03:45,656 [292] [DEBUG] [app] Ending request: urn:request:a1411486-978d-448d-a98f-2d1271ff8765 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:a1411486-978d-448d-a98f-2d1271ff8765', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:03:45,656 [284] [DEBUG] [app] Ending request: urn:request:58b56bcd-bcf8-42ff-a059-201e154f366b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:58b56bcd-bcf8-42ff-a059-201e154f366b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:03:45,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:03:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:03:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:03:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:03:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:03:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:03:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:03:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:03:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:03:45,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:03:45,659 [282] [DEBUG] [app] Starting request: urn:request:535853f6-db09-4405-bc8a-e93415cacde1 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:03:45,659 [282] [DEBUG] [app] Ending request: urn:request:535853f6-db09-4405-bc8a-e93415cacde1 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:535853f6-db09-4405-bc8a-e93415cacde1', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:03:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:03:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:03:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:03:45,660 [279] [DEBUG] [app] Starting request: urn:request:3672ece5-47f7-4b6e-9913-f7ea8de305b1 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:03:45,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:03:45,660 [279] [DEBUG] [app] Ending request: urn:request:3672ece5-47f7-4b6e-9913-f7ea8de305b1 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3672ece5-47f7-4b6e-9913-f7ea8de305b1', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:03:45,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:03:45,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:03:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:03:45,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:03:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:03:45,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:03:45,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:03:45,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:03:45,674 [282] [DEBUG] [app] Ending request: urn:request:665874a9-3c62-4272-b4f8-54320357f45b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:665874a9-3c62-4272-b4f8-54320357f45b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:03:45,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:45,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:03:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:03:45,675 [281] [DEBUG] [app] Ending request: urn:request:afc3353b-7ee7-41a8-a36a-5d348da8fffd (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:afc3353b-7ee7-41a8-a36a-5d348da8fffd', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:03:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:03:45,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:45,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:03:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:03:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
buildlogsarchiver stdout | 2024-04-22 04:03:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:03:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:17.052354+00:00 (in 29.999473 seconds)
buildlogsarchiver stdout | 2024-04-22 04:03:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:17 UTC)" (scheduled at 2024-04-22 04:03:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:03:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 3, 47, 53237), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:03:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:03:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:03:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:03:50,001 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:03:51,473 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:51 +0000] "GET /angular/?_=1713758630462 HTTP/1.1" 302 145 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1493 -)
gunicorn-web stdout | 2024-04-22 04:03:52,097 [278] [DEBUG] [app] Starting request: urn:request:35c17293-f79e-46b6-88e0-de4ea438d960 (/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:52,098 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:52,100 [278] [DEBUG] [app] Ending request: urn:request:35c17293-f79e-46b6-88e0-de4ea438d960 (/) {'endpoint': 'web.index', 'request_id': 'urn:request:35c17293-f79e-46b6-88e0-de4ea438d960', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758630462', 'path': '/', 'parameters': {'_': '1713758630462'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:52,101 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:52 +0000] "GET /?_=1713758630462 HTTP/1.0" 200 93195 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:52 +0000] "GET /?_=1713758630462 HTTP/1.1" 200 14252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.006 1468 0.005)
gunicorn-web stdout | 2024-04-22 04:03:52,691 [278] [DEBUG] [app] Starting request: urn:request:fa9040df-bba6-4bce-82f3-de3cd27b2bc7 (/api/v1/user/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:52,691 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:52,691 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:52,692 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:52,701 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:52,701 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:52,701 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:52,702 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:52,702 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:52,702 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:52,702 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:52,703 [278] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" INNER JOIN "team" AS "t2" ON ("t2"."organization_id" = "t1"."id") INNER JOIN "teammember" AS "t3" ON ("t3"."team_id" = "t2"."id") INNER JOIN "user" AS "t4" ON ("t4"."id" = "t3"."user_id") WHERE (("t1"."organization" = %s) AND ("t4"."username" = %s))', [True, 'whuquay'])
gunicorn-web stdout | 2024-04-22 04:03:52,706 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:52,706 [278] [DEBUG] [peewee] ('SELECT "t1"."service_ident", "t2"."name", "t1"."metadata_json" FROM "federatedlogin" AS "t1" INNER JOIN "loginservice" AS "t2" ON ("t1"."service_id" = "t2"."id") WHERE (("t2"."name" != %s) AND ("t1"."user_id" = %s))', ['quayrobot', 1])
gunicorn-web stdout | 2024-04-22 04:03:52,709 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."kind_id" FROM "userprompt" AS "t1" INNER JOIN "userpromptkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE ("t1"."user_id" = %s)', [1])
gunicorn-web stdout | 2024-04-22 04:03:52,712 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['whuquay', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:52,714 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['whuquay'])
gunicorn-web stdout | 2024-04-22 04:03:52,717 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['whuquay', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:52,719 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['whuquay'])
gunicorn-web stdout | 2024-04-22 04:03:52,721 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."size_bytes", "t1"."backfill_start_ms", "t1"."backfill_complete" FROM "quotanamespacesize" AS "t1" WHERE ("t1"."namespace_user_id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:52,723 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:52,723 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:52,724 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:03:52,727 [278] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:52,727 [278] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:52,727 [278] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:52,727 [278] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:52,727 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:52,727 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:52,727 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:52,728 [278] [DEBUG] [app] Ending request: urn:request:fa9040df-bba6-4bce-82f3-de3cd27b2bc7 (/api/v1/user/) {'endpoint': 'api.user', 'request_id': 'urn:request:fa9040df-bba6-4bce-82f3-de3cd27b2bc7', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/', 'path': '/api/v1/user/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:52,728 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:52,728 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:52 +0000] "GET /api/v1/user/ HTTP/1.0" 200 987 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:52 +0000] "GET /api/v1/user/ HTTP/1.1" 200 987 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.039 1473 0.039)
gunicorn-web stdout | 2024-04-22 04:03:53,050 [282] [DEBUG] [app] Starting request: urn:request:66053c96-3a95-4154-ad52-b5ea3ef01d06 (/api/v1/user/notifications) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:53,050 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:53,050 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:53,051 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:53,059 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:53,059 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:53,059 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:53,060 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:03:53,060 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:53,060 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:53,060 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:53,060 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:53,061 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."dismissed" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."dismissed" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', [False, 1, False, 1, 'admin', 6])
gunicorn-web stdout | 2024-04-22 04:03:53,066 [282] [DEBUG] [app] Ending request: urn:request:66053c96-3a95-4154-ad52-b5ea3ef01d06 (/api/v1/user/notifications) {'endpoint': 'api.usernotificationlist', 'request_id': 'urn:request:66053c96-3a95-4154-ad52-b5ea3ef01d06', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/notifications', 'path': '/api/v1/user/notifications', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:53,067 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:53,067 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:53 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 43 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:53 +0000] "GET /api/v1/user/notifications HTTP/1.1" 200 43 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.018 1486 0.018)
gunicorn-web stdout | 2024-04-22 04:03:53,376 [282] [DEBUG] [app] Starting request: urn:request:5e205730-8a84-46d5-be44-e114150a70e3 (/api/v1/repository) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:53,376 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:53,376 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:53,377 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:53,385 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:53,385 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:53,385 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:53,387 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name", "t1"."id" AS "rid" FROM "repository" AS "t1" INNER JOIN "star" AS "t4" ON ("t4"."repository_id" = "t1"."id") INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "visibility" AS "t3" ON ("t1"."visibility_id" = "t3"."id") WHERE ((("t4"."user_id" = %s) AND ("t1"."kind_id" = %s)) AND ("t1"."state" != %s))', [1, 1, 3])
gunicorn-web stdout | 2024-04-22 04:03:53,390 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name", "t1"."id" AS "rid" FROM "repository" AS "t1" INNER JOIN "star" AS "t4" ON ("t4"."repository_id" = "t1"."id") INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "visibility" AS "t3" ON ("t1"."visibility_id" = "t3"."id") WHERE ((("t4"."user_id" = %s) AND ("t1"."kind_id" = %s)) AND ("t1"."state" != %s))', [1, 1, 3])
gunicorn-web stdout | 2024-04-22 04:03:53,393 [282] [DEBUG] [app] Ending request: urn:request:5e205730-8a84-46d5-be44-e114150a70e3 (/api/v1/repository) {'endpoint': 'api.repositorylist', 'request_id': 'urn:request:5e205730-8a84-46d5-be44-e114150a70e3', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository?last_modified=true&popularity=true&starred=true', 'path': '/api/v1/repository', 'parameters': {'last_modified': 'true', 'popularity': 'true', 'starred': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:53,393 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:53,393 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:53 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/1.0" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:53 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/1.1" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.018 1537 0.018)
gunicorn-web stdout | 2024-04-22 04:03:53,401 [279] [DEBUG] [app] Starting request: urn:request:801006ad-c206-46f7-967b-273f215ab492 (/api/v1/messages) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:03:53,401 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:53,401 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:53,401 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:53,410 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:53,410 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:53,410 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:53,411 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."content", "t1"."uuid", "t1"."severity", "t1"."media_type_id", "t2"."id", "t2"."name" FROM "messages" AS "t1" INNER JOIN "mediatype" AS "t2" ON ("t1"."media_type_id" = "t2"."id")', [])
gunicorn-web stdout | 2024-04-22 04:03:53,413 [279] [DEBUG] [app] Ending request: urn:request:801006ad-c206-46f7-967b-273f215ab492 (/api/v1/messages) {'endpoint': 'api.globalusermessages', 'request_id': 'urn:request:801006ad-c206-46f7-967b-273f215ab492', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/messages', 'path': '/api/v1/messages', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:53,414 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:53,414 [279] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:03:53 +0000] "GET /api/v1/messages HTTP/1.0" 200 17 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:53 +0000] "GET /api/v1/messages HTTP/1.1" 200 17 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.015 1476 0.014)
gunicorn-web stdout | 2024-04-22 04:03:53,757 [278] [DEBUG] [app] Starting request: urn:request:7327aadc-99ea-4465-bb48-4316184586bd (/api/v1/user/apptoken) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:53,757 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:53,757 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:53,758 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
notificationworker stdout | 2024-04-22 04:03:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:03:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:03.759375+00:00 (in 9.999498 seconds)
notificationworker stdout | 2024-04-22 04:03:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:04:03 UTC)" (scheduled at 2024-04-22 04:03:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:03:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:03:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 3, 53, 760249), True, datetime.datetime(2024, 4, 22, 4, 3, 53, 760249), 0, 'notification/%', 50, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:53,768 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:53,768 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:53,768 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:53,768 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:03:53,768 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:53,768 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:53,768 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:53,768 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:53,769 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."uuid", "t1"."title", "t1"."token_name", "t1"."token_secret", "t1"."created", "t1"."expiration", "t1"."last_accessed" FROM "appspecificauthtoken" AS "t1" WHERE ((("t1"."user_id" = %s) AND ("t1"."expiration" <= %s)) AND ("t1"."expiration" > %s))', [1, datetime.datetime(2024, 4, 24, 23, 15, 53, 768912), datetime.datetime(2024, 4, 22, 4, 3, 53, 768971)])
gunicorn-web stdout | 2024-04-22 04:03:53,771 [278] [DEBUG] [app] Ending request: urn:request:7327aadc-99ea-4465-bb48-4316184586bd (/api/v1/user/apptoken) {'endpoint': 'api.apptokens', 'request_id': 'urn:request:7327aadc-99ea-4465-bb48-4316184586bd', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/apptoken?expiring=true', 'path': '/api/v1/user/apptoken', 'parameters': {'expiring': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:53,772 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:53,772 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:53 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:53 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.1" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.016 1495 0.016)
notificationworker stdout | 2024-04-22 04:03:53,774 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:03:53,774 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:03:53,775 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:04:03 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:03:54,031 [281] [DEBUG] [app] Starting request: urn:request:303200e3-bcfa-4dcc-ab03-3e909387dcff (/api/v1/repository) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:03:54,031 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:54,031 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:54,032 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:54,034 [278] [DEBUG] [app] Starting request: urn:request:d4c7bceb-5d3b-43b4-b883-c8bb9aa6176d (/api/v1/repository) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:54,034 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:54,034 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:54,035 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:54,041 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:54,041 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:54,041 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:54,041 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:54,041 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:54,041 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:54,041 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:54,041 [281] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:54,042 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['whuquay', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:54,043 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:54,043 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:54,043 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:54,044 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:54,044 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:54,044 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:54,044 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:54,044 [278] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:54,045 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['whuquay', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:54,045 [281] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."name", "t1"."id" AS "rid", "t1"."description", "t2"."username", "t1"."visibility_id", "t1"."kind_id", "t1"."state" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") LEFT OUTER JOIN "repositorypermission" AS "t3" ON ("t3"."repository_id" = "t1"."id") WHERE ((("t1"."state" != %s) AND ("t1"."kind_id" = %s)) AND ("t2"."username" = %s)) ORDER BY rid LIMIT %s', [3, 1, 'whuquay', 101])
gunicorn-web stdout | 2024-04-22 04:03:54,047 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1"', [])
gunicorn-web stdout | 2024-04-22 04:03:54,049 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name", "t1"."id" AS "rid" FROM "repository" AS "t1" INNER JOIN "star" AS "t4" ON ("t4"."repository_id" = "t1"."id") INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "visibility" AS "t3" ON ("t1"."visibility_id" = "t3"."id") WHERE ((("t4"."user_id" = %s) AND ("t1"."kind_id" = %s)) AND ("t1"."state" != %s))', [1, 1, 3])
gunicorn-web stdout | 2024-04-22 04:03:54,049 [278] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."name", "t1"."id" AS "rid", "t1"."description", "t2"."username", "t1"."visibility_id", "t1"."kind_id", "t1"."state" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") LEFT OUTER JOIN "repositorypermission" AS "t3" ON ("t3"."repository_id" = "t1"."id") WHERE ((("t1"."state" != %s) AND ("t1"."kind_id" = %s)) AND ("t2"."username" = %s)) ORDER BY rid LIMIT %s', [3, 1, 'build_test', 101])
gunicorn-web stdout | 2024-04-22 04:03:54,052 [281] [DEBUG] [app] Ending request: urn:request:303200e3-bcfa-4dcc-ab03-3e909387dcff (/api/v1/repository) {'endpoint': 'api.repositorylist', 'request_id': 'urn:request:303200e3-bcfa-4dcc-ab03-3e909387dcff', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository?last_modified=true&namespace=whuquay&popularity=true&quota=true&state=true', 'path': '/api/v1/repository', 'parameters': {'last_modified': 'true', 'namespace': 'whuquay', 'popularity': 'true', 'quota': 'true', 'state': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:54,052 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:54 +0000] "GET /api/v1/repository?last_modified=true&namespace=whuquay&popularity=true&quota=true&state=true HTTP/1.1" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.022 1564 0.022)
gunicorn-web stdout | 2024-04-22 04:03:54,052 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:03:54 +0000] "GET /api/v1/repository?last_modified=true&namespace=whuquay&popularity=true&quota=true&state=true HTTP/1.0" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:03:54,053 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name", "t1"."id" AS "rid" FROM "repository" AS "t1" INNER JOIN "star" AS "t4" ON ("t4"."repository_id" = "t1"."id") INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "visibility" AS "t3" ON ("t1"."visibility_id" = "t3"."id") WHERE ((("t4"."user_id" = %s) AND ("t1"."kind_id" = %s)) AND ("t1"."state" != %s))', [1, 1, 3])
gunicorn-web stdout | 2024-04-22 04:03:54,056 [278] [DEBUG] [app] Ending request: urn:request:d4c7bceb-5d3b-43b4-b883-c8bb9aa6176d (/api/v1/repository) {'endpoint': 'api.repositorylist', 'request_id': 'urn:request:d4c7bceb-5d3b-43b4-b883-c8bb9aa6176d', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository?last_modified=true&namespace=build_test&popularity=true&public=false&quota=true&state=true', 'path': '/api/v1/repository', 'parameters': {'last_modified': 'true', 'namespace': 'build_test', 'popularity': 'true', 'public': 'false', 'quota': 'true', 'state': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:54,057 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:54,057 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:54 +0000] "GET /api/v1/repository?last_modified=true&namespace=build_test&popularity=true&public=false&quota=true&state=true HTTP/1.0" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:54 +0000] "GET /api/v1/repository?last_modified=true&namespace=build_test&popularity=true&public=false&quota=true&state=true HTTP/1.1" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.024 1580 0.024)
builder stdout | 2024-04-22 04:03:55,116 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 04:03:56,814 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 04:03:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:03:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:05.871852+00:00 (in 8.998246 seconds)
securityworker stdout | 2024-04-22 04:03:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:26 UTC)" (scheduled at 2024-04-22 04:03:56.873109+00:00)
securityworker stdout | 2024-04-22 04:03:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:03:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:03:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:03:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:03:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:03:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:03:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:03:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:03:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:03:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:03:56,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:03:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:03:56,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 58, 56, 881070), 1, 2])
securityworker stdout | 2024-04-22 04:03:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:03:56,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:03:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 58, 56, 881070), 1, 2])
securityworker stdout | 2024-04-22 04:03:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:03:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:03:56,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:03:56,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:03:56,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:03:56,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:03:56,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:03:56,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:03:56,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:03:56,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:26 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:03:58,192 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:03:58,578 [278] [DEBUG] [app] Starting request: urn:request:1a8d8fb1-3cba-4712-95d0-fc81eda3570e (/api/v1/organization/build_test) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:58,579 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:58,579 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:58,579 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:58,588 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:58,588 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:58,588 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:58,589 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:58,591 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:58,591 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:58,591 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:58,591 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:58,592 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:03:58,596 [278] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:58,596 [278] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:58,596 [278] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:58,596 [278] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:58,596 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t2" ON ("t1"."role_id" = "t2"."id") WHERE ("t1"."organization_id" = %s)', [2])
gunicorn-web stdout | 2024-04-22 04:03:58,598 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1"', [])
gunicorn-web stdout | 2024-04-22 04:03:58,601 [278] [DEBUG] [peewee] ('SELECT "t1"."team_id", Count("t1"."id") FROM "repositorypermission" AS "t1" WHERE ("t1"."team_id" IN (%s)) GROUP BY "t1"."team_id"', [1])
gunicorn-web stdout | 2024-04-22 04:03:58,603 [278] [DEBUG] [peewee] ('SELECT "t1"."team_id", Count("t1"."id") FROM "teammember" AS "t1" WHERE ("t1"."team_id" IN (%s)) GROUP BY "t1"."team_id"', [1])
gunicorn-web stdout | 2024-04-22 04:03:58,605 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:58,605 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:58,605 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:58,605 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['build_test'])
gunicorn-web stdout | 2024-04-22 04:03:58,608 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['build_test', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:58,610 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['build_test'])
gunicorn-web stdout | 2024-04-22 04:03:58,612 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."size_bytes", "t1"."backfill_start_ms", "t1"."backfill_complete" FROM "quotanamespacesize" AS "t1" WHERE ("t1"."namespace_user_id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:58,614 [278] [DEBUG] [app] Ending request: urn:request:1a8d8fb1-3cba-4712-95d0-fc81eda3570e (/api/v1/organization/build_test) {'endpoint': 'api.organization', 'request_id': 'urn:request:1a8d8fb1-3cba-4712-95d0-fc81eda3570e', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/organization/build_test', 'path': '/api/v1/organization/build_test', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:58,615 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:58,615 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:58 +0000] "GET /api/v1/organization/build_test HTTP/1.0" 200 805 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:58 +0000] "GET /api/v1/organization/build_test HTTP/1.1" 200 805 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.038 1498 0.038)
gunicorn-web stdout | 2024-04-22 04:03:58,995 [282] [DEBUG] [app] Starting request: urn:request:d13c9040-ed56-4737-b0cc-9ac10016a5aa (/api/v1/organization/build_test/quota) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:58,995 [278] [DEBUG] [app] Starting request: urn:request:38dc469c-acbf-4936-95fe-ac3f244d2008 (/api/v1/organization/build_test/proxycache) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:58,995 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:58,996 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:58,996 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:58,996 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:58,996 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:58,996 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:59,005 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:59,005 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:59,005 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:59,005 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:59,005 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,005 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,005 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,005 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:59,006 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:59,006 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:59,006 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:59,006 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,006 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,006 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,007 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:03:59,007 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:03:59,010 [278] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,010 [278] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,010 [278] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,010 [278] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:59,010 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."organization_id", "t1"."creation_date", "t1"."upstream_registry", "t1"."upstream_registry_username", "t1"."upstream_registry_password", "t1"."expiration_s", "t1"."insecure" FROM "proxycacheconfig" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") WHERE (("t2"."username" = %s) AND ("t2"."organization" = %s)) LIMIT %s OFFSET %s', ['build_test', True, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:59,010 [282] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,010 [282] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,010 [282] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,011 [282] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:59,011 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:59,013 [278] [DEBUG] [app] Ending request: urn:request:38dc469c-acbf-4936-95fe-ac3f244d2008 (/api/v1/organization/build_test/proxycache) {'endpoint': 'api.organizationproxycacheconfig', 'request_id': 'urn:request:38dc469c-acbf-4936-95fe-ac3f244d2008', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/organization/build_test/proxycache', 'path': '/api/v1/organization/build_test/proxycache', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:59,013 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['build_test'])
gunicorn-web stdout | 2024-04-22 04:03:59,013 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:59 +0000] "GET /api/v1/organization/build_test/proxycache HTTP/1.1" 200 62 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.020 1509 0.020)
gunicorn-web stdout | 2024-04-22 04:03:59,014 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:59 +0000] "GET /api/v1/organization/build_test/proxycache HTTP/1.0" 200 62 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:03:59,016 [282] [DEBUG] [app] Ending request: urn:request:d13c9040-ed56-4737-b0cc-9ac10016a5aa (/api/v1/organization/build_test/quota) {'endpoint': 'api.organizationquotalist', 'request_id': 'urn:request:d13c9040-ed56-4737-b0cc-9ac10016a5aa', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/organization/build_test/quota', 'path': '/api/v1/organization/build_test/quota', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:59,016 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:03:59,016 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:59 +0000] "GET /api/v1/organization/build_test/quota HTTP/1.0" 200 3 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:59 +0000] "GET /api/v1/organization/build_test/quota HTTP/1.1" 200 3 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.022 1504 0.022)
gunicorn-web stdout | 2024-04-22 04:03:59,036 [282] [DEBUG] [app] Starting request: urn:request:5563121c-b61a-4dde-8ada-a283cd6e403c (/api/v1/organization/build_test/prototypes) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:03:59,036 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:59,037 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:59,037 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:59,045 [278] [DEBUG] [app] Starting request: urn:request:4d0c4490-cb79-4c4f-9558-86a15c70e487 (/api/v1/repository) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:03:59,045 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:59,045 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:59,045 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:59,046 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:59,046 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:59,046 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:59,046 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:59,046 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,046 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,046 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,048 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:03:59,051 [282] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,051 [282] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,051 [282] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,051 [282] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:59,052 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:59,053 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:03:59,054 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:03:59,054 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:59,054 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:03:59,054 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,054 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,054 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:03:59,054 [278] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:03:59,054 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."org_id", "t1"."uuid", "t1"."activating_user_id", "t1"."delegate_user_id", "t1"."delegate_team_id", "t1"."role_id" FROM "permissionprototype" AS "t1" LEFT OUTER JOIN "user" AS "t2" ON ("t2"."id" = "t1"."activating_user_id") LEFT OUTER JOIN "user" AS "t3" ON ("t3"."id" = "t1"."delegate_user_id") LEFT OUTER JOIN "team" AS "t4" ON ("t4"."id" = "t1"."delegate_team_id") LEFT OUTER JOIN "role" AS "t5" ON ("t5"."id" = "t1"."role_id") WHERE ("t1"."org_id" = %s)', [2])
gunicorn-web stdout | 2024-04-22 04:03:59,055 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['whuquay', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:59,057 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['public', 1, 0])
gunicorn-web stdout | 2024-04-22 04:03:59,057 [282] [DEBUG] [app] Ending request: urn:request:5563121c-b61a-4dde-8ada-a283cd6e403c (/api/v1/organization/build_test/prototypes) {'endpoint': 'api.permissionprototypelist', 'request_id': 'urn:request:5563121c-b61a-4dde-8ada-a283cd6e403c', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/organization/build_test/prototypes', 'path': '/api/v1/organization/build_test/prototypes', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:59,058 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:03:59 +0000] "GET /api/v1/organization/build_test/prototypes HTTP/1.1" 200 19 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.023 1509 0.022)
gunicorn-web stdout | 2024-04-22 04:03:59,058 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:03:59 +0000] "GET /api/v1/organization/build_test/prototypes HTTP/1.0" 200 19 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:03:59,060 [278] [DEBUG] [peewee] ('(SELECT DISTINCT "t1"."name", "t1"."id" AS "rid", "t1"."description", "t2"."username", "t1"."visibility_id", "t1"."kind_id", "t1"."state" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") LEFT OUTER JOIN "repositorypermission" AS "t3" ON ("t3"."repository_id" = "t1"."id") WHERE (((("t1"."state" != %s) AND ("t1"."kind_id" = %s)) AND ("t2"."username" = %s)) AND ("t1"."visibility_id" = %s))) UNION (SELECT DISTINCT "t4"."name", "t4"."id" AS "rid", "t4"."description", "t5"."username", "t4"."visibility_id", "t4"."kind_id", "t4"."state" FROM "repository" AS "t4" INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "repositorypermission" AS "t6" ON ("t6"."repository_id" = "t4"."id") WHERE ((("t4"."state" != %s) AND ("t4"."kind_id" = %s)) AND ("t5"."username" = %s))) ORDER BY rid LIMIT %s', [3, 1, 'build_test', 1, 3, 1, 'build_test', 101])
gunicorn-web stdout | 2024-04-22 04:03:59,064 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name", "t1"."id" AS "rid" FROM "repository" AS "t1" INNER JOIN "star" AS "t4" ON ("t4"."repository_id" = "t1"."id") INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "visibility" AS "t3" ON ("t1"."visibility_id" = "t3"."id") WHERE ((("t4"."user_id" = %s) AND ("t1"."kind_id" = %s)) AND ("t1"."state" != %s))', [1, 1, 3])
gunicorn-web stdout | 2024-04-22 04:03:59,067 [278] [DEBUG] [app] Ending request: urn:request:4d0c4490-cb79-4c4f-9558-86a15c70e487 (/api/v1/repository) {'endpoint': 'api.repositorylist', 'request_id': 'urn:request:4d0c4490-cb79-4c4f-9558-86a15c70e487', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository?last_modified=true&namespace=build_test&popularity=true&public=true&quota=true', 'path': '/api/v1/repository', 'parameters': {'last_modified': 'true', 'namespace': 'build_test', 'popularity': 'true', 'public': 'true', 'quota': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:03:59,067 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:03:59 +0000] "GET /api/v1/repository?last_modified=true&namespace=build_test&popularity=true&public=true&quota=true HTTP/1.1" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.024 1564 0.024)
gunicorn-web stdout | 2024-04-22 04:03:59,068 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:03:59 +0000] "GET /api/v1/repository?last_modified=true&namespace=build_test&popularity=true&public=true&quota=true HTTP/1.0" 200 21 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/organization/build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:04:00,047 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:04:00,051 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:04:00,054 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:04:00,056 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:04:00,059 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
teamsyncworker stdout | 2024-04-22 04:04:00,067 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:04:00,241 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:04:00,653 [278] [DEBUG] [app] Starting request: urn:request:738e2792-3238-42c0-9d4d-6e76942d67a6 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:04:00,653 [279] [DEBUG] [app] Starting request: urn:request:b2f66a13-2a8e-4b2f-b8b4-d75afc3297e5 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:04:00,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:04:00,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:04:00,657 [292] [DEBUG] [app] Starting request: urn:request:2e6d9e4a-50f4-44bc-ae2c-c58cd3eb5a6c (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:04:00,657 [284] [DEBUG] [app] Starting request: urn:request:1a948eb4-26d4-4a08-a1ef-6bf2db2a1983 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:04:00,657 [284] [DEBUG] [app] Ending request: urn:request:1a948eb4-26d4-4a08-a1ef-6bf2db2a1983 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:1a948eb4-26d4-4a08-a1ef-6bf2db2a1983', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:04:00,657 [292] [DEBUG] [app] Ending request: urn:request:2e6d9e4a-50f4-44bc-ae2c-c58cd3eb5a6c (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:2e6d9e4a-50f4-44bc-ae2c-c58cd3eb5a6c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:04:00,658 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:04:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:04:00,658 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:04:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:04:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:04:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:04:00,658 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:04:00,658 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:04:00,660 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:04:00,660 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:04:00,661 [279] [DEBUG] [app] Starting request: urn:request:2078b93b-2017-4b06-8fed-c97009875ef5 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:04:00,661 [282] [DEBUG] [app] Starting request: urn:request:6d687cbe-443a-4a86-9d50-ea08e3fdd447 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:04:00,661 [279] [DEBUG] [app] Ending request: urn:request:2078b93b-2017-4b06-8fed-c97009875ef5 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:2078b93b-2017-4b06-8fed-c97009875ef5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:04:00,661 [282] [DEBUG] [app] Ending request: urn:request:6d687cbe-443a-4a86-9d50-ea08e3fdd447 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:6d687cbe-443a-4a86-9d50-ea08e3fdd447', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:04:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:04:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:04:00,662 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:04:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:04:00,662 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:04:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:04:00,662 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:04:00,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:04:00,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:04:00,663 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:04:00,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:04:00,669 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:04:00,676 [278] [DEBUG] [app] Ending request: urn:request:738e2792-3238-42c0-9d4d-6e76942d67a6 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:738e2792-3238-42c0-9d4d-6e76942d67a6', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:04:00,676 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:04:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.025)
gunicorn-web stdout | 2024-04-22 04:04:00,677 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:04:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:04:00,677 [279] [DEBUG] [app] Ending request: urn:request:b2f66a13-2a8e-4b2f-b8b4-d75afc3297e5 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b2f66a13-2a8e-4b2f-b8b4-d75afc3297e5', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:04:00,677 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:04:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
gunicorn-web stdout | 2024-04-22 04:04:00,677 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:04:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:00 +0000] "GET /static/fonts/glyphicons-halflings-regular.woff2 HTTP/1.1" 200 18028 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/static/ldn/bootstrap.min.css-13f668494557.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1446 -)
quotatotalworker stdout | 2024-04-22 04:04:01,052 [83] [DEBUG] [workers.worker] Scheduling worker.
quotatotalworker stdout | 2024-04-22 04:04:01,053 [83] [INFO] [apscheduler.scheduler] Scheduler started
quotatotalworker stdout | 2024-04-22 04:04:01,053 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:04:01,053 [83] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added
quotatotalworker stdout | 2024-04-22 04:04:01,053 [83] [DEBUG] [workers.worker] First run scheduled for 2024-04-22 04:04:16.054492
quotatotalworker stdout | 2024-04-22 04:04:01,054 [83] [INFO] [apscheduler.scheduler] Added job "QuotaTotalWorker.backfill" to job store "default"
quotatotalworker stdout | 2024-04-22 04:04:01,055 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:04:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:16.054492+00:00 (in 14.999412 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:04:01,070 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:04:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:04:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:16.552337+00:00 (in 13.995602 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:04:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:02 UTC)" (scheduled at 2024-04-22 04:04:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:04:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:04:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:04:02,684 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:04:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:04:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:13.759375+00:00 (in 9.999454 seconds)
notificationworker stdout | 2024-04-22 04:04:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:04:13 UTC)" (scheduled at 2024-04-22 04:04:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:04:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:04:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 4, 3, 760261), True, datetime.datetime(2024, 4, 22, 4, 4, 3, 760261), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:04:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:04:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:04:03,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:04:13 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:04:03,971 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:04:04,243 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:04:04,454 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:04:04,662 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:04:04,664 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:04:04,668 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:04:05,500 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:04:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:04:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:26.873109+00:00 (in 21.000826 seconds)
securityworker stdout | 2024-04-22 04:04:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:35 UTC)" (scheduled at 2024-04-22 04:04:05.871852+00:00)
securityworker stdout | 2024-04-22 04:04:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:04:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:04:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:04:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:04:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:04:05,886 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:04:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:35 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:04:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:04:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:13.555667+00:00 (in 7.002653 seconds)
repositorygcworker stdout | 2024-04-22 04:04:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:06 UTC)" (scheduled at 2024-04-22 04:04:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:04:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:04:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 4, 6, 553425), True, datetime.datetime(2024, 4, 22, 4, 4, 6, 553425), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:04:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:04:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:04:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:06 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:04:06,682 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:04:06,799 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:04:06,934 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:04:07,919 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:04:09,250 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:04:09,284 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:04:09,622 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:04:09,706 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:04:10,958 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:04:10,964 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:04:10,968 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:04:10,970 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:04:10,974 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:04:10,978 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:04:10,981 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:04:10,984 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:04:10,986 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
storagereplication stdout | 2024-04-22 04:04:10,989 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
autopruneworker stdout | 2024-04-22 04:04:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:04:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:41.264267+00:00 (in 29.999439 seconds)
autopruneworker stdout | 2024-04-22 04:04:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:41 UTC)" (scheduled at 2024-04-22 04:04:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:04:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758591271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:04:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:04:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:04:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:41 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:04:12,180 [278] [DEBUG] [app] Starting request: urn:request:36128063-fa31-4c51-804f-7c59cfbea809 (/api/v1/repository) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:04:12,180 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:12,180 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:12,181 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,190 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:12,190 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:12,190 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:12,191 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:12,191 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:12,191 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:12,191 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:12,193 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:04:12,196 [278] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:12,196 [278] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:12,196 [278] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:12,196 [278] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:04:12,197 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,200 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,203 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,205 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1"', [])
gunicorn-web stdout | 2024-04-22 04:04:12,207 [278] [DEBUG] [peewee] ('INSERT INTO "repository" ("namespace_user_id", "name", "visibility_id", "description", "badge_token", "kind_id", "trust_enabled", "state") VALUES (%s, %s, %s, %s, %s, %s, %s, %s) RETURNING "repository"."id"', [2, 'pushno', 2, '', '4e9e236d-00da-4775-9f4b-1d801cd061e3', 1, False, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,209 [278] [DEBUG] [peewee] ('INSERT INTO "repositoryactioncount" ("repository_id", "count", "date") VALUES (%s, %s, %s) RETURNING "repositoryactioncount"."id"', [1, 0, datetime.date(2024, 4, 21)])
gunicorn-web stdout | 2024-04-22 04:04:12,211 [278] [DEBUG] [peewee] ('INSERT INTO "repositorysearchscore" ("repository_id", "score") VALUES (%s, %s) RETURNING "repositorysearchscore"."id"', [1, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,213 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "role" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['admin', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,214 [278] [DEBUG] [peewee] ('INSERT INTO "repositorypermission" ("user_id", "repository_id", "role_id") VALUES (%s, %s, %s) RETURNING "repositorypermission"."id"', [1, 1, 1])
gunicorn-web stdout | 2024-04-22 04:04:12,219 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."org_id", "t1"."uuid", "t1"."activating_user_id", "t1"."delegate_user_id", "t1"."delegate_team_id", "t1"."role_id" FROM "permissionprototype" AS "t1" WHERE ((("t1"."org_id" = %s) AND (("t1"."activating_user_id" = %s) OR ("t1"."activating_user_id" IS %s))) AND ("t1"."delegate_user_id" IS %s))', [2, 1, None, None])
gunicorn-web stdout | 2024-04-22 04:04:12,221 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."org_id", "t1"."uuid", "t1"."activating_user_id", "t1"."delegate_user_id", "t1"."delegate_team_id", "t1"."role_id" FROM "permissionprototype" AS "t1" WHERE ((("t1"."org_id" = %s) AND (("t1"."activating_user_id" = %s) OR ("t1"."activating_user_id" IS %s))) AND ("t1"."delegate_team_id" IS %s))', [2, 1, None, None])
gunicorn-web stdout | 2024-04-22 04:04:12,223 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,226 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,228 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "logentrykind" AS "t1"', [])
gunicorn-web stdout | 2024-04-22 04:04:12,232 [278] [DEBUG] [peewee] ('INSERT INTO "logentry3" ("kind_id", "account_id", "performer_id", "repository_id", "datetime", "ip", "metadata_json") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "logentry3"."id"', [14, 2, 1, 1, datetime.datetime(2024, 4, 22, 4, 4, 12, 226162), '10.128.2.8', '{"repo": "pushno", "namespace": "build_test"}'])
gunicorn-web stdout | 2024-04-22 04:04:12,236 [278] [DEBUG] [app] Ending request: urn:request:36128063-fa31-4c51-804f-7c59cfbea809 (/api/v1/repository) {'endpoint': 'api.repositorylist', 'request_id': 'urn:request:36128063-fa31-4c51-804f-7c59cfbea809', 'remote_addr': '10.128.2.8', 'http_method': 'POST', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository', 'path': '/api/v1/repository', 'parameters': {}, 'json_body': {'namespace': 'build_test', 'repository': 'pushno', 'visibility': 'private', 'description': '', 'repo_kind': 'image'}, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:12,236 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:04:12,237 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:04:12 +0000] "POST /api/v1/repository HTTP/1.0" 201 63 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/new/?namespace=build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:12 +0000] "POST /api/v1/repository HTTP/1.1" 201 63 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/new/?namespace=build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.059 1764 0.059)
gunicorn-web stdout | 2024-04-22 04:04:12,588 [281] [DEBUG] [app] Starting request: urn:request:56e09408-3f5b-4f08-a516-111d180bc95f (/api/v1/repository/build_test/pushno/tag/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:04:12,588 [282] [DEBUG] [app] Starting request: urn:request:667e76be-002b-4511-823b-764b3d47fad7 (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:04:12,589 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:12,589 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:12,589 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:12,589 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:12,589 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,589 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,598 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:12,598 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:12,598 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:12,598 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:12,599 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:12,599 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:12,599 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:12,599 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:12,599 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:12,599 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:12,599 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:12,599 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:12,599 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:12,599 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:12,599 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:12,599 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:12,601 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:04:12,601 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:04:12,608 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:12,608 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:12,608 [282] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:12,609 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,609 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,611 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,613 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,614 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:04:12,615 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,616 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:12,616 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:12,617 [282] [DEBUG] [app] Ending request: urn:request:667e76be-002b-4511-823b-764b3d47fad7 (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:667e76be-002b-4511-823b-764b3d47fad7', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeStats=true&includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeStats': 'true', 'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:12,617 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,617 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:04:12,618 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:04:12 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.0" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?namespace=build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:12 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.1" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?namespace=build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.036 1565 0.037)
gunicorn-web stdout | 2024-04-22 04:04:12,620 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."repository_id", "t1"."manifest_id", "t1"."lifetime_start_ms", "t1"."lifetime_end_ms", "t1"."hidden", "t1"."reversion", "t1"."tag_kind_id", "t1"."linked_tag_id", "t2"."id", "t2"."digest", "t2"."media_type_id", "t2"."layers_compressed_size", "t2"."config_media_type" FROM "tag" AS "t1" INNER JOIN "manifest" AS "t2" ON ("t1"."manifest_id" = "t2"."id") WHERE ((("t1"."repository_id" = %s) AND (("t1"."lifetime_end_ms" IS %s) OR ("t1"."lifetime_end_ms" > %s))) AND ("t1"."hidden" = %s)) ORDER BY "t1"."lifetime_start_ms" DESC, "t1"."name" LIMIT %s OFFSET %s', [1, None, 1713758652619, False, 101, 0])
gunicorn-web stdout | 2024-04-22 04:04:12,623 [281] [DEBUG] [app] Ending request: urn:request:56e09408-3f5b-4f08-a516-111d180bc95f (/api/v1/repository/build_test/pushno/tag/) {'endpoint': 'api.listrepositorytags', 'request_id': 'urn:request:56e09408-3f5b-4f08-a516-111d180bc95f', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true', 'path': '/api/v1/repository/build_test/pushno/tag/', 'parameters': {'limit': '100', 'page': '1', 'onlyActiveTags': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:12,624 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:04:12,624 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:04:12 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?namespace=build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:12 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.1" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?namespace=build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.043 1571 0.043)
gunicorn-web stdout | 2024-04-22 04:04:13,122 [282] [DEBUG] [app] Starting request: urn:request:172daefd-9e35-4782-8c12-210505f0a442 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:04:13,122 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:13,122 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:13,123 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:13,132 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:13,132 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:13,132 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:13,132 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:13,132 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:13,133 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:13,133 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:13,133 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:13,135 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:04:13,141 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:13,142 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:13,147 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:04:13,153 [282] [DEBUG] [app] Ending request: urn:request:172daefd-9e35-4782-8c12-210505f0a442 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:172daefd-9e35-4782-8c12-210505f0a442', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:13,154 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:04:13,154 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:04:13 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?namespace=build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:13 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?namespace=build_test" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.033 1544 0.033)
repositorygcworker stdout | 2024-04-22 04:04:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:04:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:06.552482+00:00 (in 52.996357 seconds)
repositorygcworker stdout | 2024-04-22 04:04:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:13 UTC)" (scheduled at 2024-04-22 04:04:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:04:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:04:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:04:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:04:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:19.762424+00:00 (in 6.002529 seconds)
notificationworker stdout | 2024-04-22 04:04:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:04:23 UTC)" (scheduled at 2024-04-22 04:04:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:04:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:04:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 4, 13, 760284), True, datetime.datetime(2024, 4, 22, 4, 4, 13, 760284), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:04:13,773 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:04:13,773 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:04:13,773 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:04:23 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:04:14,857 [278] [DEBUG] [app] Starting request: urn:request:2e2ccd43-4683-4705-b725-d9d8c00b69e3 (/api/v1/repository/build_test/pushno/permissions/user/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:04:14,857 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:14,857 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:14,858 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:14,861 [281] [DEBUG] [app] Starting request: urn:request:80ade038-6163-409c-9c67-872865e84abb (/api/v1/repository/build_test/pushno/permissions/team/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:04:14,861 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:14,861 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:14,862 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:14,867 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:14,867 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:14,867 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:14,867 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:14,867 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:14,868 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:14,868 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:14,868 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:14,870 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:04:14,870 [279] [DEBUG] [app] Starting request: urn:request:161ed142-ecc9-46d2-a586-435698e56520 (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:04:14,870 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:14,870 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:14,871 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:14,871 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:14,871 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:14,871 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:14,872 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:14,872 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:14,872 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:14,872 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:14,872 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:14,875 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:04:14,877 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:14,877 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:14,879 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:14,879 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:14,879 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:14,880 [279] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:14,880 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:14,880 [279] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:14,880 [279] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:14,880 [279] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:14,880 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed", "t2"."id", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "user" AS "t1" ON ("t3"."user_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:04:14,881 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:14,882 [281] [DEBUG] [peewee] ('SELECT "t1"."name", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "team" AS "t1" ON ("t3"."team_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:04:14,882 [279] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:04:14,883 [278] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."username" FROM "user" AS "t1" INNER JOIN "teammember" AS "t2" ON ("t2"."user_id" = "t1"."id") INNER JOIN "team" AS "t3" ON ("t2"."team_id" = "t3"."id") WHERE ((("t3"."organization_id" = %s) AND ("t1"."robot" = %s)) AND ("t1"."id" IN (%s)))', [2, False, 1])
gunicorn-web stdout | 2024-04-22 04:04:14,885 [281] [DEBUG] [app] Ending request: urn:request:80ade038-6163-409c-9c67-872865e84abb (/api/v1/repository/build_test/pushno/permissions/team/) {'endpoint': 'api.repositoryteampermissionlist', 'request_id': 'urn:request:80ade038-6163-409c-9c67-872865e84abb', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/team/', 'path': '/api/v1/repository/build_test/pushno/permissions/team/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:14,885 [278] [DEBUG] [app] Ending request: urn:request:2e2ccd43-4683-4705-b725-d9d8c00b69e3 (/api/v1/repository/build_test/pushno/permissions/user/) {'endpoint': 'api.repositoryuserpermissionlist', 'request_id': 'urn:request:2e2ccd43-4683-4705-b725-d9d8c00b69e3', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/user/', 'path': '/api/v1/repository/build_test/pushno/permissions/user/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:14,885 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:04:14,886 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:04:14,886 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:04:14 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.0" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:04:14,886 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:04:14 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.0" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:14 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.1" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.026 1558 0.026)
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:14 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.1" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.032 1558 0.032)
gunicorn-web stdout | 2024-04-22 04:04:14,889 [279] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:14,890 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:14,893 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t3"."username" = %s) AND ("t2"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:04:14,896 [279] [DEBUG] [app] Ending request: urn:request:161ed142-ecc9-46d2-a586-435698e56520 (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:161ed142-ecc9-46d2-a586-435698e56520', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:14,897 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:04:14 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 200 22 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.033 1554 0.032)
gunicorn-web stdout | 2024-04-22 04:04:14,897 [279] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:04:14 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 200 22 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gcworker stdout | 2024-04-22 04:04:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:04:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:44.952062+00:00 (in 29.999515 seconds)
gcworker stdout | 2024-04-22 04:04:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:44 UTC)" (scheduled at 2024-04-22 04:04:14.952062+00:00)
gcworker stdout | 2024-04-22 04:04:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549054952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:04:14,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:04:14,964 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:04:14,964 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:04:15,653 [278] [DEBUG] [app] Starting request: urn:request:433b5a35-2d59-4bfb-8506-59ccf496cd87 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:04:15,653 [279] [DEBUG] [app] Starting request: urn:request:7cc4bd79-296e-4795-b970-cf74ef976f9a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:04:15,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:04:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:04:15,656 [284] [DEBUG] [app] Starting request: urn:request:5c0bcac1-9a1d-4b52-a802-cd6e05109056 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:04:15,656 [292] [DEBUG] [app] Starting request: urn:request:36eaa315-a5d6-4657-a33f-45ec6348398f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:04:15,656 [284] [DEBUG] [app] Ending request: urn:request:5c0bcac1-9a1d-4b52-a802-cd6e05109056 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5c0bcac1-9a1d-4b52-a802-cd6e05109056', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:04:15,656 [292] [DEBUG] [app] Ending request: urn:request:36eaa315-a5d6-4657-a33f-45ec6348398f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:36eaa315-a5d6-4657-a33f-45ec6348398f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:04:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:04:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:04:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:04:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:04:15,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:04:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:04:15,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:04:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:04:15,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:04:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:04:15,659 [282] [DEBUG] [app] Starting request: urn:request:1e41ee86-f2bc-4724-a9f3-4516cd426033 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:04:15,660 [281] [DEBUG] [app] Starting request: urn:request:9a36d537-add0-47c0-82db-13c3afb76cbf (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:04:15,660 [282] [DEBUG] [app] Ending request: urn:request:1e41ee86-f2bc-4724-a9f3-4516cd426033 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1e41ee86-f2bc-4724-a9f3-4516cd426033', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:04:15,660 [281] [DEBUG] [app] Ending request: urn:request:9a36d537-add0-47c0-82db-13c3afb76cbf (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9a36d537-add0-47c0-82db-13c3afb76cbf', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:04:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:04:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:04:15,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:04:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:04:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:04:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:04:15,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:04:15,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:04:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:04:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:04:15,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:04:15,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:04:15,674 [278] [DEBUG] [app] Ending request: urn:request:433b5a35-2d59-4bfb-8506-59ccf496cd87 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:433b5a35-2d59-4bfb-8506-59ccf496cd87', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:04:15,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:04:15,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:04:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:04:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:04:15,675 [279] [DEBUG] [app] Ending request: urn:request:7cc4bd79-296e-4795-b970-cf74ef976f9a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:7cc4bd79-296e-4795-b970-cf74ef976f9a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:04:15,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:04:15,676 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:04:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:04:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.024)
quotatotalworker stdout | 2024-04-22 04:04:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:04:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:04:16 UTC)" (scheduled at 2024-04-22 04:04:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:04:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:04:16,057 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:31.054492+00:00 (in 14.997229 seconds)
quotatotalworker stdout | 2024-04-22 04:04:16,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:04:16,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:04:31 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:04:16,397 [281] [DEBUG] [app] Starting request: urn:request:b53a6379-64cb-4cdd-87a9-09d47da9e6e5 (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:04:16,397 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:16,397 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:16,398 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:16,407 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:16,408 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:16,408 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:16,408 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:16,408 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:16,408 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:16,408 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:16,408 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:16,411 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:04:16,418 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:16,418 [281] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:16,419 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:16,422 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:16,424 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:04:16,426 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:16,427 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:16,427 [281] [DEBUG] [app] Ending request: urn:request:b53a6379-64cb-4cdd-87a9-09d47da9e6e5 (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:b53a6379-64cb-4cdd-87a9-09d47da9e6e5', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:16,428 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:16 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.1" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.033 1565 0.033)
gunicorn-web stdout | 2024-04-22 04:04:16,428 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:04:16 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.0" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
securityscanningnotificationworker stdout | 2024-04-22 04:04:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:04:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:02.556208+00:00 (in 46.003323 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:04:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:16 UTC)" (scheduled at 2024-04-22 04:04:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:04:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:04:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 4, 16, 553292), True, datetime.datetime(2024, 4, 22, 4, 4, 16, 553292), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:04:16,563 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:04:16,563 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:04:16,563 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:04:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:04:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:47.052354+00:00 (in 29.999443 seconds)
buildlogsarchiver stdout | 2024-04-22 04:04:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:47 UTC)" (scheduled at 2024-04-22 04:04:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:04:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 4, 17, 53266), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:04:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:04:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:04:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:04:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:04:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:23.759375+00:00 (in 3.996479 seconds)
notificationworker stdout | 2024-04-22 04:04:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:19 UTC)" (scheduled at 2024-04-22 04:04:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:04:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:04:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:04:20,028 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:04:20 +0000] "GET /static/img/flowdock.ico HTTP/1.1" 200 5558 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1384 -)
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:21 +0000] "GET /static/img/hipchat.png HTTP/1.1" 200 2825 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1364 -)
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:21 +0000] "GET /static/img/slack.ico HTTP/1.1" 200 22486 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/?_=1713758630462" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.000 1362 -)
securityscanningnotificationworker stdout | 2024-04-22 04:04:21,510 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 04:04:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:04:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:43.057186+00:00 (in 20.997719 seconds)
namespacegcworker stdout | 2024-04-22 04:04:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:22 UTC)" (scheduled at 2024-04-22 04:04:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:04:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:04:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:04:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:04:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:33.759375+00:00 (in 9.999461 seconds)
notificationworker stdout | 2024-04-22 04:04:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:04:33 UTC)" (scheduled at 2024-04-22 04:04:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:04:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:04:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 4, 23, 760258), True, datetime.datetime(2024, 4, 22, 4, 4, 23, 760258), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:04:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:04:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:04:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:04:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:04:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:04:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:24.361582+00:00 (in 59.999451 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:04:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:24 UTC)" (scheduled at 2024-04-22 04:04:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:04:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:04:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:04:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:24 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:04:25,066 [278] [DEBUG] [app] Starting request: urn:request:2023af4c-3376-4446-9921-ee18fe2cdd52 (/api/v1/organization/build_test) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:04:25,066 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:25,066 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:25,067 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:25,076 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:25,076 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:25,076 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:25,076 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:25,078 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:25,078 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:25,078 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:25,079 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:25,080 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:04:25,083 [278] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:25,084 [278] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:25,084 [278] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:25,084 [278] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:04:25,084 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t2" ON ("t1"."role_id" = "t2"."id") WHERE ("t1"."organization_id" = %s)', [2])
gunicorn-web stdout | 2024-04-22 04:04:25,086 [278] [DEBUG] [peewee] ('SELECT "t1"."team_id", Count("t1"."id") FROM "repositorypermission" AS "t1" WHERE ("t1"."team_id" IN (%s)) GROUP BY "t1"."team_id"', [1])
gunicorn-web stdout | 2024-04-22 04:04:25,089 [278] [DEBUG] [peewee] ('SELECT "t1"."team_id", Count("t1"."id") FROM "teammember" AS "t1" WHERE ("t1"."team_id" IN (%s)) GROUP BY "t1"."team_id"', [1])
gunicorn-web stdout | 2024-04-22 04:04:25,090 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:25,090 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:25,091 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:25,091 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['build_test'])
gunicorn-web stdout | 2024-04-22 04:04:25,093 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['build_test', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:25,095 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['build_test'])
gunicorn-web stdout | 2024-04-22 04:04:25,097 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."size_bytes", "t1"."backfill_start_ms", "t1"."backfill_complete" FROM "quotanamespacesize" AS "t1" WHERE ("t1"."namespace_user_id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:25,100 [278] [DEBUG] [app] Ending request: urn:request:2023af4c-3376-4446-9921-ee18fe2cdd52 (/api/v1/organization/build_test) {'endpoint': 'api.organization', 'request_id': 'urn:request:2023af4c-3376-4446-9921-ee18fe2cdd52', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/organization/build_test', 'path': '/api/v1/organization/build_test', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:25,100 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:04:25,101 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:04:25 +0000] "GET /api/v1/organization/build_test HTTP/1.0" 200 805 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:25 +0000] "GET /api/v1/organization/build_test HTTP/1.1" 200 805 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.036 1523 0.037)
builder stdout | 2024-04-22 04:04:25,127 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 04:04:26,850 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 04:04:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:04:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:35.871852+00:00 (in 8.998278 seconds)
securityworker stdout | 2024-04-22 04:04:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:56 UTC)" (scheduled at 2024-04-22 04:04:26.873109+00:00)
securityworker stdout | 2024-04-22 04:04:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:04:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:04:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:04:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:04:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:04:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:04:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:04:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:04:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:04:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:04:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:04:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:04:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 59, 26, 881316), 1, 2])
securityworker stdout | 2024-04-22 04:04:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:04:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:04:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 59, 26, 881316), 1, 2])
securityworker stdout | 2024-04-22 04:04:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:04:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:04:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:04:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:04:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:04:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:04:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:04:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:04:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:04:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:04:56 UTC)" executed successfully
quotatotalworker stdout | 2024-04-22 04:04:28,093 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:04:28,212 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:04:30,056 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:04:30,063 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:04:30,065 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:04:30,068 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:04:30,071 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:04:30,103 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:04:30,257 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:04:30,653 [281] [DEBUG] [app] Starting request: urn:request:a1c86e28-b47a-4862-8503-7ca9d2b42910 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:04:30,653 [282] [DEBUG] [app] Starting request: urn:request:82d886d4-91fa-480d-b5a8-29b37854565c (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:04:30,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:04:30,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:04:30,656 [292] [DEBUG] [app] Starting request: urn:request:204c4650-b488-400d-bebf-c203ba316ea9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:04:30,657 [284] [DEBUG] [app] Starting request: urn:request:ac44b5fa-ba88-49f1-9bef-d99ac34d9c14 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:04:30,657 [292] [DEBUG] [app] Ending request: urn:request:204c4650-b488-400d-bebf-c203ba316ea9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:204c4650-b488-400d-bebf-c203ba316ea9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:04:30,657 [284] [DEBUG] [app] Ending request: urn:request:ac44b5fa-ba88-49f1-9bef-d99ac34d9c14 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:ac44b5fa-ba88-49f1-9bef-d99ac34d9c14', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:04:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:04:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:04:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:04:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:04:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:04:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:04:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:04:30,658 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:04:30,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:04:30,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:04:30,660 [278] [DEBUG] [app] Starting request: urn:request:521d36ad-38bd-49ac-9bdd-770cb1172f88 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:04:30,660 [278] [DEBUG] [app] Ending request: urn:request:521d36ad-38bd-49ac-9bdd-770cb1172f88 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:521d36ad-38bd-49ac-9bdd-770cb1172f88', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:04:30,660 [281] [DEBUG] [app] Starting request: urn:request:187a35ef-fa7c-4bc3-9b5c-506580bb4a88 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:04:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:04:30,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:04:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:04:30,661 [281] [DEBUG] [app] Ending request: urn:request:187a35ef-fa7c-4bc3-9b5c-506580bb4a88 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:187a35ef-fa7c-4bc3-9b5c-506580bb4a88', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:04:30,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:04:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:04:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:04:30,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:04:30,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:04:30,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:04:30,662 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:04:30,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:04:30,668 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:04:30,676 [282] [DEBUG] [app] Ending request: urn:request:82d886d4-91fa-480d-b5a8-29b37854565c (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:82d886d4-91fa-480d-b5a8-29b37854565c', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:04:30,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:04:30,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:04:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:04:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.023)
gunicorn-web stdout | 2024-04-22 04:04:30,676 [281] [DEBUG] [app] Ending request: urn:request:a1c86e28-b47a-4862-8503-7ca9d2b42910 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a1c86e28-b47a-4862-8503-7ca9d2b42910', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:04:30,677 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:04:30,677 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:04:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:04:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
quotatotalworker stdout | 2024-04-22 04:04:31,055 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:04:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:46.054492+00:00 (in 14.999019 seconds)
quotatotalworker stdout | 2024-04-22 04:04:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:04:46 UTC)" (scheduled at 2024-04-22 04:04:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:04:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:04:31,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:04:31,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:04:46 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:04:31,100 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:04:32,696 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:04:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:04:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:43.759375+00:00 (in 9.999505 seconds)
notificationworker stdout | 2024-04-22 04:04:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:04:43 UTC)" (scheduled at 2024-04-22 04:04:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:04:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:04:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 4, 33, 760272), True, datetime.datetime(2024, 4, 22, 4, 4, 33, 760272), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:04:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:04:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:04:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:04:43 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:04:34,005 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:04:34,280 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:04:34,491 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:04:34,669 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:04:34,673 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:04:34,675 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:04:35,527 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:04:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:04:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:56.873109+00:00 (in 21.000738 seconds)
securityworker stdout | 2024-04-22 04:04:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:05 UTC)" (scheduled at 2024-04-22 04:04:35.871852+00:00)
securityworker stdout | 2024-04-22 04:04:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:04:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:04:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:04:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:04:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:04:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:04:35,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:04:36,718 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:04:36,832 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:04:36,949 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:04:37,950 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:04:39,262 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:04:39,320 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
exportactionlogsworker stdout | 2024-04-22 04:04:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:04:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:41.564959+00:00 (in 1.997434 seconds)
exportactionlogsworker stdout | 2024-04-22 04:04:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:39 UTC)" (scheduled at 2024-04-22 04:04:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:04:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:04:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:39 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:04:39,632 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:04:39,743 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:04:40,970 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:04:40,974 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:04:40,978 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:04:40,982 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:04:40,985 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:04:40,989 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:04:40,992 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:04:40,994 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:04:40,997 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
storagereplication stdout | 2024-04-22 04:04:41,009 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
gunicorn-web stdout | 2024-04-22 04:04:41,097 [281] [DEBUG] [app] Starting request: urn:request:d6bb8c22-72eb-4a5d-b4e2-4c25ec8d584d (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:04:41,097 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,097 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,098 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,107 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:41,108 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:41,108 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,108 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:41,108 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,108 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,108 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,108 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,110 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:04:41,116 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,117 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,121 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description" FROM "team" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") WHERE ((("t1"."name" = %s) AND ("t2"."organization" = %s)) AND ("t2"."username" = %s)) LIMIT %s', ['owners', True, 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:04:41,124 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,126 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['repo_push', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,129 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['quay_notification', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,131 [281] [DEBUG] [peewee] ('INSERT INTO "repositorynotification" ("uuid", "repository_id", "event_id", "method_id", "title", "config_json", "event_config_json", "number_of_failures") VALUES (%s, %s, %s, %s, %s, %s, %s, %s) RETURNING "repositorynotification"."id"', ['be8728b1-b88c-4c96-82bc-47b149e585ad', 1, 5, 4, 'push quay', '{"target": {"name": "owners", "kind": "team", "is_robot": false, "avatar": {"name": "owners", "hash": "6f0e3a8c0eb46e8834b43b03374ece43a030621d92a7437beb48f871e90f8d90", "color": "#c7c7c7", "kind": "team"}, "is_org_member": true}}', '{}', 0])
gunicorn-web stdout | 2024-04-22 04:04:41,137 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,139 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,142 [281] [DEBUG] [peewee] ('INSERT INTO "logentry3" ("kind_id", "account_id", "performer_id", "repository_id", "datetime", "ip", "metadata_json") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "logentry3"."id"', [6, 2, 1, 1, datetime.datetime(2024, 4, 22, 4, 4, 41, 139534), '10.128.2.8', '{"repo": "pushno", "namespace": "build_test", "notification_id": "be8728b1-b88c-4c96-82bc-47b149e585ad", "event": "repo_push", "method": "quay_notification"}'])
gunicorn-web stdout | 2024-04-22 04:04:41,146 [281] [DEBUG] [app] Ending request: urn:request:d6bb8c22-72eb-4a5d-b4e2-4c25ec8d584d (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:d6bb8c22-72eb-4a5d-b4e2-4c25ec8d584d', 'remote_addr': '10.128.2.8', 'http_method': 'POST', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': {'event': 'repo_push', 'method': 'quay_notification', 'config': {'target': {'name': 'owners', 'kind': 'team', 'is_robot': False, 'avatar': {'name': 'owners', 'hash': '6f0e3a8c0eb46e8834b43b03374ece43a030621d92a7437beb48f871e90f8d90', 'color': '#c7c7c7', 'kind': 'team'}, 'is_org_member': True}}, 'eventConfig': {}, 'title': 'push quay'}, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:41,146 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:04:41,147 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:04:41 +0000] "POST /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 201 411 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:41 +0000] "POST /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 201 411 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.051 2021 0.051)
autopruneworker stdout | 2024-04-22 04:04:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:04:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:11.264267+00:00 (in 29.999568 seconds)
autopruneworker stdout | 2024-04-22 04:04:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:11 UTC)" (scheduled at 2024-04-22 04:04:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:04:41,271 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758621271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:04:41,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:04:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:04:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:11 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:04:41,485 [281] [DEBUG] [app] Starting request: urn:request:21411abf-dcb7-436a-bb17-f0d564808f11 (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:04:41,485 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,485 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,485 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,488 [278] [DEBUG] [app] Starting request: urn:request:9e711a68-1978-432a-b716-db9e054b3e30 (/api/v1/repository/build_test/pushno/tag/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:04:41,489 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,489 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,490 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,494 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:41,494 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:41,494 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,494 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:41,494 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,494 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,494 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,494 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,496 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:04:41,498 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:41,498 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:41,498 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,499 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:41,499 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,499 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,499 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,499 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,501 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:04:41,502 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,502 [281] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:41,503 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,506 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,508 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,508 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:04:41,509 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,510 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,510 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,511 [281] [DEBUG] [app] Ending request: urn:request:21411abf-dcb7-436a-bb17-f0d564808f11 (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:21411abf-dcb7-436a-bb17-f0d564808f11', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeStats=true&includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeStats': 'true', 'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:41,511 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:04:41,511 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:04:41 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.0" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:41 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.1" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.027 1557 0.027)
gunicorn-web stdout | 2024-04-22 04:04:41,513 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,516 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,518 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,521 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."repository_id", "t1"."manifest_id", "t1"."lifetime_start_ms", "t1"."lifetime_end_ms", "t1"."hidden", "t1"."reversion", "t1"."tag_kind_id", "t1"."linked_tag_id", "t2"."id", "t2"."digest", "t2"."media_type_id", "t2"."layers_compressed_size", "t2"."config_media_type" FROM "tag" AS "t1" INNER JOIN "manifest" AS "t2" ON ("t1"."manifest_id" = "t2"."id") WHERE ((("t1"."repository_id" = %s) AND (("t1"."lifetime_end_ms" IS %s) OR ("t1"."lifetime_end_ms" > %s))) AND ("t1"."hidden" = %s)) ORDER BY "t1"."lifetime_start_ms" DESC, "t1"."name" LIMIT %s OFFSET %s', [1, None, 1713758681520, False, 101, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,524 [278] [DEBUG] [app] Ending request: urn:request:9e711a68-1978-432a-b716-db9e054b3e30 (/api/v1/repository/build_test/pushno/tag/) {'endpoint': 'api.listrepositorytags', 'request_id': 'urn:request:9e711a68-1978-432a-b716-db9e054b3e30', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true', 'path': '/api/v1/repository/build_test/pushno/tag/', 'parameters': {'limit': '100', 'page': '1', 'onlyActiveTags': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:41,524 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:41 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.1" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.044 1563 0.044)
gunicorn-web stdout | 2024-04-22 04:04:41,525 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:04:41 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
exportactionlogsworker stdout | 2024-04-22 04:04:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:04:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:39.566970+00:00 (in 58.001546 seconds)
exportactionlogsworker stdout | 2024-04-22 04:04:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:41 UTC)" (scheduled at 2024-04-22 04:04:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:04:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:04:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 4, 41, 565643), True, datetime.datetime(2024, 4, 22, 4, 4, 41, 565643), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:04:41,575 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:04:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:04:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:41 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:04:41,918 [281] [DEBUG] [app] Starting request: urn:request:db320a37-94a9-432e-afff-e31c05d18552 (/api/v1/repository/build_test/pushno/permissions/team/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:04:41,918 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,918 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,919 [278] [DEBUG] [app] Starting request: urn:request:1a58f341-e10e-4eeb-9daa-8e6136bf2289 (/api/v1/repository/build_test/pushno/permissions/user/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:04:41,919 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,919 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,919 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,920 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,929 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:41,929 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:41,929 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,929 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:41,929 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,929 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,929 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,929 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,929 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:41,929 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:41,930 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,930 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:41,930 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:41,930 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,930 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,930 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,931 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:04:41,933 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:04:41,937 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,938 [281] [DEBUG] [peewee] ('SELECT "t1"."name", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "team" AS "t1" ON ("t3"."team_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:04:41,939 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:41,940 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:41,940 [281] [DEBUG] [app] Ending request: urn:request:db320a37-94a9-432e-afff-e31c05d18552 (/api/v1/repository/build_test/pushno/permissions/team/) {'endpoint': 'api.repositoryteampermissionlist', 'request_id': 'urn:request:db320a37-94a9-432e-afff-e31c05d18552', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/team/', 'path': '/api/v1/repository/build_test/pushno/permissions/team/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:41,941 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:41 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.1" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.024 1539 0.024)
gunicorn-web stdout | 2024-04-22 04:04:41,941 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:04:41 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.0" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:04:41,943 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed", "t2"."id", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "user" AS "t1" ON ("t3"."user_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:04:41,946 [278] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."username" FROM "user" AS "t1" INNER JOIN "teammember" AS "t2" ON ("t2"."user_id" = "t1"."id") INNER JOIN "team" AS "t3" ON ("t2"."team_id" = "t3"."id") WHERE ((("t3"."organization_id" = %s) AND ("t1"."robot" = %s)) AND ("t1"."id" IN (%s)))', [2, False, 1])
gunicorn-web stdout | 2024-04-22 04:04:41,948 [278] [DEBUG] [app] Ending request: urn:request:1a58f341-e10e-4eeb-9daa-8e6136bf2289 (/api/v1/repository/build_test/pushno/permissions/user/) {'endpoint': 'api.repositoryuserpermissionlist', 'request_id': 'urn:request:1a58f341-e10e-4eeb-9daa-8e6136bf2289', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/user/', 'path': '/api/v1/repository/build_test/pushno/permissions/user/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:41,949 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:41 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.1" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.032 1539 0.032)
gunicorn-web stdout | 2024-04-22 04:04:41,949 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:04:41 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.0" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:04:42,661 [281] [DEBUG] [app] Starting request: urn:request:00d36c23-aa88-4331-aaf4-45276ed3ad6a (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:04:42,661 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:42,661 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:42,661 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:42,670 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:42,670 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:42,670 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:42,670 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:42,670 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:42,670 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:42,670 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:42,671 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:42,672 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:04:42,678 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:42,679 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:42,683 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t3"."username" = %s) AND ("t2"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:04:42,685 [278] [DEBUG] [app] Starting request: urn:request:549f2cca-2b10-4b5f-80e6-14afc183051f (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:04:42,685 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:42,685 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:42,685 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:42,686 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:42,687 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [4, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:42,690 [281] [DEBUG] [app] Ending request: urn:request:00d36c23-aa88-4331-aaf4-45276ed3ad6a (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:00d36c23-aa88-4331-aaf4-45276ed3ad6a', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:42,690 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:04:42 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 200 432 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1535 0.030)
gunicorn-web stdout | 2024-04-22 04:04:42,690 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:04:42 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 200 432 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:04:42,696 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:42,696 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:42,696 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:42,696 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:42,696 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:42,696 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:42,696 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:42,696 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:42,699 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:04:42,705 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:42,707 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:42,711 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:04:42,716 [278] [DEBUG] [app] Ending request: urn:request:549f2cca-2b10-4b5f-80e6-14afc183051f (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:549f2cca-2b10-4b5f-80e6-14afc183051f', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:42,716 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:42 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.033 1536 0.033)
gunicorn-web stdout | 2024-04-22 04:04:42,717 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:04:42 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
namespacegcworker stdout | 2024-04-22 04:04:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:04:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:22.058978+00:00 (in 39.001298 seconds)
namespacegcworker stdout | 2024-04-22 04:04:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:43 UTC)" (scheduled at 2024-04-22 04:04:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:04:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:04:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 4, 43, 58095), True, datetime.datetime(2024, 4, 22, 4, 4, 43, 58095), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:04:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:04:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:04:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:05:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:04:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:04:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:04:53.759375+00:00 (in 9.999541 seconds)
notificationworker stdout | 2024-04-22 04:04:43,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:04:53 UTC)" (scheduled at 2024-04-22 04:04:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:04:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:04:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 4, 43, 760093), True, datetime.datetime(2024, 4, 22, 4, 4, 43, 760093), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:04:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:04:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:04:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:04:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:04:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:04:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:14.952062+00:00 (in 29.999466 seconds)
gcworker stdout | 2024-04-22 04:04:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:14 UTC)" (scheduled at 2024-04-22 04:04:44.952062+00:00)
gcworker stdout | 2024-04-22 04:04:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549084953, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:04:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:04:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:04:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:04:45,653 [278] [DEBUG] [app] Starting request: urn:request:4e7db7ff-f8bb-48e3-ab4d-c42723e5f592 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:04:45,653 [281] [DEBUG] [app] Starting request: urn:request:07945846-fed6-484a-9808-d0a032538ce4 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:04:45,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:04:45,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:04:45,656 [289] [DEBUG] [app] Starting request: urn:request:050e3eb0-1481-4f96-8392-f8a52b344cb9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:04:45,656 [290] [DEBUG] [app] Starting request: urn:request:8a6e5cf9-9060-43ff-a2d5-cff6e1421489 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:04:45,657 [290] [DEBUG] [app] Ending request: urn:request:8a6e5cf9-9060-43ff-a2d5-cff6e1421489 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:8a6e5cf9-9060-43ff-a2d5-cff6e1421489', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:04:45,657 [289] [DEBUG] [app] Ending request: urn:request:050e3eb0-1481-4f96-8392-f8a52b344cb9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:050e3eb0-1481-4f96-8392-f8a52b344cb9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:04:45,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:04:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:04:45,657 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:04:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:04:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:04:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:04:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:04:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:04:45,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:04:45,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:04:45,660 [281] [DEBUG] [app] Starting request: urn:request:98ecf3cc-476f-474f-adbd-244b4bb1a477 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:04:45,660 [281] [DEBUG] [app] Ending request: urn:request:98ecf3cc-476f-474f-adbd-244b4bb1a477 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:98ecf3cc-476f-474f-adbd-244b4bb1a477', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:04:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:04:45,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:04:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:04:45,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:04:45,661 [279] [DEBUG] [app] Starting request: urn:request:b3f77e97-e3bd-444a-b5da-48fb2ef4a4fb (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:04:45,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:04:45,661 [279] [DEBUG] [app] Ending request: urn:request:b3f77e97-e3bd-444a-b5da-48fb2ef4a4fb (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b3f77e97-e3bd-444a-b5da-48fb2ef4a4fb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:04:45,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:04:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:04:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:04:45,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:04:45,663 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:04:45,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:04:45,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:04:45,675 [281] [DEBUG] [app] Ending request: urn:request:07945846-fed6-484a-9808-d0a032538ce4 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:07945846-fed6-484a-9808-d0a032538ce4', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:04:45,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:04:45,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:04:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:04:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:04:45,676 [278] [DEBUG] [app] Ending request: urn:request:4e7db7ff-f8bb-48e3-ab4d-c42723e5f592 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:4e7db7ff-f8bb-48e3-ab4d-c42723e5f592', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:04:45,677 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:04:45,677 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:04:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:04:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
quotatotalworker stdout | 2024-04-22 04:04:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:04:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:01.054492+00:00 (in 14.999491 seconds)
quotatotalworker stdout | 2024-04-22 04:04:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:05:01 UTC)" (scheduled at 2024-04-22 04:04:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:04:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:04:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:04:46,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:05:01 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:04:46,671 [279] [DEBUG] [app] Starting request: urn:request:d02b62b7-5e84-45a7-ad6a-4ebc2b5dbffd (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:04:46,672 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:46,672 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:46,672 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:46,682 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:04:46,682 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:04:46,682 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:46,682 [279] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:46,682 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:46,682 [279] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:46,682 [279] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:46,682 [279] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:46,684 [279] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:04:46,691 [279] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:04:46,691 [279] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:04:46,692 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:46,695 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:46,697 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['public', 1, 0])
gunicorn-web stdout | 2024-04-22 04:04:46,699 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:04:46,701 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:46,701 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:04:46,702 [279] [DEBUG] [app] Ending request: urn:request:d02b62b7-5e84-45a7-ad6a-4ebc2b5dbffd (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:d02b62b7-5e84-45a7-ad6a-4ebc2b5dbffd', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:04:46,702 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:04:46,703 [279] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:04:46 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.0" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:04:46 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.1" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.034 1546 0.035)
buildlogsarchiver stdout | 2024-04-22 04:04:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:04:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:17.052354+00:00 (in 29.999508 seconds)
buildlogsarchiver stdout | 2024-04-22 04:04:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:17 UTC)" (scheduled at 2024-04-22 04:04:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:04:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 4, 47, 53201), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:04:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:04:47,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:04:47,063 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:04:50,065 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:04:51,525 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:04:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:04:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:03.759375+00:00 (in 9.999457 seconds)
notificationworker stdout | 2024-04-22 04:04:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:05:03 UTC)" (scheduled at 2024-04-22 04:04:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:04:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:04:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 4, 53, 760366), True, datetime.datetime(2024, 4, 22, 4, 4, 53, 760366), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:04:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:04:53,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:04:53,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:05:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:04:55,165 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:04:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:04:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:05.871852+00:00 (in 8.998216 seconds)
securityworker stdout | 2024-04-22 04:04:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:26 UTC)" (scheduled at 2024-04-22 04:04:56.873109+00:00)
securityworker stdout | 2024-04-22 04:04:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:04:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:04:56,875 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:04:56,875 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:04:56,875 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:04:56,876 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:04:56,876 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:04:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:04:56,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
repositoryactioncounter stdout | 2024-04-22 04:04:56,896 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
securityworker stdout | 2024-04-22 04:04:56,919 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:04:56,928 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:04:56,929 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:04:56,930 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 3, 59, 56, 880441), 1, 2])
securityworker stdout | 2024-04-22 04:04:56,932 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:04:56,932 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:04:56,933 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 3, 59, 56, 880441), 1, 2])
securityworker stdout | 2024-04-22 04:04:56,935 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:04:56,935 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:04:56,936 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:04:56,936 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:04:56,936 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:04:56,936 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:04:56,936 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:04:56,937 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:04:56,937 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:04:56,937 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:26 UTC)" executed successfully
quotatotalworker stdout | 2024-04-22 04:04:58,129 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:04:58,249 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:05:00,065 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:05:00,074 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:05:00,076 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:05:00,079 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:05:00,083 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:05:00,128 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:05:00,287 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:05:00,653 [281] [DEBUG] [app] Starting request: urn:request:4b8ef757-c5f6-4cec-a7d1-475d07746872 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:05:00,653 [278] [DEBUG] [app] Starting request: urn:request:0c942ae5-f053-461f-a531-2b113e059d1a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:05:00,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:05:00,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:05:00,656 [284] [DEBUG] [app] Starting request: urn:request:de684d59-f616-49b7-9ce7-98be75ff6032 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:05:00,656 [284] [DEBUG] [app] Ending request: urn:request:de684d59-f616-49b7-9ce7-98be75ff6032 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:de684d59-f616-49b7-9ce7-98be75ff6032', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:05:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:05:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:05:00,657 [292] [DEBUG] [app] Starting request: urn:request:e851dcbd-2a3b-4bdd-909d-1f4d5b2b8c3c (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:05:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:05:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 04:05:00,657 [292] [DEBUG] [app] Ending request: urn:request:e851dcbd-2a3b-4bdd-909d-1f4d5b2b8c3c (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:e851dcbd-2a3b-4bdd-909d-1f4d5b2b8c3c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:05:00,658 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:05:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:05:00,658 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:05:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-web stdout | 2024-04-22 04:05:00,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:05:00,659 [282] [DEBUG] [app] Starting request: urn:request:4084f4ec-85b9-4679-a24d-4e337bc26bf5 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:05:00,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:05:00,660 [282] [DEBUG] [app] Ending request: urn:request:4084f4ec-85b9-4679-a24d-4e337bc26bf5 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:4084f4ec-85b9-4679-a24d-4e337bc26bf5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:05:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:05:00,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:05:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:05:00,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:05:00,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:05:00,661 [279] [DEBUG] [app] Starting request: urn:request:1a94e349-50ed-449c-b575-a1430e72b9b4 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:05:00,661 [279] [DEBUG] [app] Ending request: urn:request:1a94e349-50ed-449c-b575-a1430e72b9b4 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1a94e349-50ed-449c-b575-a1430e72b9b4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:05:00,662 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:05:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:05:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:05:00,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:05:00,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:05:00,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:05:00,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:05:00,674 [281] [DEBUG] [app] Ending request: urn:request:4b8ef757-c5f6-4cec-a7d1-475d07746872 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:4b8ef757-c5f6-4cec-a7d1-475d07746872', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:05:00,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:00,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:05:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:05:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:05:00,676 [278] [DEBUG] [app] Ending request: urn:request:0c942ae5-f053-461f-a531-2b113e059d1a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:0c942ae5-f053-461f-a531-2b113e059d1a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:05:00,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:00,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:05:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:05:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
quotatotalworker stdout | 2024-04-22 04:05:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:05:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:16.054492+00:00 (in 14.999459 seconds)
quotatotalworker stdout | 2024-04-22 04:05:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:05:16 UTC)" (scheduled at 2024-04-22 04:05:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:05:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:05:01,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:05:01,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:05:16 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:05:01,129 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 04:05:01,307 [281] [DEBUG] [app] Starting request: urn:request:37fd8205-a151-46b1-97ba-084917b10a9d (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:01,307 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:01,308 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:01,308 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:01,326 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:01,326 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:01,326 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:01,326 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:01,326 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:01,327 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:01,327 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:01,327 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:01,329 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:01,335 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:01,336 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:01,341 [281] [DEBUG] [app] Ending request: urn:request:37fd8205-a151-46b1-97ba-084917b10a9d (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:37fd8205-a151-46b1-97ba-084917b10a9d', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:01,341 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:01,341 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:01 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 404 136 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:01 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 404 136 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.035 1562 0.035)
securityscanningnotificationworker stdout | 2024-04-22 04:05:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:05:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:16.552337+00:00 (in 13.995624 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:05:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:02 UTC)" (scheduled at 2024-04-22 04:05:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:05:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:05:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:05:02,710 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:05:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:05:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:13.759375+00:00 (in 9.999461 seconds)
notificationworker stdout | 2024-04-22 04:05:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:05:13 UTC)" (scheduled at 2024-04-22 04:05:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:05:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:05:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 5, 3, 760262), True, datetime.datetime(2024, 4, 22, 4, 5, 3, 760262), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:05:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:05:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:05:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:05:13 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:05:04,023 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:05:04,297 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:05:04,498 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:05:04,678 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:05:04,681 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:05:04,685 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:05:05,563 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:05:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:05:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:26.873109+00:00 (in 21.000717 seconds)
securityworker stdout | 2024-04-22 04:05:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:35 UTC)" (scheduled at 2024-04-22 04:05:05.871852+00:00)
securityworker stdout | 2024-04-22 04:05:05,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:05:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:05:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:05:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:05:05,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:05:05,888 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:05:05,888 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:35 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:05:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:05:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:13.555667+00:00 (in 7.002683 seconds)
repositorygcworker stdout | 2024-04-22 04:05:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:06 UTC)" (scheduled at 2024-04-22 04:05:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:05:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:05:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 5, 6, 553263), True, datetime.datetime(2024, 4, 22, 4, 5, 6, 553263), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:05:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:05:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:05:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:06 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:05:06,753 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:05:06,847 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:05:06,961 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
gunicorn-web stdout | 2024-04-22 04:05:07,163 [281] [DEBUG] [app] Starting request: urn:request:b17cfff5-71ef-47b7-8a87-2ed7a7c8fdfe (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:07,163 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:07,163 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:07,164 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:07,173 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:07,173 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:07,174 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:07,174 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:07,174 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:07,174 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:07,174 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:07,174 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:07,176 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:07,183 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:07,184 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:07,187 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:07,188 [281] [DEBUG] [peewee] ('INSERT INTO "repositoryauthorizedemail" ("repository_id", "email", "code", "confirmed") VALUES (%s, %s, %s, %s) RETURNING "repositoryauthorizedemail"."id"', [1, 'hu_weihua@163.com', 'X02X45ST1YHE8C4H', False])
blobuploadcleanupworker stdout | 2024-04-22 04:05:07,970 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:05:09,299 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:05:09,357 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:05:09,669 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:05:09,771 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:05:10,981 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:05:10,984 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:05:10,988 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:05:10,992 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:05:10,994 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:05:10,998 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:05:11,001 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:05:11,005 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:05:11,007 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
storagereplication stdout | 2024-04-22 04:05:11,044 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
autopruneworker stdout | 2024-04-22 04:05:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:05:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:41.264267+00:00 (in 29.999518 seconds)
autopruneworker stdout | 2024-04-22 04:05:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:41 UTC)" (scheduled at 2024-04-22 04:05:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:05:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758651271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:05:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:05:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:05:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:41 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:05:11,465 [281] [DEBUG] [util.useremails] Sent email: '[Red Hat Quay] Please verify your e-mail address for repository build_test/pushno'
gunicorn-web stdout | 2024-04-22 04:05:11,468 [281] [DEBUG] [app] Ending request: urn:request:b17cfff5-71ef-47b7-8a87-2ed7a7c8fdfe (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:b17cfff5-71ef-47b7-8a87-2ed7a7c8fdfe', 'remote_addr': '10.128.2.8', 'http_method': 'POST', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': {}, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:11,469 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:11,469 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:11 +0000] "POST /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:11 +0000] "POST /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (4.308 1731 4.307)
repositorygcworker stdout | 2024-04-22 04:05:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:05:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:06.552482+00:00 (in 52.996284 seconds)
repositorygcworker stdout | 2024-04-22 04:05:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:13 UTC)" (scheduled at 2024-04-22 04:05:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:05:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:05:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:05:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:05:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:19.762424+00:00 (in 6.002584 seconds)
notificationworker stdout | 2024-04-22 04:05:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:05:23 UTC)" (scheduled at 2024-04-22 04:05:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:05:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:05:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 5, 13, 760220), True, datetime.datetime(2024, 4, 22, 4, 5, 13, 760220), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:05:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:05:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:05:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:05:23 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:05:13,806 [278] [DEBUG] [app] Starting request: urn:request:bf7edd6b-53d9-400a-a8c8-6b708e45138b (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:13,807 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:13,807 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:13,808 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:13,817 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:13,817 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:13,817 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:13,818 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:13,818 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:13,818 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:13,818 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:13,818 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:13,820 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:13,826 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:13,828 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:13,831 [278] [DEBUG] [app] Ending request: urn:request:bf7edd6b-53d9-400a-a8c8-6b708e45138b (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:bf7edd6b-53d9-400a-a8c8-6b708e45138b', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:13,831 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:13 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.026 1562 0.026)
gunicorn-web stdout | 2024-04-22 04:05:13,831 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:13 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gcworker stdout | 2024-04-22 04:05:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:05:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:44.952062+00:00 (in 29.999457 seconds)
gcworker stdout | 2024-04-22 04:05:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:44 UTC)" (scheduled at 2024-04-22 04:05:14.952062+00:00)
gcworker stdout | 2024-04-22 04:05:14,954 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549114953, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:05:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:05:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:05:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:05:15,653 [278] [DEBUG] [app] Starting request: urn:request:8bfcd355-8228-45fb-90e0-2bc9e3d539f7 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:05:15,653 [282] [DEBUG] [app] Starting request: urn:request:13a0e060-7559-4be3-b889-01799356b3ff (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:05:15,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:05:15,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:05:15,656 [290] [DEBUG] [app] Starting request: urn:request:1ae123a4-7f34-4555-a795-d4425aa73372 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:05:15,657 [290] [DEBUG] [app] Ending request: urn:request:1ae123a4-7f34-4555-a795-d4425aa73372 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:1ae123a4-7f34-4555-a795-d4425aa73372', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:05:15,657 [289] [DEBUG] [app] Starting request: urn:request:10acb8ea-9877-4518-91fd-cc4356446950 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:05:15,657 [289] [DEBUG] [app] Ending request: urn:request:10acb8ea-9877-4518-91fd-cc4356446950 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:10acb8ea-9877-4518-91fd-cc4356446950', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:05:15,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:05:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:05:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:05:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:05:15,657 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:05:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:05:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:05:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:05:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:05:15,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:05:15,660 [281] [DEBUG] [app] Starting request: urn:request:f9d30314-b961-450f-870d-9b73f26c76c6 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:05:15,660 [281] [DEBUG] [app] Ending request: urn:request:f9d30314-b961-450f-870d-9b73f26c76c6 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:f9d30314-b961-450f-870d-9b73f26c76c6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:05:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:05:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:05:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:05:15,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:05:15,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:05:15,661 [281] [DEBUG] [app] Starting request: urn:request:0e9ea044-11c6-4050-a856-3542fad2a7c9 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:05:15,661 [281] [DEBUG] [app] Ending request: urn:request:0e9ea044-11c6-4050-a856-3542fad2a7c9 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:0e9ea044-11c6-4050-a856-3542fad2a7c9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:05:15,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:05:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:05:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.000)
gunicorn-web stdout | 2024-04-22 04:05:15,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:05:15,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:05:15,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:05:15,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:05:15,675 [282] [DEBUG] [app] Ending request: urn:request:13a0e060-7559-4be3-b889-01799356b3ff (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:13a0e060-7559-4be3-b889-01799356b3ff', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:05:15,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:15,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:05:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:05:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:05:15,676 [278] [DEBUG] [app] Ending request: urn:request:8bfcd355-8228-45fb-90e0-2bc9e3d539f7 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:8bfcd355-8228-45fb-90e0-2bc9e3d539f7', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:05:15,676 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:05:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 04:05:15,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:05:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:05:15,821 [278] [DEBUG] [app] Starting request: urn:request:5f0bda0b-8bce-4dbb-8536-96a4d8abfb27 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:15,821 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:15,821 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:15,822 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:15,832 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:15,832 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:15,832 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:15,832 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:15,832 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:15,832 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:15,833 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:15,833 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:15,835 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:15,842 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:15,843 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:15,846 [278] [DEBUG] [app] Ending request: urn:request:5f0bda0b-8bce-4dbb-8536-96a4d8abfb27 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:5f0bda0b-8bce-4dbb-8536-96a4d8abfb27', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:15,847 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:15 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.028 1581 0.027)
gunicorn-web stdout | 2024-04-22 04:05:15,847 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:15 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
quotatotalworker stdout | 2024-04-22 04:05:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:05:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:31.054492+00:00 (in 14.999470 seconds)
quotatotalworker stdout | 2024-04-22 04:05:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:05:31 UTC)" (scheduled at 2024-04-22 04:05:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:05:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:05:16,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:05:16,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:05:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:05:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:05:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:02.556208+00:00 (in 46.003297 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:05:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:16 UTC)" (scheduled at 2024-04-22 04:05:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:05:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:05:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 5, 16, 553313), True, datetime.datetime(2024, 4, 22, 4, 5, 16, 553313), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:05:16,571 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:05:16,571 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:05:16,572 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:05:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:05:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:47.052354+00:00 (in 29.999443 seconds)
buildlogsarchiver stdout | 2024-04-22 04:05:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:47 UTC)" (scheduled at 2024-04-22 04:05:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:05:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 5, 17, 53299), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:05:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:05:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:05:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:47 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:05:18,547 [282] [DEBUG] [app] Starting request: urn:request:d72ea63f-4cd8-485f-8b91-ef722eba2dae (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:05:18,547 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:18,547 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:18,547 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:18,557 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:18,557 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:18,557 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:18,558 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:18,558 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:18,558 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:18,558 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:18,558 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:18,560 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:18,566 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:18,567 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:18,570 [282] [DEBUG] [app] Ending request: urn:request:d72ea63f-4cd8-485f-8b91-ef722eba2dae (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:d72ea63f-4cd8-485f-8b91-ef722eba2dae', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:18,570 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:18,571 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:05:18 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:05:18 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.026 1562 0.026)
notificationworker stdout | 2024-04-22 04:05:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:05:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:23.759375+00:00 (in 3.996461 seconds)
notificationworker stdout | 2024-04-22 04:05:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:19 UTC)" (scheduled at 2024-04-22 04:05:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:05:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:05:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:05:20,084 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:05:21,560 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
gunicorn-web stdout | 2024-04-22 04:05:21,914 [281] [DEBUG] [app] Starting request: urn:request:ee0659d5-70b6-49b0-8002-eaf864236c64 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:05:21,914 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:21,914 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:21,915 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:21,934 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:21,935 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:21,935 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:21,935 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:21,935 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:21,935 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:21,935 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:21,935 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:21,937 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:21,944 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:21,945 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:21,948 [281] [DEBUG] [app] Ending request: urn:request:ee0659d5-70b6-49b0-8002-eaf864236c64 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:ee0659d5-70b6-49b0-8002-eaf864236c64', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:21,949 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:21,949 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:05:21 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:05:21 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.036 1581 0.036)
namespacegcworker stdout | 2024-04-22 04:05:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:05:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:43.057186+00:00 (in 20.997683 seconds)
namespacegcworker stdout | 2024-04-22 04:05:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:22 UTC)" (scheduled at 2024-04-22 04:05:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:05:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:05:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:05:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:05:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:33.759375+00:00 (in 9.999515 seconds)
notificationworker stdout | 2024-04-22 04:05:23,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:05:33 UTC)" (scheduled at 2024-04-22 04:05:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:05:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:05:23,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 5, 23, 760109), True, datetime.datetime(2024, 4, 22, 4, 5, 23, 760109), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:05:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:05:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:05:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:05:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:05:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:05:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:24.361582+00:00 (in 59.999456 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:05:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:24 UTC)" (scheduled at 2024-04-22 04:05:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:05:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:05:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:05:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:24 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:05:24,840 [278] [DEBUG] [app] Starting request: urn:request:ad1c94e5-077a-45e4-8e5b-cd2c772852af (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:24,840 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:24,841 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:24,841 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:24,851 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:24,851 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:24,851 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:24,851 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:24,851 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:24,851 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:24,851 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:24,851 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:24,854 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:24,860 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:24,861 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:24,864 [278] [DEBUG] [app] Ending request: urn:request:ad1c94e5-077a-45e4-8e5b-cd2c772852af (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:ad1c94e5-077a-45e4-8e5b-cd2c772852af', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:24,865 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:24,865 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:24 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:24 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.026 1562 0.026)
builder stdout | 2024-04-22 04:05:25,189 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:05:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:05:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:35.871852+00:00 (in 8.998226 seconds)
securityworker stdout | 2024-04-22 04:05:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:56 UTC)" (scheduled at 2024-04-22 04:05:26.873109+00:00)
securityworker stdout | 2024-04-22 04:05:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:05:26,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:05:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:05:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:05:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:05:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:05:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:05:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:05:26,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:05:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:05:26,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:05:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:05:26,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 0, 26, 880730), 1, 2])
securityworker stdout | 2024-04-22 04:05:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:05:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:05:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 0, 26, 880730), 1, 2])
securityworker stdout | 2024-04-22 04:05:26,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:05:26,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:05:26,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:05:26,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:05:26,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:05:26,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:05:26,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:05:26,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:05:26,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:05:26,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:05:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:05:26,927 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
gunicorn-web stdout | 2024-04-22 04:05:27,259 [282] [DEBUG] [app] Starting request: urn:request:760ed4ee-95c2-4650-922b-3a80024ec2b8 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:27,259 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:27,259 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:27,260 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:27,269 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:27,269 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:27,269 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:27,269 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:27,270 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:27,270 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:27,270 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:27,270 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:27,272 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:27,278 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:27,279 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:27,282 [282] [DEBUG] [app] Ending request: urn:request:760ed4ee-95c2-4650-922b-3a80024ec2b8 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:760ed4ee-95c2-4650-922b-3a80024ec2b8', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:27,282 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:27,283 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:27 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:27 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.025 1562 0.025)
quotatotalworker stdout | 2024-04-22 04:05:28,165 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:05:28,286 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:05:29,260 [282] [DEBUG] [app] Starting request: urn:request:63642f52-c9d9-413e-8b16-08f5aa4e0e86 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:29,261 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:29,261 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:29,261 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:29,270 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:29,271 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:29,271 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:29,271 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:29,271 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:29,271 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:29,271 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:29,271 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:29,273 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:29,279 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:29,280 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:29,283 [282] [DEBUG] [app] Ending request: urn:request:63642f52-c9d9-413e-8b16-08f5aa4e0e86 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:63642f52-c9d9-413e-8b16-08f5aa4e0e86', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:29,283 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:29,284 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:29 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:29 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.025 1562 0.025)
gunicorn-web stdout | 2024-04-22 04:05:30,075 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:05:30,085 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:05:30,090 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:05:30,093 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:05:30,095 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:05:30,164 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:05:30,292 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:05:30,653 [281] [DEBUG] [app] Starting request: urn:request:fc0530cf-00a2-463a-b2b4-d0ae30bc96ba (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:05:30,653 [279] [DEBUG] [app] Starting request: urn:request:1f572d7f-7085-41c7-917a-478affcd3ace (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:05:30,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:05:30,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:05:30,656 [284] [DEBUG] [app] Starting request: urn:request:08235199-bf76-4ea9-b4bb-30de9be55313 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:05:30,656 [284] [DEBUG] [app] Ending request: urn:request:08235199-bf76-4ea9-b4bb-30de9be55313 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:08235199-bf76-4ea9-b4bb-30de9be55313', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:05:30,656 [291] [DEBUG] [app] Starting request: urn:request:a1d2f663-c9dc-4548-b8e5-a5c4bb1011a5 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:05:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:05:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:05:30,657 [291] [DEBUG] [app] Ending request: urn:request:a1d2f663-c9dc-4548-b8e5-a5c4bb1011a5 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:a1d2f663-c9dc-4548-b8e5-a5c4bb1011a5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:05:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:05:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:05:30,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:05:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:05:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:05:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:05:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:05:30,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:05:30,659 [282] [DEBUG] [app] Starting request: urn:request:e235d4d6-84de-4fa2-9b2f-862c25f5c6af (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:05:30,660 [282] [DEBUG] [app] Ending request: urn:request:e235d4d6-84de-4fa2-9b2f-862c25f5c6af (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e235d4d6-84de-4fa2-9b2f-862c25f5c6af', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:05:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:05:30,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:05:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:05:30,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:05:30,660 [278] [DEBUG] [app] Starting request: urn:request:ff3d3d84-ea85-4613-bb09-bf36dc46a8f0 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:05:30,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:05:30,661 [278] [DEBUG] [app] Ending request: urn:request:ff3d3d84-ea85-4613-bb09-bf36dc46a8f0 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:ff3d3d84-ea85-4613-bb09-bf36dc46a8f0', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:05:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.001)
gunicorn-web stdout | 2024-04-22 04:05:30,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:05:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:05:30,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:05:30,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:05:30,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:05:30,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:05:30,674 [281] [DEBUG] [app] Ending request: urn:request:fc0530cf-00a2-463a-b2b4-d0ae30bc96ba (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:fc0530cf-00a2-463a-b2b4-d0ae30bc96ba', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:05:30,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:30,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:05:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:05:30,675 [279] [DEBUG] [app] Ending request: urn:request:1f572d7f-7085-41c7-917a-478affcd3ace (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:1f572d7f-7085-41c7-917a-478affcd3ace', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:05:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:05:30,675 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:05:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:05:30,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:05:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:05:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:05:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:46.054492+00:00 (in 14.999468 seconds)
quotatotalworker stdout | 2024-04-22 04:05:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:05:46 UTC)" (scheduled at 2024-04-22 04:05:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:05:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:05:31,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:05:31,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:05:46 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:05:31,165 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 04:05:31,274 [281] [DEBUG] [app] Starting request: urn:request:de768fac-96de-443a-8823-71012ecdef40 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:31,274 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:31,274 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:31,274 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:31,283 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:31,283 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:31,283 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:31,283 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:31,283 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:31,283 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:31,283 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:31,283 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:31,286 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:31,292 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:31,293 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:31,295 [281] [DEBUG] [app] Ending request: urn:request:de768fac-96de-443a-8823-71012ecdef40 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:de768fac-96de-443a-8823-71012ecdef40', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:31,296 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:31,296 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:31 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:31 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.024 1562 0.023)
notificationworker stdout | 2024-04-22 04:05:32,719 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-web stdout | 2024-04-22 04:05:33,287 [282] [DEBUG] [app] Starting request: urn:request:1f37526d-16a5-4d93-b88e-5241bd41b3d9 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:33,287 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:33,287 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:33,288 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:33,298 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:33,298 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:33,298 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:33,298 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:33,298 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:33,298 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:33,298 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:33,298 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:33,300 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:33,307 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:33,308 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:33,311 [282] [DEBUG] [app] Ending request: urn:request:1f37526d-16a5-4d93-b88e-5241bd41b3d9 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:1f37526d-16a5-4d93-b88e-5241bd41b3d9', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:33,311 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:33,312 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:33 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:33 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.027 1562 0.027)
notificationworker stdout | 2024-04-22 04:05:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:05:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:43.759375+00:00 (in 9.999476 seconds)
notificationworker stdout | 2024-04-22 04:05:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:05:43 UTC)" (scheduled at 2024-04-22 04:05:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:05:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:05:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 5, 33, 760322), True, datetime.datetime(2024, 4, 22, 4, 5, 33, 760322), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:05:33,776 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:05:33,776 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:05:33,776 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:05:43 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:05:34,048 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:05:34,324 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:05:34,534 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:05:34,686 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:05:34,689 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:05:34,693 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
gunicorn-web stdout | 2024-04-22 04:05:35,289 [279] [DEBUG] [app] Starting request: urn:request:ef7d74bd-77f2-4ae2-aa77-30dc9a19706d (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:35,289 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:35,289 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:35,290 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:35,300 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:35,300 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:35,300 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:35,300 [279] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:35,301 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:35,301 [279] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:35,301 [279] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:35,301 [279] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:35,303 [279] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:35,310 [279] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:35,311 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:35,314 [279] [DEBUG] [app] Ending request: urn:request:ef7d74bd-77f2-4ae2-aa77-30dc9a19706d (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:ef7d74bd-77f2-4ae2-aa77-30dc9a19706d', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:35,315 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:35,315 [279] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:35 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:35 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.027 1562 0.027)
logrotateworker stdout | 2024-04-22 04:05:35,600 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:05:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:05:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:56.873109+00:00 (in 21.000738 seconds)
securityworker stdout | 2024-04-22 04:05:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:05 UTC)" (scheduled at 2024-04-22 04:05:35.871852+00:00)
securityworker stdout | 2024-04-22 04:05:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:05:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:05:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:05:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:05:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:05:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:05:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:05:36,788 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:05:36,863 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:05:36,996 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
gunicorn-web stdout | 2024-04-22 04:05:37,301 [282] [DEBUG] [app] Starting request: urn:request:6e6b25e0-22cf-4213-85c1-9a5a9d7216bb (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:37,301 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:37,301 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:37,302 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:37,311 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:37,311 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:37,311 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:37,311 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:37,312 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:37,312 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:37,312 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:37,312 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:37,314 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:37,321 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:37,321 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:37,324 [282] [DEBUG] [app] Ending request: urn:request:6e6b25e0-22cf-4213-85c1-9a5a9d7216bb (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:6e6b25e0-22cf-4213-85c1-9a5a9d7216bb', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:37,325 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:37,325 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:37 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:37 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.026 1562 0.025)
blobuploadcleanupworker stdout | 2024-04-22 04:05:38,006 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
gunicorn-web stdout | 2024-04-22 04:05:39,304 [281] [DEBUG] [app] Starting request: urn:request:f6fcf29d-b978-4d83-9790-91c3ceb9b85a (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:39,304 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:39,304 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:39,305 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:39,314 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:39,314 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:39,314 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:39,314 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:39,314 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:39,314 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:39,314 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:39,315 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:39,317 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:39,323 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:39,324 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:39,327 [281] [DEBUG] [app] Ending request: urn:request:f6fcf29d-b978-4d83-9790-91c3ceb9b85a (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:f6fcf29d-b978-4d83-9790-91c3ceb9b85a', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:39,327 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:39,328 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:39 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:39 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.026 1562 0.025)
securityworker stdout | 2024-04-22 04:05:39,335 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:05:39,378 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
exportactionlogsworker stdout | 2024-04-22 04:05:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:05:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:41.564959+00:00 (in 1.997470 seconds)
exportactionlogsworker stdout | 2024-04-22 04:05:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:39 UTC)" (scheduled at 2024-04-22 04:05:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:05:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:05:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:39 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:05:39,697 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:05:39,798 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:05:40,992 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:05:40,996 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:05:40,999 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:05:41,001 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:05:41,004 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:05:41,007 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:05:41,010 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:05:41,013 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:05:41,018 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
storagereplication stdout | 2024-04-22 04:05:41,080 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
autopruneworker stdout | 2024-04-22 04:05:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:05:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:11.264267+00:00 (in 29.999438 seconds)
autopruneworker stdout | 2024-04-22 04:05:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:11 UTC)" (scheduled at 2024-04-22 04:05:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:05:41,271 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758681271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:05:41,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:05:41,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:05:41,275 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:11 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:05:41,319 [281] [DEBUG] [app] Starting request: urn:request:04b38fe6-7c5c-4459-a7ef-3dfddc17bd89 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:41,319 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:41,319 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:41,320 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:41,328 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:41,328 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:41,328 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:41,329 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:41,329 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:41,329 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:41,329 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:41,329 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:41,331 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:41,337 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:41,338 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:41,341 [281] [DEBUG] [app] Ending request: urn:request:04b38fe6-7c5c-4459-a7ef-3dfddc17bd89 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:04b38fe6-7c5c-4459-a7ef-3dfddc17bd89', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:41,341 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:41 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.023 1562 0.023)
gunicorn-web stdout | 2024-04-22 04:05:41,342 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:41 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
exportactionlogsworker stdout | 2024-04-22 04:05:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:05:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:39.566970+00:00 (in 58.001490 seconds)
exportactionlogsworker stdout | 2024-04-22 04:05:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:41 UTC)" (scheduled at 2024-04-22 04:05:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:05:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:05:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 5, 41, 565725), True, datetime.datetime(2024, 4, 22, 4, 5, 41, 565725), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:05:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:05:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:05:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:05:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:05:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:22.058978+00:00 (in 39.001275 seconds)
namespacegcworker stdout | 2024-04-22 04:05:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:43 UTC)" (scheduled at 2024-04-22 04:05:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:05:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:05:43,059 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 5, 43, 58191), True, datetime.datetime(2024, 4, 22, 4, 5, 43, 58191), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:05:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:05:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:05:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:06:43 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:05:43,325 [281] [DEBUG] [app] Starting request: urn:request:9a3a633b-5b59-4809-bc4a-a915651a1e8f (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:43,325 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:43,325 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:43,326 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:43,334 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:43,334 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:43,335 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:43,335 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:43,335 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:43,335 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:43,335 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:43,335 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:43,337 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:43,343 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:43,344 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:43,347 [281] [DEBUG] [app] Ending request: urn:request:9a3a633b-5b59-4809-bc4a-a915651a1e8f (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:9a3a633b-5b59-4809-bc4a-a915651a1e8f', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:43,347 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:43,348 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:43 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:43 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.025 1562 0.025)
notificationworker stdout | 2024-04-22 04:05:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:05:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:05:53.759375+00:00 (in 9.999457 seconds)
notificationworker stdout | 2024-04-22 04:05:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:05:53 UTC)" (scheduled at 2024-04-22 04:05:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:05:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:05:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 5, 43, 760235), True, datetime.datetime(2024, 4, 22, 4, 5, 43, 760235), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:05:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:05:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:05:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:05:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:05:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:05:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:14.952062+00:00 (in 29.999490 seconds)
gcworker stdout | 2024-04-22 04:05:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:14 UTC)" (scheduled at 2024-04-22 04:05:44.952062+00:00)
gcworker stdout | 2024-04-22 04:05:44,953 [68] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."removed_tag_expiration_s" FROM "user" AS "t1" LIMIT %s', [100])
gcworker stdout | 2024-04-22 04:05:44,963 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549144962, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:05:44,967 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:05:44,967 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:05:44,967 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:05:45,335 [282] [DEBUG] [app] Starting request: urn:request:489cfe9f-6b65-4551-9110-c00864736143 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:45,335 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:45,335 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:45,336 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:45,345 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:45,345 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:45,345 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:45,345 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:45,346 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:45,346 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:45,346 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:45,346 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:45,348 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:45,354 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:45,355 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:45,357 [282] [DEBUG] [app] Ending request: urn:request:489cfe9f-6b65-4551-9110-c00864736143 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:489cfe9f-6b65-4551-9110-c00864736143', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:45,358 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:45,358 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:45 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:45 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.024 1562 0.024)
gunicorn-web stdout | 2024-04-22 04:05:45,652 [282] [DEBUG] [app] Starting request: urn:request:5a04a19e-49fd-4e4a-82fa-b6b32e40f5af (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:05:45,653 [278] [DEBUG] [app] Starting request: urn:request:7bb831e0-24c3-46f3-a3dd-114613a8349b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:05:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:05:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:05:45,656 [284] [DEBUG] [app] Starting request: urn:request:3cba469c-ec88-49d3-a45a-312728a6c6a8 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:05:45,656 [291] [DEBUG] [app] Starting request: urn:request:197b9b96-05a5-4a18-ba4b-0edba4601e83 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:05:45,656 [284] [DEBUG] [app] Ending request: urn:request:3cba469c-ec88-49d3-a45a-312728a6c6a8 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:3cba469c-ec88-49d3-a45a-312728a6c6a8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:05:45,656 [291] [DEBUG] [app] Ending request: urn:request:197b9b96-05a5-4a18-ba4b-0edba4601e83 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:197b9b96-05a5-4a18-ba4b-0edba4601e83', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:05:45,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:05:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:05:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:05:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:05:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:05:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:05:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:05:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-web stdout | 2024-04-22 04:05:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:05:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:05:45,659 [282] [DEBUG] [app] Starting request: urn:request:9c01edd9-8433-445b-8195-347f63de2d34 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:05:45,659 [282] [DEBUG] [app] Ending request: urn:request:9c01edd9-8433-445b-8195-347f63de2d34 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9c01edd9-8433-445b-8195-347f63de2d34', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:05:45,659 [279] [DEBUG] [app] Starting request: urn:request:104725a9-aab8-4359-bb5c-bd8db8d5fe3f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:05:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:05:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:05:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:05:45,660 [279] [DEBUG] [app] Ending request: urn:request:104725a9-aab8-4359-bb5c-bd8db8d5fe3f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:104725a9-aab8-4359-bb5c-bd8db8d5fe3f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:05:45,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:05:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:05:45,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:05:45,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:05:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:05:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:05:45,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:05:45,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:05:45,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:05:45,674 [282] [DEBUG] [app] Ending request: urn:request:5a04a19e-49fd-4e4a-82fa-b6b32e40f5af (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:5a04a19e-49fd-4e4a-82fa-b6b32e40f5af', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:05:45,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:45,674 [278] [DEBUG] [app] Ending request: urn:request:7bb831e0-24c3-46f3-a3dd-114613a8349b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:7bb831e0-24c3-46f3-a3dd-114613a8349b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:05:45,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:45,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:05:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:05:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.023)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:05:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:05:45,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:05:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:05:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:05:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:01.054492+00:00 (in 14.999470 seconds)
quotatotalworker stdout | 2024-04-22 04:05:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:06:01 UTC)" (scheduled at 2024-04-22 04:05:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:05:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:05:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:05:46,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:06:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:05:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:05:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:17.052354+00:00 (in 29.999434 seconds)
buildlogsarchiver stdout | 2024-04-22 04:05:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:17 UTC)" (scheduled at 2024-04-22 04:05:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:05:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 5, 47, 53302), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:05:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:05:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:05:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:17 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:05:47,348 [282] [DEBUG] [app] Starting request: urn:request:c8eac079-bf62-411d-9478-879741f05408 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:47,348 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:47,348 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:47,349 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:47,358 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:47,358 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:47,358 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:47,358 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:47,358 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:47,358 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:47,358 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:47,358 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:47,360 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:47,367 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:47,368 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:47,371 [282] [DEBUG] [app] Ending request: urn:request:c8eac079-bf62-411d-9478-879741f05408 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:c8eac079-bf62-411d-9478-879741f05408', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:47,371 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:47,371 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:47 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:47 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.024 1562 0.024)
gunicorn-web stdout | 2024-04-22 04:05:49,356 [282] [DEBUG] [app] Starting request: urn:request:8f193ac4-a424-4917-8721-fbba291387b2 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:49,356 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:49,357 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:49,357 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:49,366 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:49,367 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:49,367 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:49,367 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:49,367 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:49,367 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:49,367 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:49,367 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:49,369 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:49,376 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:49,377 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:49,379 [282] [DEBUG] [app] Ending request: urn:request:8f193ac4-a424-4917-8721-fbba291387b2 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:8f193ac4-a424-4917-8721-fbba291387b2', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:49,380 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:49,380 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:49 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:49 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 102 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.025 1562 0.025)
gunicorn-web stdout | 2024-04-22 04:05:49,800 [278] [DEBUG] [app] Starting request: urn:request:86b9d51e-722a-4b03-befd-8f0239237e66 (/authrepoemail) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:49,801 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."code" = %s) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['X02X45ST1YHE8C4H', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:49,811 [278] [DEBUG] [peewee] ('UPDATE "repositoryauthorizedemail" SET "repository_id" = %s, "email" = %s, "code" = %s, "confirmed" = %s WHERE ("repositoryauthorizedemail"."id" = %s)', [1, 'hu_weihua@163.com', 'X02X45ST1YHE8C4H', True, 1])
gunicorn-web stdout | 2024-04-22 04:05:49,818 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:49,818 [278] [DEBUG] [app] Ending request: urn:request:86b9d51e-722a-4b03-befd-8f0239237e66 (/authrepoemail) {'endpoint': 'web.confirm_repo_email', 'request_id': 'urn:request:86b9d51e-722a-4b03-befd-8f0239237e66', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/authrepoemail?code=X02X45ST1YHE8C4H', 'path': '/authrepoemail', 'parameters': {'code': 'X02X45ST1YHE8C4H'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:49,818 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:49,819 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:49 +0000] "GET /authrepoemail?code=X02X45ST1YHE8C4H HTTP/1.0" 200 790 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:49 +0000] "GET /authrepoemail?code=X02X45ST1YHE8C4H HTTP/1.1" 200 484 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.020 1371 0.020)
expiredappspecifictokenworker stdout | 2024-04-22 04:05:50,113 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
gunicorn-web stdout | 2024-04-22 04:05:50,523 [278] [DEBUG] [app] Starting request: urn:request:ecc5df99-7d9b-4c12-a531-7aa5f913d648 (/favicon.ico) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:50,523 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:50,523 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:50,523 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:50,542 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:50,542 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:50,542 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:50,543 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['favicon.ico', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:50,548 [278] [DEBUG] [app] Ending request: urn:request:ecc5df99-7d9b-4c12-a531-7aa5f913d648 (/favicon.ico) {'endpoint': 'web.redirect_to_namespace', 'request_id': 'urn:request:ecc5df99-7d9b-4c12-a531-7aa5f913d648', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/favicon.ico', 'path': '/favicon.ico', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:50,548 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:50,549 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:50 +0000] "GET /favicon.ico HTTP/1.0" 404 93294 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/authrepoemail?code=X02X45ST1YHE8C4H" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:50 +0000] "GET /favicon.ico HTTP/1.1" 404 14284 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/authrepoemail?code=X02X45ST1YHE8C4H" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.028 1372 0.028)
gunicorn-web stdout | 2024-04-22 04:05:51,359 [278] [DEBUG] [app] Starting request: urn:request:c6b212b5-f6b7-4720-97ef-52ee242393f6 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:51,359 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:51,359 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:51,360 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:51,370 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:51,370 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:51,370 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:51,370 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:51,370 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:51,370 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:51,370 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:51,370 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:51,372 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:51,379 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:51,380 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:51,383 [278] [DEBUG] [app] Ending request: urn:request:c6b212b5-f6b7-4720-97ef-52ee242393f6 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:c6b212b5-f6b7-4720-97ef-52ee242393f6', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:51,383 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:51 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 101 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.025 1562 0.025)
gunicorn-web stdout | 2024-04-22 04:05:51,383 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:51 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 101 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
securityscanningnotificationworker stdout | 2024-04-22 04:05:51,569 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
gunicorn-web stdout | 2024-04-22 04:05:52,367 [278] [DEBUG] [app] Starting request: urn:request:984fc048-ad27-4f74-8b58-36a32b3f1843 (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:52,367 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:52,367 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:52,368 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:52,377 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:52,377 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:52,377 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:52,377 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:52,377 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:52,377 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:52,377 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:52,377 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:52,380 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:52,386 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:52,387 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:52,391 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:52,394 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:52,396 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['repo_push', 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:52,399 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['email', 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:52,401 [278] [DEBUG] [peewee] ('INSERT INTO "repositorynotification" ("uuid", "repository_id", "event_id", "method_id", "title", "config_json", "event_config_json", "number_of_failures") VALUES (%s, %s, %s, %s, %s, %s, %s, %s) RETURNING "repositorynotification"."id"', ['98da68a7-e4d8-463f-b0a3-50d4807bf84c', 1, 5, 1, 'push mail', '{"email": "hu_weihua@163.com"}', '{}', 0])
gunicorn-web stdout | 2024-04-22 04:05:52,406 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:52,408 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:52,410 [278] [DEBUG] [peewee] ('INSERT INTO "logentry3" ("kind_id", "account_id", "performer_id", "repository_id", "datetime", "ip", "metadata_json") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "logentry3"."id"', [6, 2, 1, 1, datetime.datetime(2024, 4, 22, 4, 5, 52, 408295), '10.128.2.8', '{"repo": "pushno", "namespace": "build_test", "notification_id": "98da68a7-e4d8-463f-b0a3-50d4807bf84c", "event": "repo_push", "method": "email"}'])
gunicorn-web stdout | 2024-04-22 04:05:52,414 [278] [DEBUG] [app] Ending request: urn:request:984fc048-ad27-4f74-8b58-36a32b3f1843 (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:984fc048-ad27-4f74-8b58-36a32b3f1843', 'remote_addr': '10.128.2.8', 'http_method': 'POST', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': {'event': 'repo_push', 'method': 'email', 'config': {'email': 'hu_weihua@163.com'}, 'eventConfig': {}, 'title': 'push mail'}, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:52,415 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:52,415 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:52 +0000] "POST /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 201 199 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:52 +0000] "POST /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 201 199 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.051 1825 0.049)
gunicorn-web stdout | 2024-04-22 04:05:52,742 [278] [DEBUG] [app] Starting request: urn:request:312168b5-2bf3-45c1-96e6-5e4496842188 (/api/v1/repository/build_test/pushno/tag/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:52,742 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:52,742 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:52,743 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:52,751 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:52,751 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:52,751 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:52,752 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:52,752 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:52,752 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:52,752 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:52,752 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:52,754 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:52,760 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:52,761 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:52,764 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:52,767 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:52,769 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:52,771 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."repository_id", "t1"."manifest_id", "t1"."lifetime_start_ms", "t1"."lifetime_end_ms", "t1"."hidden", "t1"."reversion", "t1"."tag_kind_id", "t1"."linked_tag_id", "t2"."id", "t2"."digest", "t2"."media_type_id", "t2"."layers_compressed_size", "t2"."config_media_type" FROM "tag" AS "t1" INNER JOIN "manifest" AS "t2" ON ("t1"."manifest_id" = "t2"."id") WHERE ((("t1"."repository_id" = %s) AND (("t1"."lifetime_end_ms" IS %s) OR ("t1"."lifetime_end_ms" > %s))) AND ("t1"."hidden" = %s)) ORDER BY "t1"."lifetime_start_ms" DESC, "t1"."name" LIMIT %s OFFSET %s', [1, None, 1713758752771, False, 101, 0])
gunicorn-web stdout | 2024-04-22 04:05:52,774 [278] [DEBUG] [app] Ending request: urn:request:312168b5-2bf3-45c1-96e6-5e4496842188 (/api/v1/repository/build_test/pushno/tag/) {'endpoint': 'api.listrepositorytags', 'request_id': 'urn:request:312168b5-2bf3-45c1-96e6-5e4496842188', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true', 'path': '/api/v1/repository/build_test/pushno/tag/', 'parameters': {'limit': '100', 'page': '1', 'onlyActiveTags': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:52,775 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:52,775 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:52 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:52 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.1" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.034 1563 0.034)
gunicorn-web stdout | 2024-04-22 04:05:53,439 [278] [DEBUG] [app] Starting request: urn:request:c9c01030-07c2-4a09-8bb4-889af1a83322 (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:53,440 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:53,440 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:53,440 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:53,449 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:53,449 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:53,449 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:53,449 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:53,450 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:53,450 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:53,450 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:53,450 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:53,452 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:53,458 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:53,458 [278] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:53,459 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:53,461 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:53,464 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:05:53,466 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:53,466 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:53,466 [278] [DEBUG] [app] Ending request: urn:request:c9c01030-07c2-4a09-8bb4-889af1a83322 (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:c9c01030-07c2-4a09-8bb4-889af1a83322', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeStats=true&includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeStats': 'true', 'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:53,467 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:53,467 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:53 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.0" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:53 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.1" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.029 1557 0.029)
notificationworker stdout | 2024-04-22 04:05:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:05:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:03.759375+00:00 (in 9.999474 seconds)
notificationworker stdout | 2024-04-22 04:05:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:06:03 UTC)" (scheduled at 2024-04-22 04:05:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:05:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:05:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 5, 53, 760334), True, datetime.datetime(2024, 4, 22, 4, 5, 53, 760334), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:05:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:05:53,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:05:53,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:06:03 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:05:53,882 [278] [DEBUG] [app] Starting request: urn:request:45cc5f0f-4cdb-429e-a52c-c50d3d2ea8fb (/api/v1/repository/build_test/pushno/permissions/team/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:53,882 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:53,882 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:53,882 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:53,885 [281] [DEBUG] [app] Starting request: urn:request:c6de9348-9171-4942-b2ed-691e6ed222ae (/api/v1/repository/build_test/pushno/permissions/user/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:53,885 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:53,885 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:53,886 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:53,891 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:53,891 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:53,891 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:53,891 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:53,891 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:53,891 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:53,892 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:53,892 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:53,894 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:53,894 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:53,894 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:53,894 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:53,895 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:53,895 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:53,895 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:53,895 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:53,895 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:53,897 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:53,900 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:53,900 [278] [DEBUG] [peewee] ('SELECT "t1"."name", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "team" AS "t1" ON ("t3"."team_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:05:53,903 [278] [DEBUG] [app] Ending request: urn:request:45cc5f0f-4cdb-429e-a52c-c50d3d2ea8fb (/api/v1/repository/build_test/pushno/permissions/team/) {'endpoint': 'api.repositoryteampermissionlist', 'request_id': 'urn:request:45cc5f0f-4cdb-429e-a52c-c50d3d2ea8fb', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/team/', 'path': '/api/v1/repository/build_test/pushno/permissions/team/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:53,903 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:53,903 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:53,904 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:53 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.0" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:53 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.1" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.024 1539 0.024)
gunicorn-web stdout | 2024-04-22 04:05:53,904 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:53,907 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed", "t2"."id", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "user" AS "t1" ON ("t3"."user_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:05:53,910 [281] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."username" FROM "user" AS "t1" INNER JOIN "teammember" AS "t2" ON ("t2"."user_id" = "t1"."id") INNER JOIN "team" AS "t3" ON ("t2"."team_id" = "t3"."id") WHERE ((("t3"."organization_id" = %s) AND ("t1"."robot" = %s)) AND ("t1"."id" IN (%s)))', [2, False, 1])
gunicorn-web stdout | 2024-04-22 04:05:53,912 [281] [DEBUG] [app] Ending request: urn:request:c6de9348-9171-4942-b2ed-691e6ed222ae (/api/v1/repository/build_test/pushno/permissions/user/) {'endpoint': 'api.repositoryuserpermissionlist', 'request_id': 'urn:request:c6de9348-9171-4942-b2ed-691e6ed222ae', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/user/', 'path': '/api/v1/repository/build_test/pushno/permissions/user/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:53,913 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:53,913 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:53 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.0" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:53 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.1" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.029 1539 0.029)
gunicorn-web stdout | 2024-04-22 04:05:54,612 [278] [DEBUG] [app] Starting request: urn:request:d4d56c28-2fa6-4f1b-af18-90e988e5788c (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:05:54,613 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:54,613 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:54,613 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:54,623 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:54,623 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:54,623 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:54,623 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:54,623 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:54,623 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:54,623 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:54,623 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:54,625 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:54,632 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:54,633 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:54,636 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t3"."username" = %s) AND ("t2"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:05:54,639 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:54,641 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [4, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:54,643 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:54,645 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:54,648 [278] [DEBUG] [app] Ending request: urn:request:d4d56c28-2fa6-4f1b-af18-90e988e5788c (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:d4d56c28-2fa6-4f1b-af18-90e988e5788c', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:54,648 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:05:54,649 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:05:54 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 200 632 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:05:54 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 200 632 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.037 1535 0.037)
gunicorn-web stdout | 2024-04-22 04:05:54,662 [278] [DEBUG] [app] Starting request: urn:request:ab7aa332-0991-489d-9890-ef5d7af43f8f (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:05:54,663 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:54,663 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:54,664 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:54,673 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:05:54,673 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:05:54,673 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:54,673 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:05:54,673 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:05:54,673 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:54,673 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:54,673 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:54,676 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:05:54,682 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:05:54,683 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:05:54,687 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:05:54,691 [278] [DEBUG] [app] Ending request: urn:request:ab7aa332-0991-489d-9890-ef5d7af43f8f (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:ab7aa332-0991-489d-9890-ef5d7af43f8f', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:05:54,692 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:05:54 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.031 1536 0.031)
gunicorn-web stdout | 2024-04-22 04:05:54,692 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:05:54 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
builder stdout | 2024-04-22 04:05:55,226 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:05:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:05:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:05.871852+00:00 (in 8.998231 seconds)
securityworker stdout | 2024-04-22 04:05:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:26 UTC)" (scheduled at 2024-04-22 04:05:56.873109+00:00)
securityworker stdout | 2024-04-22 04:05:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:05:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:05:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:05:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:05:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:05:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:05:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:05:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:05:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:05:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:05:56,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:05:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:05:56,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 0, 56, 880914), 1, 2])
securityworker stdout | 2024-04-22 04:05:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:05:56,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:05:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 0, 56, 880914), 1, 2])
securityworker stdout | 2024-04-22 04:05:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:05:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:05:56,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:05:56,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:05:56,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:05:56,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:05:56,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:05:56,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:05:56,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:05:56,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:05:56,963 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:05:58,193 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:05:58,313 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:06:00,086 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:06:00,096 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:06:00,099 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:06:00,102 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:06:00,106 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:06:00,199 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:06:00,314 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:06:00,653 [282] [DEBUG] [app] Starting request: urn:request:02a9f02a-27b6-48af-9334-0914dafd742d (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:06:00,653 [278] [DEBUG] [app] Starting request: urn:request:b82f1453-3dc4-4d75-a501-d82112731269 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:06:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:06:00,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:06:00,656 [284] [DEBUG] [app] Starting request: urn:request:31606dc9-6ce6-4e8a-8c7f-d56c29a9a4c1 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:06:00,656 [288] [DEBUG] [app] Starting request: urn:request:3e04dac2-9f6c-45ba-8cb6-9286f97389b9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:06:00,656 [288] [DEBUG] [app] Ending request: urn:request:3e04dac2-9f6c-45ba-8cb6-9286f97389b9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:3e04dac2-9f6c-45ba-8cb6-9286f97389b9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:06:00,656 [284] [DEBUG] [app] Ending request: urn:request:31606dc9-6ce6-4e8a-8c7f-d56c29a9a4c1 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:31606dc9-6ce6-4e8a-8c7f-d56c29a9a4c1', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:06:00,657 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:06:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:06:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:06:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:06:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:06:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:06:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:06:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:06:00,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:06:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:06:00,659 [278] [DEBUG] [app] Starting request: urn:request:12eae20c-e251-450f-a1d5-7de0d49f277e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:06:00,659 [278] [DEBUG] [app] Ending request: urn:request:12eae20c-e251-450f-a1d5-7de0d49f277e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:12eae20c-e251-450f-a1d5-7de0d49f277e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:06:00,659 [281] [DEBUG] [app] Starting request: urn:request:9309bbc9-6a42-4949-af00-fdbb6c194f3b (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:06:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:06:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:06:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:06:00,660 [281] [DEBUG] [app] Ending request: urn:request:9309bbc9-6a42-4949-af00-fdbb6c194f3b (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9309bbc9-6a42-4949-af00-fdbb6c194f3b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:06:00,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:06:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:06:00,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:06:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:06:00,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:06:00,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:06:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:06:00,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:06:00,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:06:00,674 [278] [DEBUG] [app] Ending request: urn:request:b82f1453-3dc4-4d75-a501-d82112731269 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b82f1453-3dc4-4d75-a501-d82112731269', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:06:00,675 [282] [DEBUG] [app] Ending request: urn:request:02a9f02a-27b6-48af-9334-0914dafd742d (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:02a9f02a-27b6-48af-9334-0914dafd742d', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:06:00,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:06:00,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:06:00,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:06:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:06:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:06:00,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:06:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:06:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotatotalworker stdout | 2024-04-22 04:06:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:06:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:16.054492+00:00 (in 14.999486 seconds)
quotatotalworker stdout | 2024-04-22 04:06:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:06:16 UTC)" (scheduled at 2024-04-22 04:06:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:06:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:06:01,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:06:01,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:06:16 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:06:01,185 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:06:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:06:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:16.552337+00:00 (in 13.995629 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:06:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:02 UTC)" (scheduled at 2024-04-22 04:06:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:06:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:06:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:06:02,755 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:06:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:06:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:13.759375+00:00 (in 9.999497 seconds)
notificationworker stdout | 2024-04-22 04:06:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:06:13 UTC)" (scheduled at 2024-04-22 04:06:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:06:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:06:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 6, 3, 760176), True, datetime.datetime(2024, 4, 22, 4, 6, 3, 760176), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:06:03,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:06:03,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:06:03,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:06:13 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:06:04,086 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:06:04,361 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:06:04,551 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:06:04,695 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:06:04,698 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:06:04,701 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:06:05,636 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:06:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:06:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:26.873109+00:00 (in 21.000728 seconds)
securityworker stdout | 2024-04-22 04:06:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:35 UTC)" (scheduled at 2024-04-22 04:06:05.871852+00:00)
securityworker stdout | 2024-04-22 04:06:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:06:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:06:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:06:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:06:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:06:05,886 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:06:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:35 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:06:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:06:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:13.555667+00:00 (in 7.002702 seconds)
repositorygcworker stdout | 2024-04-22 04:06:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:06 UTC)" (scheduled at 2024-04-22 04:06:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:06:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:06:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 6, 6, 553217), True, datetime.datetime(2024, 4, 22, 4, 6, 6, 553217), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:06:06,568 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:06:06,568 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:06:06,568 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:06 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:06:06,816 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:06:06,899 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:06:07,032 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
gunicorn-web stdout | 2024-04-22 04:06:07,577 [282] [DEBUG] [app] Starting request: urn:request:b49487c8-3317-495f-843e-def620fc0388 (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:06:07,577 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:06:07,577 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:06:07,578 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:06:07,587 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:06:07,587 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:06:07,587 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:06:07,587 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:06:07,587 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:06:07,587 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:06:07,587 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:06:07,587 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:06:07,589 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:06:07,596 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:06:07,596 [282] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:06:07,597 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:06:07,599 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:06:07,602 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:06:07,604 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:06:07,604 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:06:07,605 [282] [DEBUG] [app] Ending request: urn:request:b49487c8-3317-495f-843e-def620fc0388 (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:b49487c8-3317-495f-843e-def620fc0388', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:06:07,605 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:06:07,605 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:06:07 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.0" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:06:07 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.1" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1546 0.029)
blobuploadcleanupworker stdout | 2024-04-22 04:06:08,043 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:06:09,346 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:06:09,391 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:06:09,734 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:06:09,816 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:06:11,003 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:06:11,006 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:06:11,009 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:06:11,013 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:06:11,015 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:06:11,018 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:06:11,021 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:06:11,025 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:06:11,028 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
storagereplication stdout | 2024-04-22 04:06:11,117 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
autopruneworker stdout | 2024-04-22 04:06:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:06:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:41.264267+00:00 (in 29.999461 seconds)
autopruneworker stdout | 2024-04-22 04:06:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:41 UTC)" (scheduled at 2024-04-22 04:06:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:06:11,271 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758711271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:06:11,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:06:11,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:06:11,275 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:06:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:06:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:51.555445+00:00 (in 37.999282 seconds)
repositorygcworker stdout | 2024-04-22 04:06:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:13 UTC)" (scheduled at 2024-04-22 04:06:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:06:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:06:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:06:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:06:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:19.762424+00:00 (in 6.002592 seconds)
notificationworker stdout | 2024-04-22 04:06:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:06:23 UTC)" (scheduled at 2024-04-22 04:06:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:06:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:06:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 6, 13, 760267), True, datetime.datetime(2024, 4, 22, 4, 6, 13, 760267), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:06:13,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:06:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:06:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:06:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:06:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:06:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:44.952062+00:00 (in 29.999547 seconds)
gcworker stdout | 2024-04-22 04:06:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:44 UTC)" (scheduled at 2024-04-22 04:06:14.952062+00:00)
gcworker stdout | 2024-04-22 04:06:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549174952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:06:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:06:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:06:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:06:15,653 [279] [DEBUG] [app] Starting request: urn:request:36678427-ba78-4ae8-a833-deb70e9ff3bc (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:06:15,653 [278] [DEBUG] [app] Starting request: urn:request:ea9e6ae4-a425-42a8-9748-bcf40803b051 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:06:15,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:06:15,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:06:15,656 [284] [DEBUG] [app] Starting request: urn:request:b59920b9-bb17-47a5-9712-ff5f0535e95d (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:06:15,656 [288] [DEBUG] [app] Starting request: urn:request:47cb7599-79e9-4602-a534-e6e68b152f23 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:06:15,657 [288] [DEBUG] [app] Ending request: urn:request:47cb7599-79e9-4602-a534-e6e68b152f23 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:47cb7599-79e9-4602-a534-e6e68b152f23', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:06:15,657 [284] [DEBUG] [app] Ending request: urn:request:b59920b9-bb17-47a5-9712-ff5f0535e95d (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b59920b9-bb17-47a5-9712-ff5f0535e95d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:06:15,657 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:06:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:06:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:06:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:06:15,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:06:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:06:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:06:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
gunicorn-web stdout | 2024-04-22 04:06:15,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:06:15,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:06:15,660 [282] [DEBUG] [app] Starting request: urn:request:3495c1eb-9bed-46b8-b564-82281d91dae0 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:06:15,660 [281] [DEBUG] [app] Starting request: urn:request:490f0a0e-84c8-4143-97fb-86b51ca45bda (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:06:15,660 [282] [DEBUG] [app] Ending request: urn:request:3495c1eb-9bed-46b8-b564-82281d91dae0 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3495c1eb-9bed-46b8-b564-82281d91dae0', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:06:15,660 [281] [DEBUG] [app] Ending request: urn:request:490f0a0e-84c8-4143-97fb-86b51ca45bda (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:490f0a0e-84c8-4143-97fb-86b51ca45bda', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:06:15,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:06:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:06:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 04:06:15,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:06:15,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:06:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:06:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:06:15,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:06:15,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:06:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:06:15,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:06:15,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:06:15,674 [278] [DEBUG] [app] Ending request: urn:request:ea9e6ae4-a425-42a8-9748-bcf40803b051 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:ea9e6ae4-a425-42a8-9748-bcf40803b051', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:06:15,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:06:15,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:06:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:06:15,675 [279] [DEBUG] [app] Ending request: urn:request:36678427-ba78-4ae8-a833-deb70e9ff3bc (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:36678427-ba78-4ae8-a833-deb70e9ff3bc', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:06:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:06:15,675 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:06:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:06:15,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:06:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:06:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:06:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:31.054492+00:00 (in 14.999462 seconds)
quotatotalworker stdout | 2024-04-22 04:06:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:06:31 UTC)" (scheduled at 2024-04-22 04:06:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:06:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:06:16,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:06:16,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:06:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:06:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:06:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:02.556208+00:00 (in 46.003252 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:06:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:16 UTC)" (scheduled at 2024-04-22 04:06:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:06:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:06:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 6, 16, 553387), True, datetime.datetime(2024, 4, 22, 4, 6, 16, 553387), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:06:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:06:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:06:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:06:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:06:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:47.052354+00:00 (in 29.999435 seconds)
buildlogsarchiver stdout | 2024-04-22 04:06:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:47 UTC)" (scheduled at 2024-04-22 04:06:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:06:17,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 6, 17, 53298), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:06:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:06:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:06:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:06:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:06:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:23.759375+00:00 (in 3.996447 seconds)
notificationworker stdout | 2024-04-22 04:06:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:19 UTC)" (scheduled at 2024-04-22 04:06:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:06:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:06:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:06:20,150 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:06:21,579 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 04:06:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:06:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:43.057186+00:00 (in 20.997613 seconds)
namespacegcworker stdout | 2024-04-22 04:06:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:22 UTC)" (scheduled at 2024-04-22 04:06:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:06:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:06:22,060 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:06:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:06:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:33.759375+00:00 (in 9.999523 seconds)
notificationworker stdout | 2024-04-22 04:06:23,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:06:33 UTC)" (scheduled at 2024-04-22 04:06:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:06:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:06:23,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 6, 23, 760101), True, datetime.datetime(2024, 4, 22, 4, 6, 23, 760101), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:06:23,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:06:23,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:06:23,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:06:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:06:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:06:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:24.361582+00:00 (in 59.999454 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:06:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:24 UTC)" (scheduled at 2024-04-22 04:06:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:06:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:06:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:06:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:06:25,248 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:06:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:06:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:35.871852+00:00 (in 8.998247 seconds)
securityworker stdout | 2024-04-22 04:06:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:56 UTC)" (scheduled at 2024-04-22 04:06:26.873109+00:00)
securityworker stdout | 2024-04-22 04:06:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:06:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:06:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:06:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:06:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:06:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:06:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:06:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:06:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:06:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:06:26,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:06:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:06:26,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 1, 26, 881377), 1, 2])
securityworker stdout | 2024-04-22 04:06:26,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:06:26,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:06:26,898 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 1, 26, 881377), 1, 2])
securityworker stdout | 2024-04-22 04:06:26,900 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:06:26,900 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:06:26,900 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:06:26,900 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:06:26,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:06:26,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:06:26,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:06:26,901 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:06:26,901 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:06:26,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:06:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:06:26,977 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:06:28,210 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:06:28,331 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:06:30,099 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:06:30,108 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:06:30,112 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:06:30,115 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:06:30,118 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:06:30,236 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:06:30,338 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:06:30,653 [281] [DEBUG] [app] Starting request: urn:request:e3036e78-6e05-4165-b43d-2cb35d9890ea (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:06:30,653 [282] [DEBUG] [app] Starting request: urn:request:4fe1dc7f-e883-4e75-8df6-67c90dcc4c81 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:06:30,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:06:30,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:06:30,656 [292] [DEBUG] [app] Starting request: urn:request:19a912a4-7268-442a-b884-8c7457de9bc3 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:06:30,656 [292] [DEBUG] [app] Ending request: urn:request:19a912a4-7268-442a-b884-8c7457de9bc3 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:19a912a4-7268-442a-b884-8c7457de9bc3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:06:30,656 [291] [DEBUG] [app] Starting request: urn:request:7ea9ddce-8093-4971-a456-507352bc049e (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:06:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:06:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:06:30,657 [291] [DEBUG] [app] Ending request: urn:request:7ea9ddce-8093-4971-a456-507352bc049e (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7ea9ddce-8093-4971-a456-507352bc049e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:06:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:06:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:06:30,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:06:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:06:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:06:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:06:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:06:30,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:06:30,659 [278] [DEBUG] [app] Starting request: urn:request:2e0c0482-f5a3-42c1-b547-1ef9d8ec2b47 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:06:30,660 [278] [DEBUG] [app] Ending request: urn:request:2e0c0482-f5a3-42c1-b547-1ef9d8ec2b47 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:2e0c0482-f5a3-42c1-b547-1ef9d8ec2b47', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:06:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:06:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:06:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:06:30,660 [281] [DEBUG] [app] Starting request: urn:request:e7172bb1-35be-4165-b22a-39e47f46219d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:06:30,661 [281] [DEBUG] [app] Ending request: urn:request:e7172bb1-35be-4165-b22a-39e47f46219d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e7172bb1-35be-4165-b22a-39e47f46219d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:06:30,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:06:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:06:30,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:06:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:06:30,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:06:30,662 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:06:30,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:06:30,668 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:06:30,670 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:06:30,675 [281] [DEBUG] [app] Ending request: urn:request:e3036e78-6e05-4165-b43d-2cb35d9890ea (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e3036e78-6e05-4165-b43d-2cb35d9890ea', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:06:30,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:06:30,676 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:06:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:06:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 04:06:30,678 [282] [DEBUG] [app] Ending request: urn:request:4fe1dc7f-e883-4e75-8df6-67c90dcc4c81 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:4fe1dc7f-e883-4e75-8df6-67c90dcc4c81', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:06:30,678 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:06:30,678 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:06:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:06:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
quotatotalworker stdout | 2024-04-22 04:06:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:06:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:46.054492+00:00 (in 14.999457 seconds)
quotatotalworker stdout | 2024-04-22 04:06:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:06:46 UTC)" (scheduled at 2024-04-22 04:06:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:06:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:06:31,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:06:31,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:06:46 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:06:31,223 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:06:32,790 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:06:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:06:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:43.759375+00:00 (in 9.999463 seconds)
notificationworker stdout | 2024-04-22 04:06:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:06:43 UTC)" (scheduled at 2024-04-22 04:06:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:06:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:06:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 6, 33, 760231), True, datetime.datetime(2024, 4, 22, 4, 6, 33, 760231), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:06:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:06:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:06:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:06:43 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:06:34,114 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:06:34,383 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:06:34,587 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:06:34,703 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:06:34,706 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:06:34,710 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:06:35,667 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:06:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:06:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:56.873109+00:00 (in 21.000777 seconds)
securityworker stdout | 2024-04-22 04:06:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:05 UTC)" (scheduled at 2024-04-22 04:06:35.871852+00:00)
securityworker stdout | 2024-04-22 04:06:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:06:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:06:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:06:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:06:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:06:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:06:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:06:36,849 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:06:36,913 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:06:37,039 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:06:38,079 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:06:39,379 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:06:39,418 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
exportactionlogsworker stdout | 2024-04-22 04:06:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:06:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:41.564959+00:00 (in 1.997447 seconds)
exportactionlogsworker stdout | 2024-04-22 04:06:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:39 UTC)" (scheduled at 2024-04-22 04:06:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:06:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:06:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:39 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:06:39,757 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:06:39,852 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:06:41,013 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:06:41,015 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:06:41,020 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:06:41,022 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:06:41,026 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:06:41,029 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:06:41,033 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:06:41,036 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:06:41,039 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
storagereplication stdout | 2024-04-22 04:06:41,136 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
autopruneworker stdout | 2024-04-22 04:06:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:06:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:11.264267+00:00 (in 29.999452 seconds)
autopruneworker stdout | 2024-04-22 04:06:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:11 UTC)" (scheduled at 2024-04-22 04:06:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:06:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758741271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:06:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:06:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:06:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:06:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:06:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:53.566665+00:00 (in 12.001203 seconds)
exportactionlogsworker stdout | 2024-04-22 04:06:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:41 UTC)" (scheduled at 2024-04-22 04:06:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:06:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:06:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 6, 41, 565682), True, datetime.datetime(2024, 4, 22, 4, 6, 41, 565682), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:06:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:06:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:06:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:06:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:06:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:22.058978+00:00 (in 39.001333 seconds)
namespacegcworker stdout | 2024-04-22 04:06:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:43 UTC)" (scheduled at 2024-04-22 04:06:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:06:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:06:43,059 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 6, 43, 58073), True, datetime.datetime(2024, 4, 22, 4, 6, 43, 58073), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:06:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:06:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:06:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:07:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:06:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:06:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:06:53.759375+00:00 (in 9.999491 seconds)
notificationworker stdout | 2024-04-22 04:06:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:06:53 UTC)" (scheduled at 2024-04-22 04:06:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:06:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:06:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 6, 43, 760157), True, datetime.datetime(2024, 4, 22, 4, 6, 43, 760157), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:06:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:06:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:06:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:06:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:06:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:06:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:14.952062+00:00 (in 29.999490 seconds)
gcworker stdout | 2024-04-22 04:06:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:14 UTC)" (scheduled at 2024-04-22 04:06:44.952062+00:00)
gcworker stdout | 2024-04-22 04:06:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549204953, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:06:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:06:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:06:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:06:45,652 [278] [DEBUG] [app] Starting request: urn:request:485ab3f6-c626-463a-a0b7-4530949fe1c1 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:06:45,652 [282] [DEBUG] [app] Starting request: urn:request:80181805-1137-4bfd-8601-70d71bdb3e61 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:06:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:06:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:06:45,656 [284] [DEBUG] [app] Starting request: urn:request:86f8c61a-9fb1-49ac-b00f-b3752cbe248d (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:06:45,656 [292] [DEBUG] [app] Starting request: urn:request:13663872-2da0-4f02-bf8e-6c3e897e3fe7 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:06:45,656 [284] [DEBUG] [app] Ending request: urn:request:86f8c61a-9fb1-49ac-b00f-b3752cbe248d (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:86f8c61a-9fb1-49ac-b00f-b3752cbe248d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:06:45,656 [292] [DEBUG] [app] Ending request: urn:request:13663872-2da0-4f02-bf8e-6c3e897e3fe7 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:13663872-2da0-4f02-bf8e-6c3e897e3fe7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:06:45,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:06:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:06:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:06:45,656 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:06:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:06:45,656 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:06:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:06:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:06:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:06:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:06:45,659 [281] [DEBUG] [app] Starting request: urn:request:23b6152d-4933-477d-9918-4779951ccd39 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:06:45,659 [281] [DEBUG] [app] Ending request: urn:request:23b6152d-4933-477d-9918-4779951ccd39 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:23b6152d-4933-477d-9918-4779951ccd39', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:06:45,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:06:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:06:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 04:06:45,660 [278] [DEBUG] [app] Starting request: urn:request:5a6f5783-c0f1-48ad-94b4-387e981da9eb (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:06:45,660 [278] [DEBUG] [app] Ending request: urn:request:5a6f5783-c0f1-48ad-94b4-387e981da9eb (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:5a6f5783-c0f1-48ad-94b4-387e981da9eb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:06:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:06:45,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:06:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:06:45,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:06:45,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:06:45,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:06:45,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:06:45,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:06:45,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:06:45,674 [278] [DEBUG] [app] Ending request: urn:request:485ab3f6-c626-463a-a0b7-4530949fe1c1 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:485ab3f6-c626-463a-a0b7-4530949fe1c1', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:06:45,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:06:45,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:06:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:06:45,675 [282] [DEBUG] [app] Ending request: urn:request:80181805-1137-4bfd-8601-70d71bdb3e61 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:80181805-1137-4bfd-8601-70d71bdb3e61', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:06:45,675 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:06:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 04:06:45,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:06:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:06:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotatotalworker stdout | 2024-04-22 04:06:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:06:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:01.054492+00:00 (in 14.999462 seconds)
quotatotalworker stdout | 2024-04-22 04:06:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:07:01 UTC)" (scheduled at 2024-04-22 04:06:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:06:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:06:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:06:46,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:07:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:06:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:06:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:17.052354+00:00 (in 29.999486 seconds)
buildlogsarchiver stdout | 2024-04-22 04:06:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:17 UTC)" (scheduled at 2024-04-22 04:06:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:06:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 6, 47, 53253), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:06:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:06:47,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:06:47,063 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:06:50,186 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
repositorygcworker stdout | 2024-04-22 04:06:51,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:06:51,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:06.552482+00:00 (in 14.996484 seconds)
repositorygcworker stdout | 2024-04-22 04:06:51,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:11:51 UTC)" (scheduled at 2024-04-22 04:06:51.555445+00:00)
repositorygcworker stdout | 2024-04-22 04:06:51,557 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 6, 51, 556392), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 04:06:51,567 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 6, 51, 556392), True, datetime.datetime(2024, 4, 22, 4, 6, 51, 556392), 0, 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 04:06:51,570 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 6, 51, 556392), True, datetime.datetime(2024, 4, 22, 4, 6, 51, 556392), 0, 'repositorygc/%', False, datetime.datetime(2024, 4, 22, 4, 6, 51, 556392), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 04:06:51,572 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:06:51,572 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:11:51 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:06:51,614 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
exportactionlogsworker stdout | 2024-04-22 04:06:53,566 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:06:53,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:39.566970+00:00 (in 45.999820 seconds)
exportactionlogsworker stdout | 2024-04-22 04:06:53,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:11:53 UTC)" (scheduled at 2024-04-22 04:06:53.566665+00:00)
exportactionlogsworker stdout | 2024-04-22 04:06:53,567 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 6, 53, 567348), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 04:06:53,577 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 6, 53, 567348), True, datetime.datetime(2024, 4, 22, 4, 6, 53, 567348), 0, 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 04:06:53,640 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 6, 53, 567348), True, datetime.datetime(2024, 4, 22, 4, 6, 53, 567348), 0, 'exportactionlogs/%', False, datetime.datetime(2024, 4, 22, 4, 6, 53, 567348), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 04:06:53,643 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:06:53,643 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:11:53 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:06:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:06:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:03.759375+00:00 (in 9.999528 seconds)
notificationworker stdout | 2024-04-22 04:06:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:07:03 UTC)" (scheduled at 2024-04-22 04:06:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:06:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:06:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 6, 53, 760154), True, datetime.datetime(2024, 4, 22, 4, 6, 53, 760154), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:06:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:06:53,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:06:53,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:07:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:06:55,257 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:06:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:06:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:05.871852+00:00 (in 8.998210 seconds)
securityworker stdout | 2024-04-22 04:06:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:26 UTC)" (scheduled at 2024-04-22 04:06:56.873109+00:00)
securityworker stdout | 2024-04-22 04:06:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:06:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:06:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:06:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:06:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:06:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:06:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:06:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:06:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:06:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:06:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:06:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:06:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 1, 56, 881289), 1, 2])
securityworker stdout | 2024-04-22 04:06:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:06:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:06:56,900 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 1, 56, 881289), 1, 2])
securityworker stdout | 2024-04-22 04:06:56,902 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:06:56,902 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:06:56,902 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:06:56,902 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:06:56,902 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:06:56,902 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:06:56,902 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:06:56,903 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:06:56,903 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:06:56,903 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:06:57,010 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:06:58,217 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:06:58,345 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:07:00,109 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:07:00,117 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:07:00,124 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:07:00,127 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:07:00,129 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:07:00,272 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:07:00,374 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:07:00,653 [278] [DEBUG] [app] Starting request: urn:request:53433008-5812-4de1-ac40-0d055402e115 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:07:00,653 [279] [DEBUG] [app] Starting request: urn:request:834aa4d9-fc2b-45f8-a812-80f3209ee220 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:07:00,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:07:00,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:07:00,656 [284] [DEBUG] [app] Starting request: urn:request:8df23a29-dcb2-4137-ac27-1dab8c82ab3b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:07:00,656 [291] [DEBUG] [app] Starting request: urn:request:4de7fe5f-77c5-4de1-a3bd-6cda6f43ca8c (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:07:00,656 [284] [DEBUG] [app] Ending request: urn:request:8df23a29-dcb2-4137-ac27-1dab8c82ab3b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:8df23a29-dcb2-4137-ac27-1dab8c82ab3b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:07:00,656 [291] [DEBUG] [app] Ending request: urn:request:4de7fe5f-77c5-4de1-a3bd-6cda6f43ca8c (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:4de7fe5f-77c5-4de1-a3bd-6cda6f43ca8c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:07:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:07:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:07:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:07:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:07:00,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:07:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:07:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:07:00,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:07:00,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:07:00,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:07:00,659 [278] [DEBUG] [app] Starting request: urn:request:e56fafc0-1dcd-4e43-bd2a-6a1b4ace753e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:07:00,659 [278] [DEBUG] [app] Ending request: urn:request:e56fafc0-1dcd-4e43-bd2a-6a1b4ace753e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e56fafc0-1dcd-4e43-bd2a-6a1b4ace753e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:07:00,660 [282] [DEBUG] [app] Starting request: urn:request:8fea7862-b588-458d-afb9-dcd5ebd5ca50 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:07:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:07:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:07:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:07:00,660 [282] [DEBUG] [app] Ending request: urn:request:8fea7862-b588-458d-afb9-dcd5ebd5ca50 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:8fea7862-b588-458d-afb9-dcd5ebd5ca50', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:07:00,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:07:00,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:07:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:07:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:07:00,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:07:00,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:07:00,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:07:00,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:07:00,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:07:00,674 [278] [DEBUG] [app] Ending request: urn:request:53433008-5812-4de1-ac40-0d055402e115 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:53433008-5812-4de1-ac40-0d055402e115', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:07:00,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:07:00,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:07:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:07:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:07:00,675 [279] [DEBUG] [app] Ending request: urn:request:834aa4d9-fc2b-45f8-a812-80f3209ee220 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:834aa4d9-fc2b-45f8-a812-80f3209ee220', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:07:00,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:07:00,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:07:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:07:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotatotalworker stdout | 2024-04-22 04:07:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:07:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:16.054492+00:00 (in 14.999467 seconds)
quotatotalworker stdout | 2024-04-22 04:07:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:07:16 UTC)" (scheduled at 2024-04-22 04:07:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:07:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:07:01,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:07:01,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:07:16 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:07:01,248 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 04:07:02,485 [279] [DEBUG] [app] Starting request: urn:request:5d43079c-80bd-4ffe-bf65-b8940136614d (/repository/build_test/pushno/create-notification) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:07:02,493 [279] [DEBUG] [endpoints.api.discovery] Unable to find method for POST in class <class 'endpoints.api.repository.RepositoryTrust'>
gunicorn-web stdout | 2024-04-22 04:07:02,504 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:02,518 [279] [DEBUG] [app] Ending request: urn:request:5d43079c-80bd-4ffe-bf65-b8940136614d (/repository/build_test/pushno/create-notification) {'endpoint': 'web.repository', 'request_id': 'urn:request:5d43079c-80bd-4ffe-bf65-b8940136614d', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification', 'path': '/repository/build_test/pushno/create-notification', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:07:02,519 [279] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:07:02 +0000] "GET /repository/build_test/pushno/create-notification HTTP/1.0" 200 93195 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:07:02 +0000] "GET /repository/build_test/pushno/create-notification HTTP/1.1" 200 14252 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.035 1378 0.035)
securityscanningnotificationworker stdout | 2024-04-22 04:07:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:07:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:16.552337+00:00 (in 13.995591 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:07:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:02 UTC)" (scheduled at 2024-04-22 04:07:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:07:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:07:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:07:02,800 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-web stdout | 2024-04-22 04:07:03,177 [279] [DEBUG] [app] Starting request: urn:request:fbbeab38-3af6-4cea-82c9-61a5197890b0 (/api/v1/user/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:07:03,177 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,177 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,178 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:03,187 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:07:03,187 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:07:03,187 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,187 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,188 [279] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:03,188 [279] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:03,188 [279] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:03,188 [279] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" INNER JOIN "team" AS "t2" ON ("t2"."organization_id" = "t1"."id") INNER JOIN "teammember" AS "t3" ON ("t3"."team_id" = "t2"."id") INNER JOIN "user" AS "t4" ON ("t4"."id" = "t3"."user_id") WHERE (("t1"."organization" = %s) AND ("t4"."username" = %s))', [True, 'whuquay'])
gunicorn-web stdout | 2024-04-22 04:07:03,192 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,192 [279] [DEBUG] [peewee] ('SELECT "t1"."service_ident", "t2"."name", "t1"."metadata_json" FROM "federatedlogin" AS "t1" INNER JOIN "loginservice" AS "t2" ON ("t1"."service_id" = "t2"."id") WHERE (("t2"."name" != %s) AND ("t1"."user_id" = %s))', ['quayrobot', 1])
gunicorn-web stdout | 2024-04-22 04:07:03,195 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."kind_id" FROM "userprompt" AS "t1" INNER JOIN "userpromptkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE ("t1"."user_id" = %s)', [1])
gunicorn-web stdout | 2024-04-22 04:07:03,197 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['whuquay', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:03,199 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['whuquay'])
gunicorn-web stdout | 2024-04-22 04:07:03,202 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['whuquay', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:03,204 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['whuquay'])
gunicorn-web stdout | 2024-04-22 04:07:03,206 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."size_bytes", "t1"."backfill_start_ms", "t1"."backfill_complete" FROM "quotanamespacesize" AS "t1" WHERE ("t1"."namespace_user_id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:03,208 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,208 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,209 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:07:03,212 [279] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:03,212 [279] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:03,212 [279] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:03,212 [279] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:07:03,212 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,212 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,212 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,213 [279] [DEBUG] [app] Ending request: urn:request:fbbeab38-3af6-4cea-82c9-61a5197890b0 (/api/v1/user/) {'endpoint': 'api.user', 'request_id': 'urn:request:fbbeab38-3af6-4cea-82c9-61a5197890b0', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/', 'path': '/api/v1/user/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:07:03,213 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:07:03,214 [279] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:07:03 +0000] "GET /api/v1/user/ HTTP/1.0" 200 989 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:07:03 +0000] "GET /api/v1/user/ HTTP/1.1" 200 989 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.038 1505 0.038)
gunicorn-web stdout | 2024-04-22 04:07:03,540 [282] [DEBUG] [app] Starting request: urn:request:ede5461d-a1c0-4d99-910c-d63bc2791ace (/api/v1/user/notifications) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:07:03,541 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,541 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,541 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:03,551 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:07:03,551 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:07:03,551 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,551 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:07:03,551 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,551 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:03,551 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:03,551 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:03,552 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."dismissed" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."dismissed" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', [False, 1, False, 1, 'admin', 6])
gunicorn-web stdout | 2024-04-22 04:07:03,557 [282] [DEBUG] [app] Ending request: urn:request:ede5461d-a1c0-4d99-910c-d63bc2791ace (/api/v1/user/notifications) {'endpoint': 'api.usernotificationlist', 'request_id': 'urn:request:ede5461d-a1c0-4d99-910c-d63bc2791ace', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/notifications', 'path': '/api/v1/user/notifications', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:07:03,557 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:07:03,558 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:07:03 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 43 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:07:03 +0000] "GET /api/v1/user/notifications HTTP/1.1" 200 43 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.019 1518 0.019)
notificationworker stdout | 2024-04-22 04:07:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:07:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:13.759375+00:00 (in 9.999447 seconds)
notificationworker stdout | 2024-04-22 04:07:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:07:13 UTC)" (scheduled at 2024-04-22 04:07:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:07:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:07:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 7, 3, 760282), True, datetime.datetime(2024, 4, 22, 4, 7, 3, 760282), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:07:03,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:07:03,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:07:03,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:07:13 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:07:03,917 [281] [DEBUG] [app] Starting request: urn:request:fa0c7a42-46cf-4830-a85f-39b116bbefc4 (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:07:03,917 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,917 [282] [DEBUG] [app] Starting request: urn:request:5de96e1b-16f8-4e94-b884-c95b0e1c9b4f (/api/v1/messages) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:07:03,917 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,917 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,917 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,918 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:03,918 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:03,926 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:07:03,926 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:07:03,926 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,926 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:07:03,927 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:07:03,927 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:07:03,927 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,927 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,927 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:03,927 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:03,927 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:03,927 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."content", "t1"."uuid", "t1"."severity", "t1"."media_type_id", "t2"."id", "t2"."name" FROM "messages" AS "t1" INNER JOIN "mediatype" AS "t2" ON ("t1"."media_type_id" = "t2"."id")', [])
gunicorn-web stdout | 2024-04-22 04:07:03,929 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:07:03,930 [282] [DEBUG] [app] Ending request: urn:request:5de96e1b-16f8-4e94-b884-c95b0e1c9b4f (/api/v1/messages) {'endpoint': 'api.globalusermessages', 'request_id': 'urn:request:5de96e1b-16f8-4e94-b884-c95b0e1c9b4f', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/messages', 'path': '/api/v1/messages', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:07:03,930 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:07:03,931 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:07:03 +0000] "GET /api/v1/messages HTTP/1.0" 200 17 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:07:03 +0000] "GET /api/v1/messages HTTP/1.1" 200 17 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.014 1508 0.015)
gunicorn-web stdout | 2024-04-22 04:07:03,935 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:03,935 [281] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:07:03,936 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:03,938 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:03,941 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:07:03,943 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,943 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:03,943 [281] [DEBUG] [app] Ending request: urn:request:fa0c7a42-46cf-4830-a85f-39b116bbefc4 (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:fa0c7a42-46cf-4830-a85f-39b116bbefc4', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:07:03,944 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:07:03 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.1" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.029 1546 0.029)
gunicorn-web stdout | 2024-04-22 04:07:03,944 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:07:03 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.0" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
buildlogsarchiver stdout | 2024-04-22 04:07:04,150 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gunicorn-web stdout | 2024-04-22 04:07:04,272 [282] [DEBUG] [app] Starting request: urn:request:d7bce4a3-4681-450b-9a19-c09aa3a1875a (/api/v1/user/apptoken) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:07:04,272 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:04,272 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:04,273 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:04,281 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:07:04,281 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:07:04,281 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:04,282 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:07:04,282 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:04,282 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:04,282 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:04,282 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:04,282 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."uuid", "t1"."title", "t1"."token_name", "t1"."token_secret", "t1"."created", "t1"."expiration", "t1"."last_accessed" FROM "appspecificauthtoken" AS "t1" WHERE ((("t1"."user_id" = %s) AND ("t1"."expiration" <= %s)) AND ("t1"."expiration" > %s))', [1, datetime.datetime(2024, 4, 24, 23, 19, 4, 282334), datetime.datetime(2024, 4, 22, 4, 7, 4, 282370)])
gunicorn-web stdout | 2024-04-22 04:07:04,285 [282] [DEBUG] [app] Ending request: urn:request:d7bce4a3-4681-450b-9a19-c09aa3a1875a (/api/v1/user/apptoken) {'endpoint': 'api.apptokens', 'request_id': 'urn:request:d7bce4a3-4681-450b-9a19-c09aa3a1875a', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/apptoken?expiring=true', 'path': '/api/v1/user/apptoken', 'parameters': {'expiring': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:07:04,285 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:07:04,285 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:07:04 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:07:04 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.1" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.014 1527 0.014)
gcworker stdout | 2024-04-22 04:07:04,409 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:07:04,623 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:07:04,711 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:07:04,714 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:07:04,719 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:07:05,703 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:07:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:07:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:26.873109+00:00 (in 21.000734 seconds)
securityworker stdout | 2024-04-22 04:07:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:35 UTC)" (scheduled at 2024-04-22 04:07:05.871852+00:00)
securityworker stdout | 2024-04-22 04:07:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:07:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:07:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:07:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:07:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:07:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:07:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:35 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:07:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:07:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:13.555667+00:00 (in 7.002663 seconds)
repositorygcworker stdout | 2024-04-22 04:07:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:06 UTC)" (scheduled at 2024-04-22 04:07:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:07:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:07:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 7, 6, 553428), True, datetime.datetime(2024, 4, 22, 4, 7, 6, 553428), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:07:06,563 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:07:06,563 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:07:06,563 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:06 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:07:06,885 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:07:06,925 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:07:07,046 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:07:08,113 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:07:09,401 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:07:09,454 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:07:09,793 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:07:09,874 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:07:11,021 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:07:11,024 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:07:11,032 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:07:11,036 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:07:11,038 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:07:11,041 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:07:11,044 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:07:11,047 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:07:11,050 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
storagereplication stdout | 2024-04-22 04:07:11,171 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
autopruneworker stdout | 2024-04-22 04:07:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:07:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:41.264267+00:00 (in 29.999451 seconds)
autopruneworker stdout | 2024-04-22 04:07:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:41 UTC)" (scheduled at 2024-04-22 04:07:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:07:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758771272, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:07:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:07:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:07:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:07:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:07:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:06.552482+00:00 (in 52.996333 seconds)
repositorygcworker stdout | 2024-04-22 04:07:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:13 UTC)" (scheduled at 2024-04-22 04:07:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:07:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:07:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:07:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:07:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:19.762424+00:00 (in 6.002592 seconds)
notificationworker stdout | 2024-04-22 04:07:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:07:23 UTC)" (scheduled at 2024-04-22 04:07:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:07:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:07:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 7, 13, 760157), True, datetime.datetime(2024, 4, 22, 4, 7, 13, 760157), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:07:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:07:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:07:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:07:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:07:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:07:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:44.952062+00:00 (in 29.999501 seconds)
gcworker stdout | 2024-04-22 04:07:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:44 UTC)" (scheduled at 2024-04-22 04:07:14.952062+00:00)
gcworker stdout | 2024-04-22 04:07:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549234952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:07:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:07:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:07:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:07:15,653 [278] [DEBUG] [app] Starting request: urn:request:2f39bb77-5422-47ac-85fa-d1b1c7439a09 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:07:15,653 [279] [DEBUG] [app] Starting request: urn:request:109f4ac4-012f-495b-8394-2edd39e71c9c (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:07:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:07:15,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:07:15,656 [284] [DEBUG] [app] Starting request: urn:request:0b0c5342-f1ce-4f62-94b4-350684b8ff0f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:07:15,656 [285] [DEBUG] [app] Starting request: urn:request:00087ee8-3c06-4af1-8125-791790b8d685 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:07:15,657 [285] [DEBUG] [app] Ending request: urn:request:00087ee8-3c06-4af1-8125-791790b8d685 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:00087ee8-3c06-4af1-8125-791790b8d685', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:07:15,657 [284] [DEBUG] [app] Ending request: urn:request:0b0c5342-f1ce-4f62-94b4-350684b8ff0f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:0b0c5342-f1ce-4f62-94b4-350684b8ff0f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:07:15,657 [285] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:07:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:07:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:07:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:07:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:07:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
gunicorn-web stdout | 2024-04-22 04:07:15,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:07:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:07:15,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:07:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:07:15,660 [281] [DEBUG] [app] Starting request: urn:request:b56de5ad-c8c2-4b6a-9d34-7e1ff3dd2438 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:07:15,660 [282] [DEBUG] [app] Starting request: urn:request:dd696aa7-a5b9-4982-b35c-463be5ef2d1f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:07:15,660 [281] [DEBUG] [app] Ending request: urn:request:b56de5ad-c8c2-4b6a-9d34-7e1ff3dd2438 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b56de5ad-c8c2-4b6a-9d34-7e1ff3dd2438', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:07:15,660 [282] [DEBUG] [app] Ending request: urn:request:dd696aa7-a5b9-4982-b35c-463be5ef2d1f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:dd696aa7-a5b9-4982-b35c-463be5ef2d1f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:07:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:07:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:07:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:07:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:07:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:07:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:07:15,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:07:15,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:07:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:07:15,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:07:15,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:07:15,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:07:15,674 [278] [DEBUG] [app] Ending request: urn:request:2f39bb77-5422-47ac-85fa-d1b1c7439a09 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2f39bb77-5422-47ac-85fa-d1b1c7439a09', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:07:15,675 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:07:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:07:15,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:07:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:07:15,675 [279] [DEBUG] [app] Ending request: urn:request:109f4ac4-012f-495b-8394-2edd39e71c9c (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:109f4ac4-012f-495b-8394-2edd39e71c9c', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:07:15,675 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:07:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 04:07:15,676 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:07:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:07:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:07:16,054 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:31.054492+00:00 (in 14.999567 seconds)
quotatotalworker stdout | 2024-04-22 04:07:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:07:31 UTC)" (scheduled at 2024-04-22 04:07:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:07:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:07:16,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:07:16,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:07:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:07:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:07:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:21.555879+00:00 (in 5.002956 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:07:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:16 UTC)" (scheduled at 2024-04-22 04:07:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:07:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:07:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 7, 16, 553353), True, datetime.datetime(2024, 4, 22, 4, 7, 16, 553353), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:07:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:07:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:07:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:07:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:07:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:47.052354+00:00 (in 29.999462 seconds)
buildlogsarchiver stdout | 2024-04-22 04:07:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:47 UTC)" (scheduled at 2024-04-22 04:07:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:07:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 7, 17, 53251), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:07:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:07:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:07:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:07:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:07:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:23.759375+00:00 (in 3.996391 seconds)
notificationworker stdout | 2024-04-22 04:07:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:19 UTC)" (scheduled at 2024-04-22 04:07:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:07:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:07:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:19 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:07:20,181 [281] [DEBUG] [app] Starting request: urn:request:811eed3c-9dad-486f-9ce0-ba1122bcedc5 (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:07:20,181 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:20,181 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:20,182 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:20,196 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:07:20,197 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:07:20,197 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:20,197 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:07:20,197 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:20,197 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:20,197 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:20,197 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:20,199 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:07:20,206 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:20,207 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:20,211 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:20,214 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['repo_push', 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:20,216 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['webhook', 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:20,218 [281] [DEBUG] [peewee] ('INSERT INTO "repositorynotification" ("uuid", "repository_id", "event_id", "method_id", "title", "config_json", "event_config_json", "number_of_failures") VALUES (%s, %s, %s, %s, %s, %s, %s, %s) RETURNING "repositorynotification"."id"', ['638a67a2-7215-4c47-9e8f-1866b057fc27', 1, 5, 6, 'push webhook', '{"url": "https://webhook.site/ffd85e96-d5d9-4a80-a40b-342ae3308119"}', '{}', 0])
expiredappspecifictokenworker stdout | 2024-04-22 04:07:20,222 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
gunicorn-web stdout | 2024-04-22 04:07:20,228 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:20,230 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:20,233 [281] [DEBUG] [peewee] ('INSERT INTO "logentry3" ("kind_id", "account_id", "performer_id", "repository_id", "datetime", "ip", "metadata_json") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "logentry3"."id"', [6, 2, 1, 1, datetime.datetime(2024, 4, 22, 4, 7, 20, 230483), '10.131.0.9', '{"repo": "pushno", "namespace": "build_test", "notification_id": "638a67a2-7215-4c47-9e8f-1866b057fc27", "event": "repo_push", "method": "webhook"}'])
gunicorn-web stdout | 2024-04-22 04:07:20,237 [281] [DEBUG] [app] Ending request: urn:request:811eed3c-9dad-486f-9ce0-ba1122bcedc5 (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:811eed3c-9dad-486f-9ce0-ba1122bcedc5', 'remote_addr': '10.131.0.9', 'http_method': 'POST', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': {'event': 'repo_push', 'method': 'webhook', 'config': {'url': 'https://webhook.site/ffd85e96-d5d9-4a80-a40b-342ae3308119'}, 'eventConfig': {}, 'title': 'push webhook'}, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:07:20,237 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:07:20,238 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:07:20 +0000] "POST /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 201 242 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:07:20 +0000] "POST /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 201 242 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.059 1887 0.059)
gunicorn-web stdout | 2024-04-22 04:07:20,574 [278] [DEBUG] [app] Starting request: urn:request:52182687-4f1d-461f-8153-d111a4350f3b (/api/v1/repository/build_test/pushno/tag/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:07:20,574 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:20,574 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:20,575 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:20,577 [282] [DEBUG] [app] Starting request: urn:request:3df003ac-9037-42a1-8f9a-88f6bddf2aa2 (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:07:20,578 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:20,578 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:20,578 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:20,584 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:07:20,584 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:07:20,584 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:20,584 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:07:20,584 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:20,584 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:20,585 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:20,585 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:20,587 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:07:20,587 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:07:20,587 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:07:20,587 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:20,588 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:07:20,588 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:20,588 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:20,588 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:20,588 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:20,590 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:07:20,593 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:20,594 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:20,596 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:20,596 [282] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:07:20,597 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:20,598 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:20,599 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:20,600 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:20,602 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:07:20,602 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:20,603 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:20,604 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:20,604 [282] [DEBUG] [app] Ending request: urn:request:3df003ac-9037-42a1-8f9a-88f6bddf2aa2 (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:3df003ac-9037-42a1-8f9a-88f6bddf2aa2', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeStats=true&includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeStats': 'true', 'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:07:20,605 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:07:20,605 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."repository_id", "t1"."manifest_id", "t1"."lifetime_start_ms", "t1"."lifetime_end_ms", "t1"."hidden", "t1"."reversion", "t1"."tag_kind_id", "t1"."linked_tag_id", "t2"."id", "t2"."digest", "t2"."media_type_id", "t2"."layers_compressed_size", "t2"."config_media_type" FROM "tag" AS "t1" INNER JOIN "manifest" AS "t2" ON ("t1"."manifest_id" = "t2"."id") WHERE ((("t1"."repository_id" = %s) AND (("t1"."lifetime_end_ms" IS %s) OR ("t1"."lifetime_end_ms" > %s))) AND ("t1"."hidden" = %s)) ORDER BY "t1"."lifetime_start_ms" DESC, "t1"."name" LIMIT %s OFFSET %s', [1, None, 1713758840604, False, 101, 0])
gunicorn-web stdout | 2024-04-22 04:07:20,605 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:07:20 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.0" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:07:20 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.1" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.029 1576 0.029)
gunicorn-web stdout | 2024-04-22 04:07:20,608 [278] [DEBUG] [app] Ending request: urn:request:52182687-4f1d-461f-8153-d111a4350f3b (/api/v1/repository/build_test/pushno/tag/) {'endpoint': 'api.listrepositorytags', 'request_id': 'urn:request:52182687-4f1d-461f-8153-d111a4350f3b', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true', 'path': '/api/v1/repository/build_test/pushno/tag/', 'parameters': {'limit': '100', 'page': '1', 'onlyActiveTags': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:07:20,608 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:07:20 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.1" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.036 1582 0.036)
gunicorn-web stdout | 2024-04-22 04:07:20,609 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:07:20 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:07:21,045 [281] [DEBUG] [app] Starting request: urn:request:da10ef54-b0ee-46ee-9d24-41b90658170b (/api/v1/repository/build_test/pushno/permissions/user/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:07:21,045 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:21,046 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:21,046 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:21,055 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:07:21,056 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:07:21,056 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:21,056 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:07:21,056 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:21,056 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:21,056 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:21,056 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:21,058 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:07:21,064 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:21,065 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:21,067 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed", "t2"."id", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "user" AS "t1" ON ("t3"."user_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:07:21,070 [281] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."username" FROM "user" AS "t1" INNER JOIN "teammember" AS "t2" ON ("t2"."user_id" = "t1"."id") INNER JOIN "team" AS "t3" ON ("t2"."team_id" = "t3"."id") WHERE ((("t3"."organization_id" = %s) AND ("t1"."robot" = %s)) AND ("t1"."id" IN (%s)))', [2, False, 1])
gunicorn-web stdout | 2024-04-22 04:07:21,073 [281] [DEBUG] [app] Ending request: urn:request:da10ef54-b0ee-46ee-9d24-41b90658170b (/api/v1/repository/build_test/pushno/permissions/user/) {'endpoint': 'api.repositoryuserpermissionlist', 'request_id': 'urn:request:da10ef54-b0ee-46ee-9d24-41b90658170b', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/user/', 'path': '/api/v1/repository/build_test/pushno/permissions/user/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:07:21,073 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:07:21 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.1" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.029 1558 0.029)
gunicorn-web stdout | 2024-04-22 04:07:21,073 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:07:21 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.0" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
securityscanningnotificationworker stdout | 2024-04-22 04:07:21,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:07:21,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:02.556208+00:00 (in 40.999800 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:07:21,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:12:21 UTC)" (scheduled at 2024-04-22 04:07:21.555879+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:07:21,557 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 7, 21, 556809), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 04:07:21,566 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 7, 21, 556809), True, datetime.datetime(2024, 4, 22, 4, 7, 21, 556809), 0, 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 04:07:21,569 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 7, 21, 556809), True, datetime.datetime(2024, 4, 22, 4, 7, 21, 556809), 0, 'secscanv4/%', False, datetime.datetime(2024, 4, 22, 4, 7, 21, 556809), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 04:07:21,571 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:07:21,571 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:12:21 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:07:21,650 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
gunicorn-web stdout | 2024-04-22 04:07:21,754 [282] [DEBUG] [app] Starting request: urn:request:1176ac2c-067d-4b92-b483-d53efd3d2ac0 (/api/v1/repository/build_test/pushno/permissions/team/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:07:21,754 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:21,754 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:21,755 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:21,765 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:07:21,765 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:07:21,765 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:21,765 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:07:21,765 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:21,765 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:21,765 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:21,765 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:21,767 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:07:21,773 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:21,774 [282] [DEBUG] [peewee] ('SELECT "t1"."name", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "team" AS "t1" ON ("t3"."team_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:07:21,777 [282] [DEBUG] [app] Ending request: urn:request:1176ac2c-067d-4b92-b483-d53efd3d2ac0 (/api/v1/repository/build_test/pushno/permissions/team/) {'endpoint': 'api.repositoryteampermissionlist', 'request_id': 'urn:request:1176ac2c-067d-4b92-b483-d53efd3d2ac0', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/team/', 'path': '/api/v1/repository/build_test/pushno/permissions/team/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:07:21,777 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:07:21,777 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:07:21 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.0" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:07:21 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.1" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.024 1539 0.024)
gunicorn-web stdout | 2024-04-22 04:07:21,788 [282] [DEBUG] [app] Starting request: urn:request:6741fdf1-6ce3-4457-8065-0fcf8c37ebe9 (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:07:21,788 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:21,788 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:21,788 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:21,796 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:07:21,797 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:07:21,797 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:21,797 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:07:21,797 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:21,797 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:21,797 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:21,797 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:21,799 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:07:21,805 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:21,806 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:21,809 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t3"."username" = %s) AND ("t2"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:07:21,812 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:21,814 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [4, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:21,817 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:21,819 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:21,821 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:21,823 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:21,825 [282] [DEBUG] [app] Ending request: urn:request:6741fdf1-6ce3-4457-8065-0fcf8c37ebe9 (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:6741fdf1-6ce3-4457-8065-0fcf8c37ebe9', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:07:21,825 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:07:21,826 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:07:21 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 200 875 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:07:21 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 200 875 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.039 1535 0.039)
gunicorn-web stdout | 2024-04-22 04:07:21,919 [278] [DEBUG] [app] Starting request: urn:request:bde9f094-71c8-4ce2-9e8e-d551ae87b98e (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:07:21,919 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:21,919 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:21,920 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:21,929 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:07:21,929 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:07:21,929 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:21,929 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:07:21,929 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:21,929 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:21,929 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:21,929 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:21,931 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:07:21,937 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:21,939 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:21,943 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:07:21,947 [278] [DEBUG] [app] Ending request: urn:request:bde9f094-71c8-4ce2-9e8e-d551ae87b98e (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:bde9f094-71c8-4ce2-9e8e-d551ae87b98e', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:07:21,948 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:07:21,948 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:07:21 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:07:21 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.031 1536 0.031)
namespacegcworker stdout | 2024-04-22 04:07:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:07:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:38.058708+00:00 (in 15.999193 seconds)
namespacegcworker stdout | 2024-04-22 04:07:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:22 UTC)" (scheduled at 2024-04-22 04:07:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:07:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:07:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:07:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:07:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:33.759375+00:00 (in 9.999482 seconds)
notificationworker stdout | 2024-04-22 04:07:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:07:33 UTC)" (scheduled at 2024-04-22 04:07:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:07:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:07:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 7, 23, 760308), True, datetime.datetime(2024, 4, 22, 4, 7, 23, 760308), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:07:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:07:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:07:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:07:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:07:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:07:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:24.361582+00:00 (in 59.999454 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:07:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:24 UTC)" (scheduled at 2024-04-22 04:07:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:07:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:07:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:07:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:07:25,293 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
gunicorn-web stdout | 2024-04-22 04:07:26,316 [281] [DEBUG] [app] Starting request: urn:request:e8a17dcd-bd15-4679-b5af-0dbdf06c5cbd (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:07:26,316 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:26,316 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:26,317 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:26,326 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:07:26,326 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:07:26,326 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:26,326 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:07:26,326 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:26,326 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:26,327 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:26,327 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:26,329 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:07:26,335 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:07:26,335 [281] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:07:26,336 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:26,338 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:07:26,341 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:07:26,343 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:26,343 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:07:26,343 [281] [DEBUG] [app] Ending request: urn:request:e8a17dcd-bd15-4679-b5af-0dbdf06c5cbd (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:e8a17dcd-bd15-4679-b5af-0dbdf06c5cbd', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:07:26,344 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:07:26,344 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:07:26 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.0" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:07:26 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.1" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.029 1565 0.029)
securityworker stdout | 2024-04-22 04:07:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:07:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:35.871852+00:00 (in 8.998261 seconds)
securityworker stdout | 2024-04-22 04:07:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:56 UTC)" (scheduled at 2024-04-22 04:07:26.873109+00:00)
securityworker stdout | 2024-04-22 04:07:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:07:26,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:07:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:07:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:07:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:07:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:07:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:07:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:07:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:07:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:07:26,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:07:26,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:07:26,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 2, 26, 881027), 1, 2])
securityworker stdout | 2024-04-22 04:07:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:07:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:07:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 2, 26, 881027), 1, 2])
securityworker stdout | 2024-04-22 04:07:26,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:07:26,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:07:26,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:07:26,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:07:26,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:07:26,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:07:26,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:07:26,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:07:26,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:07:26,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:07:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:07:27,046 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:07:28,242 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:07:28,381 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:07:30,120 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:07:30,127 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:07:30,138 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:07:30,141 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:07:30,144 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:07:30,308 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:07:30,405 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:07:30,653 [279] [DEBUG] [app] Starting request: urn:request:e1657700-9172-43d8-84b6-d386dac76220 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:07:30,653 [278] [DEBUG] [app] Starting request: urn:request:01c5fac3-bc78-483b-9777-dfb5942f0ba0 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:07:30,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:07:30,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:07:30,656 [284] [DEBUG] [app] Starting request: urn:request:bd5c4817-900a-43c6-886b-03b81698c993 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:07:30,656 [292] [DEBUG] [app] Starting request: urn:request:431de344-9337-45bc-b086-969a04a74620 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:07:30,656 [284] [DEBUG] [app] Ending request: urn:request:bd5c4817-900a-43c6-886b-03b81698c993 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:bd5c4817-900a-43c6-886b-03b81698c993', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:07:30,657 [292] [DEBUG] [app] Ending request: urn:request:431de344-9337-45bc-b086-969a04a74620 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:431de344-9337-45bc-b086-969a04a74620', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:07:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:07:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:07:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:07:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:07:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:07:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:07:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:07:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:07:30,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:07:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:07:30,659 [279] [DEBUG] [app] Starting request: urn:request:e869c6d3-bd62-4709-b5b4-c2976b3e6857 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:07:30,659 [281] [DEBUG] [app] Starting request: urn:request:a14d6e68-4813-40a8-9a7c-2cf49db8f5bb (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:07:30,660 [279] [DEBUG] [app] Ending request: urn:request:e869c6d3-bd62-4709-b5b4-c2976b3e6857 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e869c6d3-bd62-4709-b5b4-c2976b3e6857', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:07:30,660 [281] [DEBUG] [app] Ending request: urn:request:a14d6e68-4813-40a8-9a7c-2cf49db8f5bb (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a14d6e68-4813-40a8-9a7c-2cf49db8f5bb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:07:30,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:07:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:07:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:07:30,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:07:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:07:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:07:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:07:30,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:07:30,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:07:30,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:07:30,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:07:30,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:07:30,674 [278] [DEBUG] [app] Ending request: urn:request:01c5fac3-bc78-483b-9777-dfb5942f0ba0 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:01c5fac3-bc78-483b-9777-dfb5942f0ba0', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:07:30,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:07:30,674 [279] [DEBUG] [app] Ending request: urn:request:e1657700-9172-43d8-84b6-d386dac76220 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e1657700-9172-43d8-84b6-d386dac76220', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:07:30,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:07:30,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:07:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:07:30,674 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:07:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:07:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:07:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
quotatotalworker stdout | 2024-04-22 04:07:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:07:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:46.054492+00:00 (in 14.999475 seconds)
quotatotalworker stdout | 2024-04-22 04:07:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:07:46 UTC)" (scheduled at 2024-04-22 04:07:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:07:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:07:31,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:07:31,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:07:46 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:07:31,285 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:07:32,825 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:07:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:07:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:43.759375+00:00 (in 9.999432 seconds)
notificationworker stdout | 2024-04-22 04:07:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:07:43 UTC)" (scheduled at 2024-04-22 04:07:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:07:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:07:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 7, 33, 760429), True, datetime.datetime(2024, 4, 22, 4, 7, 33, 760429), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:07:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:07:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:07:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:07:43 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:07:34,185 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:07:34,436 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:07:34,660 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:07:34,720 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:07:34,724 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:07:34,728 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:07:35,715 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:07:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:07:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:56.873109+00:00 (in 21.000741 seconds)
securityworker stdout | 2024-04-22 04:07:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:05 UTC)" (scheduled at 2024-04-22 04:07:35.871852+00:00)
securityworker stdout | 2024-04-22 04:07:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:07:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:07:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:07:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:07:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:07:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:07:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:07:36,905 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:07:36,956 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:07:37,081 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
namespacegcworker stdout | 2024-04-22 04:07:38,058 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:07:38,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:43.057186+00:00 (in 4.998007 seconds)
namespacegcworker stdout | 2024-04-22 04:07:38,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:12:38 UTC)" (scheduled at 2024-04-22 04:07:38.058708+00:00)
namespacegcworker stdout | 2024-04-22 04:07:38,060 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 7, 38, 59510), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 04:07:38,069 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 7, 38, 59510), True, datetime.datetime(2024, 4, 22, 4, 7, 38, 59510), 0, 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 04:07:38,071 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 7, 38, 59510), True, datetime.datetime(2024, 4, 22, 4, 7, 38, 59510), 0, 'namespacegc/%', False, datetime.datetime(2024, 4, 22, 4, 7, 38, 59510), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 04:07:38,074 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:07:38,074 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:12:38 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 04:07:38,150 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:07:39,438 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:07:39,466 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
exportactionlogsworker stdout | 2024-04-22 04:07:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:07:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:41.564959+00:00 (in 1.997489 seconds)
exportactionlogsworker stdout | 2024-04-22 04:07:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:39 UTC)" (scheduled at 2024-04-22 04:07:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:07:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:07:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:39 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:07:39,814 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:07:39,889 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:07:41,030 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:07:41,033 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:07:41,044 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:07:41,046 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:07:41,050 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:07:41,053 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:07:41,055 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:07:41,058 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:07:41,061 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
storagereplication stdout | 2024-04-22 04:07:41,206 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
autopruneworker stdout | 2024-04-22 04:07:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:07:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:11.264267+00:00 (in 29.999468 seconds)
autopruneworker stdout | 2024-04-22 04:07:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:11 UTC)" (scheduled at 2024-04-22 04:07:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:07:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758801271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:07:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:07:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:07:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:07:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:07:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:39.566970+00:00 (in 58.001515 seconds)
exportactionlogsworker stdout | 2024-04-22 04:07:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:41 UTC)" (scheduled at 2024-04-22 04:07:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:07:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:07:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 7, 41, 565723), True, datetime.datetime(2024, 4, 22, 4, 7, 41, 565723), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:07:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:07:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:07:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:07:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:07:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:22.058978+00:00 (in 39.001288 seconds)
namespacegcworker stdout | 2024-04-22 04:07:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:43 UTC)" (scheduled at 2024-04-22 04:07:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:07:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:07:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 7, 43, 58126), True, datetime.datetime(2024, 4, 22, 4, 7, 43, 58126), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:07:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:07:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:07:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:08:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:07:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:07:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:07:53.759375+00:00 (in 9.999505 seconds)
notificationworker stdout | 2024-04-22 04:07:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:07:53 UTC)" (scheduled at 2024-04-22 04:07:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:07:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:07:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 7, 43, 760160), True, datetime.datetime(2024, 4, 22, 4, 7, 43, 760160), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:07:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:07:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:07:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:07:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:07:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:07:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:14.952062+00:00 (in 29.999468 seconds)
gcworker stdout | 2024-04-22 04:07:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:14 UTC)" (scheduled at 2024-04-22 04:07:44.952062+00:00)
gcworker stdout | 2024-04-22 04:07:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549264953, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:07:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:07:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:07:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:07:45,653 [282] [DEBUG] [app] Starting request: urn:request:a20f756b-957d-4ff4-9b61-7f321c80bdfb (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:07:45,653 [281] [DEBUG] [app] Starting request: urn:request:85b2a247-9e78-4849-8814-9d6a8df56ea3 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:07:45,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:07:45,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:07:45,656 [292] [DEBUG] [app] Starting request: urn:request:ff10e896-5866-4cfe-a51d-e70f0a6a8041 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:07:45,656 [290] [DEBUG] [app] Starting request: urn:request:82c14cdd-18b7-4503-a369-2122f3e3fa43 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:07:45,657 [292] [DEBUG] [app] Ending request: urn:request:ff10e896-5866-4cfe-a51d-e70f0a6a8041 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:ff10e896-5866-4cfe-a51d-e70f0a6a8041', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:07:45,657 [290] [DEBUG] [app] Ending request: urn:request:82c14cdd-18b7-4503-a369-2122f3e3fa43 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:82c14cdd-18b7-4503-a369-2122f3e3fa43', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:07:45,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:07:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:07:45,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:07:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:07:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:07:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:07:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:07:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:07:45,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:07:45,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:07:45,660 [281] [DEBUG] [app] Starting request: urn:request:3f765408-42fb-46f7-a811-21ad5b8283c0 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:07:45,660 [281] [DEBUG] [app] Ending request: urn:request:3f765408-42fb-46f7-a811-21ad5b8283c0 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3f765408-42fb-46f7-a811-21ad5b8283c0', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:07:45,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:07:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:07:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:07:45,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:07:45,660 [279] [DEBUG] [app] Starting request: urn:request:1ab529d7-e499-460a-bdcb-8b319c96d62f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:07:45,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:07:45,661 [279] [DEBUG] [app] Ending request: urn:request:1ab529d7-e499-460a-bdcb-8b319c96d62f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1ab529d7-e499-460a-bdcb-8b319c96d62f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:07:45,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:07:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:07:45,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:07:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:07:45,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:07:45,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:07:45,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:07:45,674 [281] [DEBUG] [app] Ending request: urn:request:85b2a247-9e78-4849-8814-9d6a8df56ea3 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:85b2a247-9e78-4849-8814-9d6a8df56ea3', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:07:45,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:07:45,675 [282] [DEBUG] [app] Ending request: urn:request:a20f756b-957d-4ff4-9b61-7f321c80bdfb (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a20f756b-957d-4ff4-9b61-7f321c80bdfb', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:07:45,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:07:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:07:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.023)
gunicorn-web stdout | 2024-04-22 04:07:45,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:07:45,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:07:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:07:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotatotalworker stdout | 2024-04-22 04:07:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:07:46,054 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:01.054492+00:00 (in 14.999538 seconds)
quotatotalworker stdout | 2024-04-22 04:07:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:08:01 UTC)" (scheduled at 2024-04-22 04:07:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:07:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:07:46,064 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:07:46,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:08:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:07:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:07:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:17.052354+00:00 (in 29.999519 seconds)
buildlogsarchiver stdout | 2024-04-22 04:07:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:17 UTC)" (scheduled at 2024-04-22 04:07:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:07:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 7, 47, 53177), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:07:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:07:47,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:07:47,063 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:07:50,238 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:07:51,668 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:07:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:07:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:03.759375+00:00 (in 9.999465 seconds)
notificationworker stdout | 2024-04-22 04:07:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:08:03 UTC)" (scheduled at 2024-04-22 04:07:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:07:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:07:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 7, 53, 760369), True, datetime.datetime(2024, 4, 22, 4, 7, 53, 760369), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:07:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:07:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:07:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:08:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:07:55,307 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:07:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:07:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:05.871852+00:00 (in 8.998227 seconds)
securityworker stdout | 2024-04-22 04:07:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:26 UTC)" (scheduled at 2024-04-22 04:07:56.873109+00:00)
securityworker stdout | 2024-04-22 04:07:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:07:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:07:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:07:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:07:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:07:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:07:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:07:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:07:56,882 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:07:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:07:56,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:07:56,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:07:56,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 2, 56, 881897), 1, 2])
securityworker stdout | 2024-04-22 04:07:56,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:07:56,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:07:56,898 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 2, 56, 881897), 1, 2])
securityworker stdout | 2024-04-22 04:07:56,900 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:07:56,900 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:07:56,900 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:07:56,900 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:07:56,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:07:56,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:07:56,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:07:56,901 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:07:56,901 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:07:56,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:07:57,083 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:07:58,275 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:07:58,417 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:08:00,131 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:08:00,135 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:08:00,145 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:08:00,152 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:08:00,154 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:08:00,345 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:08:00,433 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:08:00,652 [278] [DEBUG] [app] Starting request: urn:request:59724ff9-b88c-4abc-9287-b0670604aaf5 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:08:00,652 [279] [DEBUG] [app] Starting request: urn:request:d076b50a-c8e0-4b8b-8704-b0a9e024c3a5 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:08:00,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:08:00,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:08:00,655 [290] [DEBUG] [app] Starting request: urn:request:7bfd33d9-c6a1-4d79-917f-6c961d4540a1 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:08:00,655 [284] [DEBUG] [app] Starting request: urn:request:b0a40854-ca48-4778-9c46-75bd757f673e (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:08:00,656 [284] [DEBUG] [app] Ending request: urn:request:b0a40854-ca48-4778-9c46-75bd757f673e (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b0a40854-ca48-4778-9c46-75bd757f673e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:08:00,656 [290] [DEBUG] [app] Ending request: urn:request:7bfd33d9-c6a1-4d79-917f-6c961d4540a1 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7bfd33d9-c6a1-4d79-917f-6c961d4540a1', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:08:00,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:08:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:08:00,656 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:08:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:08:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:08:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:08:00,656 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:08:00,656 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:08:00,657 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:08:00,657 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:08:00,659 [279] [DEBUG] [app] Starting request: urn:request:9e2a1484-6ad8-41c0-a15b-1410169b777a (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:08:00,659 [282] [DEBUG] [app] Starting request: urn:request:f1f161ce-b9e7-4e4f-8a4e-3ce94f7a9aba (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:08:00,659 [279] [DEBUG] [app] Ending request: urn:request:9e2a1484-6ad8-41c0-a15b-1410169b777a (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9e2a1484-6ad8-41c0-a15b-1410169b777a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:08:00,659 [282] [DEBUG] [app] Ending request: urn:request:f1f161ce-b9e7-4e4f-8a4e-3ce94f7a9aba (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:f1f161ce-b9e7-4e4f-8a4e-3ce94f7a9aba', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:08:00,659 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:08:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:08:00,659 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:08:00,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:08:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:08:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:08:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:08:00,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:08:00,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:08:00,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:08:00,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:08:00,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:08:00,674 [279] [DEBUG] [app] Ending request: urn:request:d076b50a-c8e0-4b8b-8704-b0a9e024c3a5 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:d076b50a-c8e0-4b8b-8704-b0a9e024c3a5', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:08:00,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:08:00,674 [278] [DEBUG] [app] Ending request: urn:request:59724ff9-b88c-4abc-9287-b0670604aaf5 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:59724ff9-b88c-4abc-9287-b0670604aaf5', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:08:00,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:08:00,674 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:08:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:08:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:08:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.023)
gunicorn-web stdout | 2024-04-22 04:08:00,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:08:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:08:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:08:01,054 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:16.054492+00:00 (in 14.999556 seconds)
quotatotalworker stdout | 2024-04-22 04:08:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:08:16 UTC)" (scheduled at 2024-04-22 04:08:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:08:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:08:01,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:08:01,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:08:16 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:08:01,305 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:08:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:08:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:16.552337+00:00 (in 13.995640 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:08:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:02 UTC)" (scheduled at 2024-04-22 04:08:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:08:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:08:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:08:02,840 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:08:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:08:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:13.759375+00:00 (in 9.999436 seconds)
notificationworker stdout | 2024-04-22 04:08:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:08:13 UTC)" (scheduled at 2024-04-22 04:08:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:08:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:08:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 8, 3, 760282), True, datetime.datetime(2024, 4, 22, 4, 8, 3, 760282), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:08:03,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:08:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:08:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:08:13 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:08:04,222 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:08:04,472 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:08:04,697 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:08:04,727 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:08:04,730 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:08:04,734 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
gunicorn-web stdout | 2024-04-22 04:08:04,905 [278] [DEBUG] [app] Starting request: urn:request:7fc4ce3f-647d-4f92-85b2-0635d11387bc (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:08:04,906 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:04,906 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:04,906 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:04,916 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:08:04,916 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:08:04,916 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:04,916 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:08:04,916 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:04,916 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:04,916 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:04,916 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:04,919 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:08:04,925 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:04,926 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:04,930 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:04,933 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['repo_push', 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:04,935 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['slack', 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:04,937 [278] [DEBUG] [peewee] ('INSERT INTO "repositorynotification" ("uuid", "repository_id", "event_id", "method_id", "title", "config_json", "event_config_json", "number_of_failures") VALUES (%s, %s, %s, %s, %s, %s, %s, %s) RETURNING "repositorynotification"."id"', ['37a609f6-18e0-4667-9e99-ed8347122ff4', 1, 5, 5, 'push slack', '{"url": "https://hooks.slack.com/services/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"}', '{}', 0])
gunicorn-web stdout | 2024-04-22 04:08:04,942 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:04,945 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:04,947 [278] [DEBUG] [peewee] ('INSERT INTO "logentry3" ("kind_id", "account_id", "performer_id", "repository_id", "datetime", "ip", "metadata_json") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "logentry3"."id"', [6, 2, 1, 1, datetime.datetime(2024, 4, 22, 4, 8, 4, 944850), '10.128.2.8', '{"repo": "pushno", "namespace": "build_test", "notification_id": "37a609f6-18e0-4667-9e99-ed8347122ff4", "event": "repo_push", "method": "slack"}'])
gunicorn-web stdout | 2024-04-22 04:08:04,951 [278] [DEBUG] [app] Ending request: urn:request:7fc4ce3f-647d-4f92-85b2-0635d11387bc (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:7fc4ce3f-647d-4f92-85b2-0635d11387bc', 'remote_addr': '10.128.2.8', 'http_method': 'POST', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': {'event': 'repo_push', 'method': 'slack', 'config': {'url': 'https://hooks.slack.com/services/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'}, 'eventConfig': {}, 'title': 'push slack'}, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:08:04,952 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:08:04,952 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:08:04 +0000] "POST /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 201 262 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:08:04 +0000] "POST /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 201 262 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.049 1888 0.048)
gunicorn-web stdout | 2024-04-22 04:08:05,286 [278] [DEBUG] [app] Starting request: urn:request:90bc352a-00fd-462b-8b8d-dddb21a5ff5b (/api/v1/repository/build_test/pushno/tag/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:08:05,286 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:05,286 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:05,286 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:05,295 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:08:05,295 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:08:05,295 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:05,295 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:08:05,295 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:05,295 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:05,295 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:05,295 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:05,298 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:08:05,304 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:05,305 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:05,309 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:05,311 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:05,313 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:05,316 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."repository_id", "t1"."manifest_id", "t1"."lifetime_start_ms", "t1"."lifetime_end_ms", "t1"."hidden", "t1"."reversion", "t1"."tag_kind_id", "t1"."linked_tag_id", "t2"."id", "t2"."digest", "t2"."media_type_id", "t2"."layers_compressed_size", "t2"."config_media_type" FROM "tag" AS "t1" INNER JOIN "manifest" AS "t2" ON ("t1"."manifest_id" = "t2"."id") WHERE ((("t1"."repository_id" = %s) AND (("t1"."lifetime_end_ms" IS %s) OR ("t1"."lifetime_end_ms" > %s))) AND ("t1"."hidden" = %s)) ORDER BY "t1"."lifetime_start_ms" DESC, "t1"."name" LIMIT %s OFFSET %s', [1, None, 1713758885315, False, 101, 0])
gunicorn-web stdout | 2024-04-22 04:08:05,318 [278] [DEBUG] [app] Ending request: urn:request:90bc352a-00fd-462b-8b8d-dddb21a5ff5b (/api/v1/repository/build_test/pushno/tag/) {'endpoint': 'api.listrepositorytags', 'request_id': 'urn:request:90bc352a-00fd-462b-8b8d-dddb21a5ff5b', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true', 'path': '/api/v1/repository/build_test/pushno/tag/', 'parameters': {'limit': '100', 'page': '1', 'onlyActiveTags': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:08:05,319 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:08:05,319 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:08:05 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:08:05 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.1" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.034 1563 0.034)
logrotateworker stdout | 2024-04-22 04:08:05,752 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:08:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:08:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:26.873109+00:00 (in 21.000748 seconds)
securityworker stdout | 2024-04-22 04:08:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:35 UTC)" (scheduled at 2024-04-22 04:08:05.871852+00:00)
securityworker stdout | 2024-04-22 04:08:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:08:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:08:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:08:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:08:05,884 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:08:05,886 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:08:05,886 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:35 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:08:05,997 [278] [DEBUG] [app] Starting request: urn:request:d94c0b17-16dd-481d-bbb9-79acd9c59ca5 (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:08:05,997 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:05,997 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:05,998 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:06,007 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:08:06,007 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:08:06,007 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:06,007 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:08:06,007 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:06,007 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:06,008 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:06,008 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:06,010 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:08:06,016 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:06,016 [278] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:08:06,017 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:06,019 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:06,021 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:08:06,023 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:06,024 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:06,024 [278] [DEBUG] [app] Ending request: urn:request:d94c0b17-16dd-481d-bbb9-79acd9c59ca5 (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:d94c0b17-16dd-481d-bbb9-79acd9c59ca5', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeStats=true&includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeStats': 'true', 'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:08:06,025 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:08:06,025 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:08:06 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.0" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:08:06 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.1" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.029 1557 0.029)
gunicorn-web stdout | 2024-04-22 04:08:06,414 [282] [DEBUG] [app] Starting request: urn:request:cd71c323-d6b1-4da8-bb6d-cca32187d9c4 (/api/v1/repository/build_test/pushno/permissions/user/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:08:06,414 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:06,414 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:06,415 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:06,423 [278] [DEBUG] [app] Starting request: urn:request:5322d2c2-e443-48f9-b69b-1abfbdf8de07 (/api/v1/repository/build_test/pushno/permissions/team/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:08:06,423 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:06,423 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:06,423 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:06,424 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:08:06,424 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:08:06,424 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:06,424 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:08:06,424 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:06,425 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:06,425 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:06,425 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:06,427 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:08:06,431 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:08:06,432 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:08:06,432 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:06,432 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:08:06,432 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:06,432 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:06,432 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:06,432 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:06,434 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:06,434 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:08:06,434 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:06,437 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed", "t2"."id", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "user" AS "t1" ON ("t3"."user_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:08:06,440 [282] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."username" FROM "user" AS "t1" INNER JOIN "teammember" AS "t2" ON ("t2"."user_id" = "t1"."id") INNER JOIN "team" AS "t3" ON ("t2"."team_id" = "t3"."id") WHERE ((("t3"."organization_id" = %s) AND ("t1"."robot" = %s)) AND ("t1"."id" IN (%s)))', [2, False, 1])
gunicorn-web stdout | 2024-04-22 04:08:06,440 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:06,441 [278] [DEBUG] [peewee] ('SELECT "t1"."name", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "team" AS "t1" ON ("t3"."team_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:08:06,442 [282] [DEBUG] [app] Ending request: urn:request:cd71c323-d6b1-4da8-bb6d-cca32187d9c4 (/api/v1/repository/build_test/pushno/permissions/user/) {'endpoint': 'api.repositoryuserpermissionlist', 'request_id': 'urn:request:cd71c323-d6b1-4da8-bb6d-cca32187d9c4', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/user/', 'path': '/api/v1/repository/build_test/pushno/permissions/user/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:08:06,443 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:08:06 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.1" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1539 0.030)
gunicorn-web stdout | 2024-04-22 04:08:06,443 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:08:06 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.0" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:08:06,443 [278] [DEBUG] [app] Ending request: urn:request:5322d2c2-e443-48f9-b69b-1abfbdf8de07 (/api/v1/repository/build_test/pushno/permissions/team/) {'endpoint': 'api.repositoryteampermissionlist', 'request_id': 'urn:request:5322d2c2-e443-48f9-b69b-1abfbdf8de07', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/team/', 'path': '/api/v1/repository/build_test/pushno/permissions/team/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:08:06,444 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:08:06,444 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:08:06 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.0" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:08:06 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.1" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.022 1539 0.022)
repositorygcworker stdout | 2024-04-22 04:08:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:08:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:13.555667+00:00 (in 7.002670 seconds)
repositorygcworker stdout | 2024-04-22 04:08:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:06 UTC)" (scheduled at 2024-04-22 04:08:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:08:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:08:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 8, 6, 553443), True, datetime.datetime(2024, 4, 22, 4, 8, 6, 553443), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:08:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:08:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:08:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:06 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:08:06,942 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:08:06,993 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:08:07,116 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
gunicorn-web stdout | 2024-04-22 04:08:07,144 [278] [DEBUG] [app] Starting request: urn:request:cd1f2d30-52ab-4dfe-bb11-7d6c49fb7e8e (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:08:07,144 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:07,144 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:07,145 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:07,154 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:08:07,154 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:08:07,154 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:07,154 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:08:07,154 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:07,154 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:07,154 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:07,154 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:07,156 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:08:07,162 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:07,163 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:07,167 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t3"."username" = %s) AND ("t2"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:08:07,169 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:07,171 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [4, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:07,174 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:07,175 [282] [DEBUG] [app] Starting request: urn:request:6e620594-dabd-4903-b0e6-1a9c03c54f1a (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:08:07,175 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:07,175 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:07,176 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:07,176 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:07,178 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:07,180 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:07,182 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:07,184 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:07,185 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:08:07,185 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:08:07,185 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:07,185 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:08:07,185 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:07,186 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:07,186 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:07,186 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:07,186 [278] [DEBUG] [app] Ending request: urn:request:cd1f2d30-52ab-4dfe-bb11-7d6c49fb7e8e (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:cd1f2d30-52ab-4dfe-bb11-7d6c49fb7e8e', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:08:07,186 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:08:07,187 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:08:07 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 200 1138 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:08:07 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 200 1138 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.044 1535 0.044)
gunicorn-web stdout | 2024-04-22 04:08:07,188 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:08:07,194 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:07,195 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:07,199 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:08:07,203 [282] [DEBUG] [app] Ending request: urn:request:6e620594-dabd-4903-b0e6-1a9c03c54f1a (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:6e620594-dabd-4903-b0e6-1a9c03c54f1a', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:08:07,203 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:08:07,204 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:08:07 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:08:07 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1536 0.030)
blobuploadcleanupworker stdout | 2024-04-22 04:08:08,157 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:08:09,457 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:08:09,489 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:08:09,827 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:08:09,896 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:08:11,042 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:08:11,045 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:08:11,053 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:08:11,056 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:08:11,061 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:08:11,064 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:08:11,067 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:08:11,070 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:08:11,073 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
storagereplication stdout | 2024-04-22 04:08:11,212 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
autopruneworker stdout | 2024-04-22 04:08:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:08:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:41.264267+00:00 (in 29.999435 seconds)
autopruneworker stdout | 2024-04-22 04:08:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:41 UTC)" (scheduled at 2024-04-22 04:08:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:08:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758831271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:08:11,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:08:11,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:08:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:08:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:08:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:06.552482+00:00 (in 52.996302 seconds)
repositorygcworker stdout | 2024-04-22 04:08:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:13 UTC)" (scheduled at 2024-04-22 04:08:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:08:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:08:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:08:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:08:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:19.762160+00:00 (in 6.002304 seconds)
notificationworker stdout | 2024-04-22 04:08:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:08:23 UTC)" (scheduled at 2024-04-22 04:08:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:08:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:08:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 8, 13, 760279), True, datetime.datetime(2024, 4, 22, 4, 8, 13, 760279), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:08:13,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:08:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:08:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:08:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:08:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:08:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:44.952062+00:00 (in 29.999497 seconds)
gcworker stdout | 2024-04-22 04:08:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:44 UTC)" (scheduled at 2024-04-22 04:08:14.952062+00:00)
gcworker stdout | 2024-04-22 04:08:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549294952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:08:14,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:08:14,964 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:08:14,964 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:08:15,653 [281] [DEBUG] [app] Starting request: urn:request:f50bdfa0-bc0b-49c8-98b0-2d558c6490ed (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:08:15,653 [278] [DEBUG] [app] Starting request: urn:request:6e231928-7c35-4064-bc4f-f72117145688 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:08:15,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:08:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:08:15,656 [284] [DEBUG] [app] Starting request: urn:request:b17fd400-8e35-469b-8cac-d53dcf90c525 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:08:15,656 [289] [DEBUG] [app] Starting request: urn:request:43a59532-ed1a-49b8-b349-cc92e4ef42ec (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:08:15,656 [284] [DEBUG] [app] Ending request: urn:request:b17fd400-8e35-469b-8cac-d53dcf90c525 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b17fd400-8e35-469b-8cac-d53dcf90c525', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:08:15,656 [289] [DEBUG] [app] Ending request: urn:request:43a59532-ed1a-49b8-b349-cc92e4ef42ec (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:43a59532-ed1a-49b8-b349-cc92e4ef42ec', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:08:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:08:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:08:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:08:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:08:15,657 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:08:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:08:15,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:08:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:08:15,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:08:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:08:15,659 [278] [DEBUG] [app] Starting request: urn:request:3cec2523-678d-4f70-aad0-08335ae8d7bb (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:08:15,659 [278] [DEBUG] [app] Ending request: urn:request:3cec2523-678d-4f70-aad0-08335ae8d7bb (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3cec2523-678d-4f70-aad0-08335ae8d7bb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:08:15,659 [282] [DEBUG] [app] Starting request: urn:request:d187fd33-4a0e-46f0-8814-158983f2d158 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:08:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:08:15,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:08:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:08:15,660 [282] [DEBUG] [app] Ending request: urn:request:d187fd33-4a0e-46f0-8814-158983f2d158 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d187fd33-4a0e-46f0-8814-158983f2d158', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:08:15,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:08:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:08:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:08:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:08:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:08:15,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:08:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:08:15,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:08:15,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:08:15,673 [281] [DEBUG] [app] Ending request: urn:request:f50bdfa0-bc0b-49c8-98b0-2d558c6490ed (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f50bdfa0-bc0b-49c8-98b0-2d558c6490ed', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:08:15,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:08:15,674 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:08:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:08:15,674 [278] [DEBUG] [app] Ending request: urn:request:6e231928-7c35-4064-bc4f-f72117145688 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:6e231928-7c35-4064-bc4f-f72117145688', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:08:15,674 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:08:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:08:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:08:15,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:08:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:08:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:08:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:31.054492+00:00 (in 14.999488 seconds)
quotatotalworker stdout | 2024-04-22 04:08:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:08:31 UTC)" (scheduled at 2024-04-22 04:08:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:08:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:08:16,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:08:16,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:08:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:08:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:08:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:02.556208+00:00 (in 46.003341 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:08:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:16 UTC)" (scheduled at 2024-04-22 04:08:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:08:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:08:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 8, 16, 553307), True, datetime.datetime(2024, 4, 22, 4, 8, 16, 553307), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:08:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:08:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:08:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:08:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:08:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:47.052354+00:00 (in 29.999484 seconds)
buildlogsarchiver stdout | 2024-04-22 04:08:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:47 UTC)" (scheduled at 2024-04-22 04:08:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:08:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 8, 17, 53221), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:08:17,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:08:17,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:08:17,063 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:08:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:08:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:23.759375+00:00 (in 3.996659 seconds)
notificationworker stdout | 2024-04-22 04:08:19,762 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:13:19 UTC)" (scheduled at 2024-04-22 04:08:19.762160+00:00)
notificationworker stdout | 2024-04-22 04:08:19,763 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 8, 19, 763010), 'notification/%'])
notificationworker stdout | 2024-04-22 04:08:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:19 UTC)" (scheduled at 2024-04-22 04:08:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:08:19,764 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:08:19,764 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:19 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:08:19,772 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 8, 19, 763010), True, datetime.datetime(2024, 4, 22, 4, 8, 19, 763010), 0, 'notification/%'])
notificationworker stdout | 2024-04-22 04:08:19,775 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 8, 19, 763010), True, datetime.datetime(2024, 4, 22, 4, 8, 19, 763010), 0, 'notification/%', False, datetime.datetime(2024, 4, 22, 4, 8, 19, 763010), 'notification/%'])
notificationworker stdout | 2024-04-22 04:08:19,777 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:08:19,777 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:13:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:08:20,274 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:08:21,678 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 04:08:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:08:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:43.057186+00:00 (in 20.997661 seconds)
namespacegcworker stdout | 2024-04-22 04:08:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:22 UTC)" (scheduled at 2024-04-22 04:08:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:08:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:08:22,060 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:22 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:08:22,221 [278] [DEBUG] [app] Starting request: urn:request:d4df9396-a86f-4a45-b880-5af285632d2f (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:08:22,221 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:22,221 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:22,222 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:22,232 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:08:22,232 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:08:22,232 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:22,232 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:08:22,232 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:22,232 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:22,232 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:22,233 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:22,235 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:08:22,241 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:08:22,242 [278] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:08:22,243 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:22,245 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:08:22,248 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:08:22,250 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:22,250 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:08:22,250 [278] [DEBUG] [app] Ending request: urn:request:d4df9396-a86f-4a45-b880-5af285632d2f (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:d4df9396-a86f-4a45-b880-5af285632d2f', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:08:22,251 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:08:22,251 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:08:22 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.0" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:08:22 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.1" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.031 1565 0.031)
notificationworker stdout | 2024-04-22 04:08:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:08:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:33.759375+00:00 (in 9.999420 seconds)
notificationworker stdout | 2024-04-22 04:08:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:08:33 UTC)" (scheduled at 2024-04-22 04:08:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:08:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:08:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 8, 23, 760450), True, datetime.datetime(2024, 4, 22, 4, 8, 23, 760450), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:08:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:08:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:08:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:08:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:08:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:08:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:24.361582+00:00 (in 59.999458 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:08:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:24 UTC)" (scheduled at 2024-04-22 04:08:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:08:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:08:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:08:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:08:25,343 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:08:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:08:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:35.871852+00:00 (in 8.998284 seconds)
securityworker stdout | 2024-04-22 04:08:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:56 UTC)" (scheduled at 2024-04-22 04:08:26.873109+00:00)
securityworker stdout | 2024-04-22 04:08:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:08:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:08:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:08:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:08:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:08:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:08:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:08:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:08:26,882 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:08:26,892 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:08:26,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:08:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:08:26,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 3, 26, 882137), 1, 2])
securityworker stdout | 2024-04-22 04:08:26,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:08:26,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:08:26,898 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 3, 26, 882137), 1, 2])
securityworker stdout | 2024-04-22 04:08:26,901 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:08:26,901 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:08:26,901 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:08:26,901 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:08:26,901 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:08:26,901 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:08:26,901 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:08:26,902 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:08:26,902 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:08:26,902 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:08:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:08:27,113 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:08:28,311 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:08:28,448 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:08:30,144 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:08:30,147 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:08:30,152 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:08:30,162 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:08:30,165 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:08:30,363 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:08:30,448 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:08:30,653 [278] [DEBUG] [app] Starting request: urn:request:d4daf703-1db9-4e3c-a115-94cb61939a18 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:08:30,653 [279] [DEBUG] [app] Starting request: urn:request:cb664fea-82fc-48d3-b044-da0295b18ce3 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:08:30,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:08:30,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:08:30,656 [284] [DEBUG] [app] Starting request: urn:request:eeb61b98-6f15-4854-86cd-b7659fe732e0 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:08:30,656 [292] [DEBUG] [app] Starting request: urn:request:77fc0d33-f24d-44ac-b6db-1805ecf7a477 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:08:30,657 [284] [DEBUG] [app] Ending request: urn:request:eeb61b98-6f15-4854-86cd-b7659fe732e0 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:eeb61b98-6f15-4854-86cd-b7659fe732e0', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:08:30,657 [292] [DEBUG] [app] Ending request: urn:request:77fc0d33-f24d-44ac-b6db-1805ecf7a477 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:77fc0d33-f24d-44ac-b6db-1805ecf7a477', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:08:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:08:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:08:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:08:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:08:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:08:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:08:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:08:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:08:30,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:08:30,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:08:30,659 [279] [DEBUG] [app] Starting request: urn:request:7b0f839b-aadc-4e8f-b837-ada9014ea8ad (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:08:30,660 [279] [DEBUG] [app] Ending request: urn:request:7b0f839b-aadc-4e8f-b837-ada9014ea8ad (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:7b0f839b-aadc-4e8f-b837-ada9014ea8ad', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:08:30,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:08:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:08:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:08:30,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:08:30,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:08:30,660 [281] [DEBUG] [app] Starting request: urn:request:4f260944-a9c1-4654-bf01-7ba11930cdc2 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:08:30,661 [281] [DEBUG] [app] Ending request: urn:request:4f260944-a9c1-4654-bf01-7ba11930cdc2 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:4f260944-a9c1-4654-bf01-7ba11930cdc2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:08:30,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:08:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:08:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:08:30,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:08:30,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:08:30,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:08:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:08:30,674 [279] [DEBUG] [app] Ending request: urn:request:cb664fea-82fc-48d3-b044-da0295b18ce3 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:cb664fea-82fc-48d3-b044-da0295b18ce3', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:08:30,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:08:30,674 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:08:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:08:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:08:30,675 [278] [DEBUG] [app] Ending request: urn:request:d4daf703-1db9-4e3c-a115-94cb61939a18 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:d4daf703-1db9-4e3c-a115-94cb61939a18', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:08:30,675 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:08:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:08:30,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:08:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:08:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:08:31,054 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:46.054492+00:00 (in 14.999522 seconds)
quotatotalworker stdout | 2024-04-22 04:08:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:08:46 UTC)" (scheduled at 2024-04-22 04:08:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:08:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:08:31,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:08:31,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:08:46 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:08:31,315 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:08:32,865 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:08:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:08:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:43.759375+00:00 (in 9.999468 seconds)
notificationworker stdout | 2024-04-22 04:08:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:08:43 UTC)" (scheduled at 2024-04-22 04:08:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:08:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:08:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 8, 33, 760321), True, datetime.datetime(2024, 4, 22, 4, 8, 33, 760321), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:08:33,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:08:33,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:08:33,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:08:43 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:08:34,256 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:08:34,508 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:08:34,735 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:08:34,738 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:08:34,741 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:08:34,744 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:08:35,788 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:08:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:08:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:56.873109+00:00 (in 21.000732 seconds)
securityworker stdout | 2024-04-22 04:08:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:05 UTC)" (scheduled at 2024-04-22 04:08:35.871852+00:00)
securityworker stdout | 2024-04-22 04:08:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:08:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:08:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:08:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:08:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:08:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:08:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:08:36,976 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:08:37,023 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:08:37,147 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:08:38,171 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:08:39,492 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:08:39,511 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
exportactionlogsworker stdout | 2024-04-22 04:08:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:08:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:41.564959+00:00 (in 1.997511 seconds)
exportactionlogsworker stdout | 2024-04-22 04:08:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:39 UTC)" (scheduled at 2024-04-22 04:08:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:08:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:08:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:39 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:08:39,856 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:08:39,932 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:08:41,053 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:08:41,056 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:08:41,062 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:08:41,065 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:08:41,071 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:08:41,074 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:08:41,077 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:08:41,080 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:08:41,083 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
storagereplication stdout | 2024-04-22 04:08:41,248 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
autopruneworker stdout | 2024-04-22 04:08:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:08:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:11.264267+00:00 (in 29.999516 seconds)
autopruneworker stdout | 2024-04-22 04:08:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:11 UTC)" (scheduled at 2024-04-22 04:08:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:08:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758861271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:08:41,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:08:41,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:08:41,275 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:08:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:08:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:39.566970+00:00 (in 58.001498 seconds)
exportactionlogsworker stdout | 2024-04-22 04:08:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:41 UTC)" (scheduled at 2024-04-22 04:08:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:08:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:08:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 8, 41, 565746), True, datetime.datetime(2024, 4, 22, 4, 8, 41, 565746), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:08:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:08:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:08:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:08:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:08:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:22.058978+00:00 (in 39.001259 seconds)
namespacegcworker stdout | 2024-04-22 04:08:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:43 UTC)" (scheduled at 2024-04-22 04:08:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:08:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:08:43,059 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 8, 43, 58170), True, datetime.datetime(2024, 4, 22, 4, 8, 43, 58170), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:08:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:08:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:08:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:09:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:08:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:08:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:08:53.759375+00:00 (in 9.999522 seconds)
notificationworker stdout | 2024-04-22 04:08:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:08:53 UTC)" (scheduled at 2024-04-22 04:08:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:08:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:08:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 8, 43, 760295), True, datetime.datetime(2024, 4, 22, 4, 8, 43, 760295), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:08:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:08:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:08:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:08:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:08:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:08:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:14.952062+00:00 (in 29.999492 seconds)
gcworker stdout | 2024-04-22 04:08:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:14 UTC)" (scheduled at 2024-04-22 04:08:44.952062+00:00)
gcworker stdout | 2024-04-22 04:08:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549324952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:08:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:08:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:08:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:08:45,653 [282] [DEBUG] [app] Starting request: urn:request:dc54f5dd-e48c-4875-9df1-7ccc1d9616d8 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:08:45,653 [281] [DEBUG] [app] Starting request: urn:request:10e7d6b8-f74b-4d32-bab4-bbc0a9b3cfa4 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:08:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:08:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:08:45,656 [289] [DEBUG] [app] Starting request: urn:request:941b1411-3e9d-4996-bdd7-7905a1ce44a7 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:08:45,656 [292] [DEBUG] [app] Starting request: urn:request:e42ee474-3ca0-48f9-a9e7-c65d31c51061 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:08:45,656 [292] [DEBUG] [app] Ending request: urn:request:e42ee474-3ca0-48f9-a9e7-c65d31c51061 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:e42ee474-3ca0-48f9-a9e7-c65d31c51061', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:08:45,656 [289] [DEBUG] [app] Ending request: urn:request:941b1411-3e9d-4996-bdd7-7905a1ce44a7 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:941b1411-3e9d-4996-bdd7-7905a1ce44a7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:08:45,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:08:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:08:45,657 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:08:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:08:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:08:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:08:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:08:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:08:45,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:08:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:08:45,660 [278] [DEBUG] [app] Starting request: urn:request:b041406e-0a71-4e0d-93cf-55874c670a4a (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:08:45,660 [279] [DEBUG] [app] Starting request: urn:request:fe613226-4c9f-4c32-8c96-1f3939f07fd5 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:08:45,660 [278] [DEBUG] [app] Ending request: urn:request:b041406e-0a71-4e0d-93cf-55874c670a4a (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b041406e-0a71-4e0d-93cf-55874c670a4a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:08:45,660 [279] [DEBUG] [app] Ending request: urn:request:fe613226-4c9f-4c32-8c96-1f3939f07fd5 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:fe613226-4c9f-4c32-8c96-1f3939f07fd5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:08:45,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:08:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:08:45,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:08:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:08:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:08:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:08:45,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:08:45,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:08:45,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:08:45,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:08:45,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:08:45,669 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:08:45,675 [282] [DEBUG] [app] Ending request: urn:request:dc54f5dd-e48c-4875-9df1-7ccc1d9616d8 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:dc54f5dd-e48c-4875-9df1-7ccc1d9616d8', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:08:45,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:08:45,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:08:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:08:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:08:45,676 [281] [DEBUG] [app] Ending request: urn:request:10e7d6b8-f74b-4d32-bab4-bbc0a9b3cfa4 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:10e7d6b8-f74b-4d32-bab4-bbc0a9b3cfa4', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:08:45,677 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:08:45,677 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:08:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:08:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
quotatotalworker stdout | 2024-04-22 04:08:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:08:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:01.054492+00:00 (in 14.999490 seconds)
quotatotalworker stdout | 2024-04-22 04:08:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:09:01 UTC)" (scheduled at 2024-04-22 04:08:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:08:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:08:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:08:46,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:09:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:08:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:08:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:17.052354+00:00 (in 29.999466 seconds)
buildlogsarchiver stdout | 2024-04-22 04:08:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:17 UTC)" (scheduled at 2024-04-22 04:08:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:08:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 8, 47, 53253), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:08:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:08:47,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:08:47,063 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:08:50,291 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:08:51,698 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:08:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:08:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:03.759375+00:00 (in 9.999484 seconds)
notificationworker stdout | 2024-04-22 04:08:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:09:03 UTC)" (scheduled at 2024-04-22 04:08:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:08:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:08:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 8, 53, 760326), True, datetime.datetime(2024, 4, 22, 4, 8, 53, 760326), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:08:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:08:53,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:08:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:09:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:08:55,380 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:08:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:08:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:05.871852+00:00 (in 8.998278 seconds)
securityworker stdout | 2024-04-22 04:08:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:26 UTC)" (scheduled at 2024-04-22 04:08:56.873109+00:00)
securityworker stdout | 2024-04-22 04:08:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:08:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:08:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:08:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:08:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:08:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:08:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:08:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:08:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:08:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:08:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:08:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:08:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 3, 56, 880903), 1, 2])
securityworker stdout | 2024-04-22 04:08:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:08:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:08:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 3, 56, 880903), 1, 2])
securityworker stdout | 2024-04-22 04:08:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:08:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:08:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:08:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:08:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:08:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:08:56,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:08:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:08:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:08:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:08:57,137 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:08:58,320 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:08:58,455 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:09:00,155 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:09:00,158 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:09:00,160 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:09:00,174 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:09:00,177 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:09:00,371 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:09:00,481 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:09:00,652 [278] [DEBUG] [app] Starting request: urn:request:d6753470-97d0-460c-ba5d-d7c4d0fc2e64 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:09:00,653 [279] [DEBUG] [app] Starting request: urn:request:cc688136-6941-4d82-8455-a31edd9fa3ec (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:09:00,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:09:00,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:09:00,656 [284] [DEBUG] [app] Starting request: urn:request:61667dc4-f703-4ff8-8720-133d44605f66 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:09:00,656 [291] [DEBUG] [app] Starting request: urn:request:7cff7e18-ebf7-48cd-97c7-d4118bf1d231 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:09:00,656 [291] [DEBUG] [app] Ending request: urn:request:7cff7e18-ebf7-48cd-97c7-d4118bf1d231 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7cff7e18-ebf7-48cd-97c7-d4118bf1d231', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:09:00,656 [284] [DEBUG] [app] Ending request: urn:request:61667dc4-f703-4ff8-8720-133d44605f66 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:61667dc4-f703-4ff8-8720-133d44605f66', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:09:00,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:09:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:09:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:09:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:09:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:09:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:09:00,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:09:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:09:00,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:09:00,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:09:00,659 [279] [DEBUG] [app] Starting request: urn:request:9c66f672-c504-4840-ab6a-f9d715a37a66 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:09:00,659 [279] [DEBUG] [app] Ending request: urn:request:9c66f672-c504-4840-ab6a-f9d715a37a66 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9c66f672-c504-4840-ab6a-f9d715a37a66', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:09:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:09:00,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:09:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:09:00,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:09:00,660 [282] [DEBUG] [app] Starting request: urn:request:18375ab2-eaf8-4c1f-abc6-d3ee0bc3e1f7 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:09:00,661 [282] [DEBUG] [app] Ending request: urn:request:18375ab2-eaf8-4c1f-abc6-d3ee0bc3e1f7 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:18375ab2-eaf8-4c1f-abc6-d3ee0bc3e1f7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:09:00,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:09:00,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:09:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:09:00,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:09:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.001)
gunicorn-web stdout | 2024-04-22 04:09:00,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:09:00,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:09:00,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:09:00,674 [279] [DEBUG] [app] Ending request: urn:request:cc688136-6941-4d82-8455-a31edd9fa3ec (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:cc688136-6941-4d82-8455-a31edd9fa3ec', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:09:00,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:00,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:09:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:09:00,675 [278] [DEBUG] [app] Ending request: urn:request:d6753470-97d0-460c-ba5d-d7c4d0fc2e64 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:d6753470-97d0-460c-ba5d-d7c4d0fc2e64', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:09:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:09:00,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:00,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:09:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:09:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotatotalworker stdout | 2024-04-22 04:09:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:09:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:16.054492+00:00 (in 14.999490 seconds)
quotatotalworker stdout | 2024-04-22 04:09:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:09:16 UTC)" (scheduled at 2024-04-22 04:09:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:09:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:09:01,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:09:01,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:09:16 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:09:01,342 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:09:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:09:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:16.552337+00:00 (in 13.995608 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:09:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:02 UTC)" (scheduled at 2024-04-22 04:09:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:09:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:09:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:09:02,875 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:09:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:09:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:13.759375+00:00 (in 9.999414 seconds)
notificationworker stdout | 2024-04-22 04:09:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:09:13 UTC)" (scheduled at 2024-04-22 04:09:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:09:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:09:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 9, 3, 760389), True, datetime.datetime(2024, 4, 22, 4, 9, 3, 760389), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:09:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:09:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:09:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:09:13 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:09:04,270 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:09:04,533 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
gunicorn-secscan stdout | 2024-04-22 04:09:04,747 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:09:04,750 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
exportactionlogsworker stdout | 2024-04-22 04:09:04,752 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-secscan stdout | 2024-04-22 04:09:04,755 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
logrotateworker stdout | 2024-04-22 04:09:05,816 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:09:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:09:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:26.873109+00:00 (in 21.000745 seconds)
securityworker stdout | 2024-04-22 04:09:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:35 UTC)" (scheduled at 2024-04-22 04:09:05.871852+00:00)
securityworker stdout | 2024-04-22 04:09:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:09:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:09:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:09:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:09:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:09:05,886 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:09:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:35 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:09:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:09:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:13.555667+00:00 (in 7.002659 seconds)
repositorygcworker stdout | 2024-04-22 04:09:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:06 UTC)" (scheduled at 2024-04-22 04:09:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:09:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:09:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 9, 6, 553405), True, datetime.datetime(2024, 4, 22, 4, 9, 6, 553405), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:09:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:09:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:09:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:06 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:09:07,014 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:09:07,031 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:09:07,183 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
gunicorn-web stdout | 2024-04-22 04:09:07,308 [282] [DEBUG] [app] Starting request: urn:request:3a4a6381-c6ca-4698-8d96-bda44ef71ba9 (/api/v1/organization/build_test) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:09:07,309 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:07,309 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:07,309 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:07,319 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:07,319 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:07,319 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:07,320 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:07,322 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:07,322 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:07,322 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:07,322 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:07,323 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:09:07,327 [282] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:07,327 [282] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:07,327 [282] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:07,327 [282] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:09:07,328 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t2" ON ("t1"."role_id" = "t2"."id") WHERE ("t1"."organization_id" = %s)', [2])
gunicorn-web stdout | 2024-04-22 04:09:07,330 [282] [DEBUG] [peewee] ('SELECT "t1"."team_id", Count("t1"."id") FROM "repositorypermission" AS "t1" WHERE ("t1"."team_id" IN (%s)) GROUP BY "t1"."team_id"', [1])
gunicorn-web stdout | 2024-04-22 04:09:07,332 [282] [DEBUG] [peewee] ('SELECT "t1"."team_id", Count("t1"."id") FROM "teammember" AS "t1" WHERE ("t1"."team_id" IN (%s)) GROUP BY "t1"."team_id"', [1])
gunicorn-web stdout | 2024-04-22 04:09:07,334 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:07,334 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:07,334 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:07,334 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['build_test'])
gunicorn-web stdout | 2024-04-22 04:09:07,337 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['build_test', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:07,339 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['build_test'])
gunicorn-web stdout | 2024-04-22 04:09:07,341 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."size_bytes", "t1"."backfill_start_ms", "t1"."backfill_complete" FROM "quotanamespacesize" AS "t1" WHERE ("t1"."namespace_user_id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:07,343 [282] [DEBUG] [app] Ending request: urn:request:3a4a6381-c6ca-4698-8d96-bda44ef71ba9 (/api/v1/organization/build_test) {'endpoint': 'api.organization', 'request_id': 'urn:request:3a4a6381-c6ca-4698-8d96-bda44ef71ba9', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/organization/build_test', 'path': '/api/v1/organization/build_test', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:07,344 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:07,344 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:09:07 +0000] "GET /api/v1/organization/build_test HTTP/1.0" 200 805 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:09:07 +0000] "GET /api/v1/organization/build_test HTTP/1.1" 200 805 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.037 1523 0.037)
blobuploadcleanupworker stdout | 2024-04-22 04:09:08,181 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:09:09,528 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:09:09,535 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:09:09,892 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:09:09,953 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:09:11,063 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:09:11,067 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:09:11,072 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:09:11,075 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:09:11,080 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:09:11,083 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:09:11,085 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:09:11,088 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:09:11,091 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
storagereplication stdout | 2024-04-22 04:09:11,260 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
autopruneworker stdout | 2024-04-22 04:09:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:09:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:41.264267+00:00 (in 29.999544 seconds)
autopruneworker stdout | 2024-04-22 04:09:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:41 UTC)" (scheduled at 2024-04-22 04:09:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:09:11,271 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758891271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:09:11,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:09:11,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:09:11,275 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:41 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:09:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:09:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:06.552482+00:00 (in 52.996380 seconds)
repositorygcworker stdout | 2024-04-22 04:09:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:13 UTC)" (scheduled at 2024-04-22 04:09:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:09:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:09:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:09:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:09:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:19.762424+00:00 (in 6.002573 seconds)
notificationworker stdout | 2024-04-22 04:09:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:09:23 UTC)" (scheduled at 2024-04-22 04:09:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:09:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:09:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 9, 13, 760239), True, datetime.datetime(2024, 4, 22, 4, 9, 13, 760239), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:09:13,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:09:13,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:09:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:09:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:09:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:09:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:44.952062+00:00 (in 29.999474 seconds)
gcworker stdout | 2024-04-22 04:09:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:44 UTC)" (scheduled at 2024-04-22 04:09:14.952062+00:00)
gcworker stdout | 2024-04-22 04:09:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549354953, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:09:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:09:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:09:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:09:15,653 [278] [DEBUG] [app] Starting request: urn:request:b5e19d58-f693-4ded-b625-7d0f680cd7c3 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:09:15,653 [279] [DEBUG] [app] Starting request: urn:request:c8215f98-7d42-4112-8485-4a6ad16d140b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:09:15,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:09:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:09:15,656 [292] [DEBUG] [app] Starting request: urn:request:da63bb4a-33e1-4118-a09e-c2902fc51ed5 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:09:15,656 [284] [DEBUG] [app] Starting request: urn:request:1452be35-6b2d-4d63-aa70-cfae8cb2dc3a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:09:15,656 [292] [DEBUG] [app] Ending request: urn:request:da63bb4a-33e1-4118-a09e-c2902fc51ed5 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:da63bb4a-33e1-4118-a09e-c2902fc51ed5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:09:15,656 [284] [DEBUG] [app] Ending request: urn:request:1452be35-6b2d-4d63-aa70-cfae8cb2dc3a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:1452be35-6b2d-4d63-aa70-cfae8cb2dc3a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:09:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:09:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:09:15,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:09:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:09:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:09:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:09:15,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:09:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:09:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:09:15,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:09:15,659 [278] [DEBUG] [app] Starting request: urn:request:d4cc765e-9250-4107-bba0-dc2ab7525a35 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:09:15,659 [278] [DEBUG] [app] Ending request: urn:request:d4cc765e-9250-4107-bba0-dc2ab7525a35 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d4cc765e-9250-4107-bba0-dc2ab7525a35', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:09:15,659 [282] [DEBUG] [app] Starting request: urn:request:8654a77c-f4cb-4582-9b2f-29ea2ab40eb1 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:09:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:09:15,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:09:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:09:15,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:09:15,660 [282] [DEBUG] [app] Ending request: urn:request:8654a77c-f4cb-4582-9b2f-29ea2ab40eb1 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:8654a77c-f4cb-4582-9b2f-29ea2ab40eb1', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:09:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:09:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:09:15,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:09:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:09:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:09:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:09:15,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:09:15,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:09:15,673 [279] [DEBUG] [app] Ending request: urn:request:c8215f98-7d42-4112-8485-4a6ad16d140b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:c8215f98-7d42-4112-8485-4a6ad16d140b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:09:15,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:15,674 [278] [DEBUG] [app] Ending request: urn:request:b5e19d58-f693-4ded-b625-7d0f680cd7c3 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b5e19d58-f693-4ded-b625-7d0f680cd7c3', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:09:15,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:15,674 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:09:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:09:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:09:15,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:09:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:09:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
quotatotalworker stdout | 2024-04-22 04:09:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:09:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:31.054492+00:00 (in 14.999475 seconds)
quotatotalworker stdout | 2024-04-22 04:09:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:09:31 UTC)" (scheduled at 2024-04-22 04:09:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:09:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:09:16,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:09:16,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:09:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:09:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:09:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:02.556208+00:00 (in 46.003278 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:09:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:16 UTC)" (scheduled at 2024-04-22 04:09:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:09:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:09:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 9, 16, 553330), True, datetime.datetime(2024, 4, 22, 4, 9, 16, 553330), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:09:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:09:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:09:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:09:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:09:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:47.052354+00:00 (in 29.999465 seconds)
buildlogsarchiver stdout | 2024-04-22 04:09:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:47 UTC)" (scheduled at 2024-04-22 04:09:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:09:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 9, 17, 53255), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:09:17,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:09:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:09:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:47 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:09:17,336 [281] [DEBUG] [app] Starting request: urn:request:384ea4f7-45f3-4d01-a1d0-308e0d0d86a8 (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:09:17,336 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:17,336 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:17,337 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:17,345 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:17,345 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:17,345 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:17,346 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:17,346 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:17,346 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:17,346 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:17,346 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:17,348 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:17,354 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:17,355 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:17,359 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description" FROM "team" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") WHERE ((("t1"."name" = %s) AND ("t2"."organization" = %s)) AND ("t2"."username" = %s)) LIMIT %s', ['owners', True, 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:17,361 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:17,364 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['vulnerability_found', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:17,366 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['quay_notification', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:17,368 [281] [DEBUG] [peewee] ('INSERT INTO "repositorynotification" ("uuid", "repository_id", "event_id", "method_id", "title", "config_json", "event_config_json", "number_of_failures") VALUES (%s, %s, %s, %s, %s, %s, %s, %s) RETURNING "repositorynotification"."id"', ['f1b7c257-8b4f-4497-9b0d-ec5a64ad3ebc', 1, 6, 4, 'vul quay', '{"target": {"name": "owners", "kind": "team", "is_robot": false, "avatar": {"name": "owners", "hash": "6f0e3a8c0eb46e8834b43b03374ece43a030621d92a7437beb48f871e90f8d90", "color": "#c7c7c7", "kind": "team"}, "is_org_member": true}}', '{"level": "2"}', 0])
gunicorn-web stdout | 2024-04-22 04:09:17,373 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:17,375 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:17,378 [281] [DEBUG] [peewee] ('INSERT INTO "logentry3" ("kind_id", "account_id", "performer_id", "repository_id", "datetime", "ip", "metadata_json") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "logentry3"."id"', [6, 2, 1, 1, datetime.datetime(2024, 4, 22, 4, 9, 17, 375488), '10.131.0.9', '{"repo": "pushno", "namespace": "build_test", "notification_id": "f1b7c257-8b4f-4497-9b0d-ec5a64ad3ebc", "event": "vulnerability_found", "method": "quay_notification"}'])
gunicorn-web stdout | 2024-04-22 04:09:17,382 [281] [DEBUG] [app] Ending request: urn:request:384ea4f7-45f3-4d01-a1d0-308e0d0d86a8 (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:384ea4f7-45f3-4d01-a1d0-308e0d0d86a8', 'remote_addr': '10.131.0.9', 'http_method': 'POST', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': {'event': 'vulnerability_found', 'method': 'quay_notification', 'config': {'target': {'name': 'owners', 'kind': 'team', 'is_robot': False, 'avatar': {'name': 'owners', 'hash': '6f0e3a8c0eb46e8834b43b03374ece43a030621d92a7437beb48f871e90f8d90', 'color': '#c7c7c7', 'kind': 'team'}, 'is_org_member': True}}, 'eventConfig': {'level': '2'}, 'title': 'vul quay'}, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:17,382 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:17,382 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:09:17 +0000] "POST /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 201 432 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:09:17 +0000] "POST /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 201 432 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.049 2041 0.048)
gunicorn-web stdout | 2024-04-22 04:09:17,806 [278] [DEBUG] [app] Starting request: urn:request:eb0036c7-1818-4a9d-a7ff-feb839a399ea (/api/v1/repository/build_test/pushno/tag/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:09:17,806 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:17,807 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:17,807 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:17,816 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:17,816 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:17,816 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:17,816 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:17,816 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:17,816 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:17,816 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:17,816 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:17,819 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:17,825 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:17,826 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:17,830 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:17,832 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:17,834 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:17,837 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."repository_id", "t1"."manifest_id", "t1"."lifetime_start_ms", "t1"."lifetime_end_ms", "t1"."hidden", "t1"."reversion", "t1"."tag_kind_id", "t1"."linked_tag_id", "t2"."id", "t2"."digest", "t2"."media_type_id", "t2"."layers_compressed_size", "t2"."config_media_type" FROM "tag" AS "t1" INNER JOIN "manifest" AS "t2" ON ("t1"."manifest_id" = "t2"."id") WHERE ((("t1"."repository_id" = %s) AND (("t1"."lifetime_end_ms" IS %s) OR ("t1"."lifetime_end_ms" > %s))) AND ("t1"."hidden" = %s)) ORDER BY "t1"."lifetime_start_ms" DESC, "t1"."name" LIMIT %s OFFSET %s', [1, None, 1713758957836, False, 101, 0])
gunicorn-web stdout | 2024-04-22 04:09:17,840 [278] [DEBUG] [app] Ending request: urn:request:eb0036c7-1818-4a9d-a7ff-feb839a399ea (/api/v1/repository/build_test/pushno/tag/) {'endpoint': 'api.listrepositorytags', 'request_id': 'urn:request:eb0036c7-1818-4a9d-a7ff-feb839a399ea', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true', 'path': '/api/v1/repository/build_test/pushno/tag/', 'parameters': {'limit': '100', 'page': '1', 'onlyActiveTags': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:17,840 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:17,840 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:09:17 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:09:17 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.1" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.035 1563 0.035)
gunicorn-web stdout | 2024-04-22 04:09:18,507 [281] [DEBUG] [app] Starting request: urn:request:43d01687-a069-48a1-9ad4-2d8067336bf5 (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:09:18,507 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:18,507 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:18,508 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:18,518 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:18,518 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:18,518 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:18,518 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:18,518 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:18,518 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:18,518 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:18,518 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:18,520 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:18,527 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:18,527 [281] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:18,527 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:18,530 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:18,532 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:09:18,534 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:18,534 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:18,535 [281] [DEBUG] [app] Ending request: urn:request:43d01687-a069-48a1-9ad4-2d8067336bf5 (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:43d01687-a069-48a1-9ad4-2d8067336bf5', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeStats=true&includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeStats': 'true', 'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:18,535 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:18,536 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:09:18 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.0" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:09:18 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.1" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1557 0.030)
gunicorn-web stdout | 2024-04-22 04:09:18,948 [278] [DEBUG] [app] Starting request: urn:request:087174db-a320-4f7f-a970-cbdfe97cbeaa (/api/v1/repository/build_test/pushno/permissions/user/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:09:18,948 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:18,949 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:18,949 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:18,952 [281] [DEBUG] [app] Starting request: urn:request:2a841d22-0d60-410b-93d4-fa41b02a1279 (/api/v1/repository/build_test/pushno/permissions/team/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:09:18,952 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:18,952 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:18,953 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:18,958 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:18,958 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:18,958 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:18,958 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:18,958 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:18,958 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:18,958 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:18,958 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:18,960 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:18,961 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:18,961 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:18,961 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:18,961 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:18,961 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:18,962 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:18,962 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:18,962 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:18,964 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:18,966 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:18,967 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:18,970 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:18,970 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed", "t2"."id", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "user" AS "t1" ON ("t3"."user_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:09:18,970 [281] [DEBUG] [peewee] ('SELECT "t1"."name", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "team" AS "t1" ON ("t3"."team_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:09:18,972 [278] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."username" FROM "user" AS "t1" INNER JOIN "teammember" AS "t2" ON ("t2"."user_id" = "t1"."id") INNER JOIN "team" AS "t3" ON ("t2"."team_id" = "t3"."id") WHERE ((("t3"."organization_id" = %s) AND ("t1"."robot" = %s)) AND ("t1"."id" IN (%s)))', [2, False, 1])
gunicorn-web stdout | 2024-04-22 04:09:18,973 [281] [DEBUG] [app] Ending request: urn:request:2a841d22-0d60-410b-93d4-fa41b02a1279 (/api/v1/repository/build_test/pushno/permissions/team/) {'endpoint': 'api.repositoryteampermissionlist', 'request_id': 'urn:request:2a841d22-0d60-410b-93d4-fa41b02a1279', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/team/', 'path': '/api/v1/repository/build_test/pushno/permissions/team/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:18,973 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:18,973 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:09:18 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.0" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:09:18 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.1" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.022 1539 0.022)
gunicorn-web stdout | 2024-04-22 04:09:18,975 [278] [DEBUG] [app] Ending request: urn:request:087174db-a320-4f7f-a970-cbdfe97cbeaa (/api/v1/repository/build_test/pushno/permissions/user/) {'endpoint': 'api.repositoryuserpermissionlist', 'request_id': 'urn:request:087174db-a320-4f7f-a970-cbdfe97cbeaa', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/user/', 'path': '/api/v1/repository/build_test/pushno/permissions/user/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:18,975 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:09:18 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.1" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.028 1539 0.029)
gunicorn-web stdout | 2024-04-22 04:09:18,976 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:09:18 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.0" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:09:19,677 [278] [DEBUG] [app] Starting request: urn:request:a50beef2-ea8f-4458-8231-5ece2074ba95 (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:09:19,677 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:19,677 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:19,678 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:19,687 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:19,687 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:19,687 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:19,687 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:19,688 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:19,688 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:19,688 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:19,688 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:19,690 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:19,696 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:19,697 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:19,700 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t3"."username" = %s) AND ("t2"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:09:19,703 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:19,705 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [4, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:19,707 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:19,709 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:19,711 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:19,712 [281] [DEBUG] [app] Starting request: urn:request:96836e38-ecf7-4c58-8ad8-89c3b321e586 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:09:19,712 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:19,712 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:19,713 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:19,713 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:19,715 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:19,717 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:19,719 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:19,721 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [4, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:19,721 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:19,722 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:19,722 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:19,722 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:19,722 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:19,722 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:19,722 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:19,722 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:19,723 [278] [DEBUG] [app] Ending request: urn:request:a50beef2-ea8f-4458-8231-5ece2074ba95 (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:a50beef2-ea8f-4458-8231-5ece2074ba95', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:19,724 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:19,724 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:09:19 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 200 1571 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.049 1535 0.048)
gunicorn-web stdout | 2024-04-22 04:09:19,724 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:09:19 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 200 1571 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:09:19,730 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:19,731 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:19,736 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:09:19,740 [281] [DEBUG] [app] Ending request: urn:request:96836e38-ecf7-4c58-8ad8-89c3b321e586 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:96836e38-ecf7-4c58-8ad8-89c3b321e586', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:19,740 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:19,740 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:09:19 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:09:19 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.029 1536 0.029)
notificationworker stdout | 2024-04-22 04:09:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:09:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:23.759375+00:00 (in 3.996484 seconds)
notificationworker stdout | 2024-04-22 04:09:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:19 UTC)" (scheduled at 2024-04-22 04:09:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:09:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:09:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:09:20,328 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
gunicorn-web stdout | 2024-04-22 04:09:21,058 [278] [DEBUG] [app] Starting request: urn:request:107d7b1a-f276-4027-8da2-0c95a34c91b9 (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:09:21,058 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:21,059 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:21,059 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:21,068 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:21,069 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:21,069 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:21,069 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:21,069 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:21,069 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:21,069 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:21,069 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:21,071 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:21,077 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:21,077 [278] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:21,078 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:21,080 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:21,083 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:09:21,085 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:21,085 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:21,085 [278] [DEBUG] [app] Ending request: urn:request:107d7b1a-f276-4027-8da2-0c95a34c91b9 (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:107d7b1a-f276-4027-8da2-0c95a34c91b9', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:21,086 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:21,086 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:09:21 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.0" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:09:21 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.1" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.029 1546 0.029)
securityscanningnotificationworker stdout | 2024-04-22 04:09:21,712 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 04:09:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:09:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:43.057186+00:00 (in 20.997652 seconds)
namespacegcworker stdout | 2024-04-22 04:09:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:22 UTC)" (scheduled at 2024-04-22 04:09:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:09:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:09:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:09:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:09:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:33.759375+00:00 (in 9.999475 seconds)
notificationworker stdout | 2024-04-22 04:09:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:09:33 UTC)" (scheduled at 2024-04-22 04:09:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:09:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:09:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 9, 23, 760346), True, datetime.datetime(2024, 4, 22, 4, 9, 23, 760346), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:09:23,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:09:23,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:09:23,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:09:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:09:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:09:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:24.361582+00:00 (in 59.999498 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:09:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:24 UTC)" (scheduled at 2024-04-22 04:09:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:09:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:09:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:09:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:09:25,390 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:09:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:09:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:35.871852+00:00 (in 8.998200 seconds)
securityworker stdout | 2024-04-22 04:09:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:56 UTC)" (scheduled at 2024-04-22 04:09:26.873109+00:00)
securityworker stdout | 2024-04-22 04:09:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:09:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:09:26,875 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:09:26,875 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:09:26,875 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:09:26,876 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:09:26,876 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:09:26,878 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:09:26,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:09:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:09:26,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:09:26,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:09:26,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 4, 26, 880280), 1, 2])
securityworker stdout | 2024-04-22 04:09:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:09:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:09:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 4, 26, 880280), 1, 2])
securityworker stdout | 2024-04-22 04:09:26,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:09:26,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:09:26,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:09:26,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:09:26,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:09:26,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:09:26,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:09:26,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:09:26,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:09:26,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:09:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:09:27,170 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:09:28,355 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:09:28,463 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:09:30,166 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:09:30,169 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:09:30,172 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:09:30,185 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:09:30,188 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:09:30,400 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:09:30,501 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:09:30,653 [279] [DEBUG] [app] Starting request: urn:request:d1063191-3d7b-48ad-91d5-3c6b866ab41a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:09:30,653 [281] [DEBUG] [app] Starting request: urn:request:e607aea4-e7c1-4d6b-b706-2cf2d0a1209d (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:09:30,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:09:30,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:09:30,656 [288] [DEBUG] [app] Starting request: urn:request:e8423980-446b-4996-86ed-1d5abab2ebca (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:09:30,656 [284] [DEBUG] [app] Starting request: urn:request:61856834-f776-41d1-a852-211a33e9c7fe (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:09:30,657 [288] [DEBUG] [app] Ending request: urn:request:e8423980-446b-4996-86ed-1d5abab2ebca (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:e8423980-446b-4996-86ed-1d5abab2ebca', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:09:30,657 [284] [DEBUG] [app] Ending request: urn:request:61856834-f776-41d1-a852-211a33e9c7fe (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:61856834-f776-41d1-a852-211a33e9c7fe', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:09:30,657 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:09:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:09:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:09:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:09:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:09:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:09:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:09:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:09:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:09:30,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:09:30,659 [281] [DEBUG] [app] Starting request: urn:request:ff655ce0-9601-480d-b4b2-306d2a63de6f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:09:30,660 [278] [DEBUG] [app] Starting request: urn:request:112c51ce-d139-4ff2-8283-68b6c90142f5 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:09:30,660 [281] [DEBUG] [app] Ending request: urn:request:ff655ce0-9601-480d-b4b2-306d2a63de6f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:ff655ce0-9601-480d-b4b2-306d2a63de6f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:09:30,660 [278] [DEBUG] [app] Ending request: urn:request:112c51ce-d139-4ff2-8283-68b6c90142f5 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:112c51ce-d139-4ff2-8283-68b6c90142f5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:09:30,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:09:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:09:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:09:30,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:09:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:09:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:09:30,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:09:30,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:09:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:09:30,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:09:30,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:09:30,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:09:30,674 [279] [DEBUG] [app] Ending request: urn:request:d1063191-3d7b-48ad-91d5-3c6b866ab41a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:d1063191-3d7b-48ad-91d5-3c6b866ab41a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:09:30,675 [281] [DEBUG] [app] Ending request: urn:request:e607aea4-e7c1-4d6b-b706-2cf2d0a1209d (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e607aea4-e7c1-4d6b-b706-2cf2d0a1209d', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:09:30,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:30,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:30,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:09:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:09:30,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:09:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:09:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:09:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotatotalworker stdout | 2024-04-22 04:09:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:09:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:46.054492+00:00 (in 14.999469 seconds)
quotatotalworker stdout | 2024-04-22 04:09:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:09:46 UTC)" (scheduled at 2024-04-22 04:09:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:09:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:09:31,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:09:31,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:09:46 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:09:31,376 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:09:32,894 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:09:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:09:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:43.759375+00:00 (in 9.999467 seconds)
notificationworker stdout | 2024-04-22 04:09:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:09:43 UTC)" (scheduled at 2024-04-22 04:09:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:09:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:09:33,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 9, 33, 760229), True, datetime.datetime(2024, 4, 22, 4, 9, 33, 760229), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:09:33,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:09:33,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:09:33,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:09:43 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:09:34,281 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:09:34,570 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
gunicorn-secscan stdout | 2024-04-22 04:09:34,755 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:09:34,759 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:09:34,761 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
exportactionlogsworker stdout | 2024-04-22 04:09:34,788 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
logrotateworker stdout | 2024-04-22 04:09:35,834 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:09:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:09:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:56.873109+00:00 (in 21.000709 seconds)
securityworker stdout | 2024-04-22 04:09:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:05 UTC)" (scheduled at 2024-04-22 04:09:35.871852+00:00)
securityworker stdout | 2024-04-22 04:09:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:09:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:09:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:09:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:09:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:09:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:09:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:05 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:09:37,051 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:09:37,067 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:09:37,220 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:09:38,191 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:09:39,541 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:09:39,557 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
exportactionlogsworker stdout | 2024-04-22 04:09:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:09:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:41.564959+00:00 (in 1.997540 seconds)
exportactionlogsworker stdout | 2024-04-22 04:09:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:39 UTC)" (scheduled at 2024-04-22 04:09:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:09:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:09:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:39 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:09:39,929 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:09:39,970 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:09:41,074 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:09:41,077 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:09:41,080 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:09:41,082 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:09:41,087 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:09:41,091 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:09:41,095 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:09:41,099 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:09:41,102 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 04:09:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:09:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:11.264267+00:00 (in 29.999459 seconds)
autopruneworker stdout | 2024-04-22 04:09:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:11 UTC)" (scheduled at 2024-04-22 04:09:41.264267+00:00)
storagereplication stdout | 2024-04-22 04:09:41,270 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
autopruneworker stdout | 2024-04-22 04:09:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758921271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:09:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:09:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:09:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:09:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:09:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:39.566970+00:00 (in 58.001503 seconds)
exportactionlogsworker stdout | 2024-04-22 04:09:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:41 UTC)" (scheduled at 2024-04-22 04:09:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:09:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:09:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 9, 41, 565729), True, datetime.datetime(2024, 4, 22, 4, 9, 41, 565729), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:09:41,575 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:09:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:09:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:41 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:09:42,754 [278] [DEBUG] [app] Starting request: urn:request:7506eb79-393b-436d-8d01-dd52e415fcd4 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:09:42,754 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:42,754 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:42,755 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:42,764 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:42,764 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:42,764 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:42,765 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:42,765 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:42,765 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:42,765 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:42,765 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:42,767 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:42,773 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:42,774 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:42,777 [278] [DEBUG] [app] Ending request: urn:request:7506eb79-393b-436d-8d01-dd52e415fcd4 (/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com) {'endpoint': 'api.repositoryauthorizedemail', 'request_id': 'urn:request:7506eb79-393b-436d-8d01-dd52e415fcd4', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'path': '/api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:42,777 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:42,778 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:09:42 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.0" 200 101 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:09:42 +0000] "GET /api/v1/repository/build_test/pushno/authorizedemail/hu_weihua@163.com HTTP/1.1" 200 101 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.024 1581 0.025)
namespacegcworker stdout | 2024-04-22 04:09:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:09:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:22.058978+00:00 (in 39.001295 seconds)
namespacegcworker stdout | 2024-04-22 04:09:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:43 UTC)" (scheduled at 2024-04-22 04:09:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:09:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:09:43,059 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 9, 43, 58011), True, datetime.datetime(2024, 4, 22, 4, 9, 43, 58011), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:09:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:09:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:09:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:10:43 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:09:43,097 [278] [DEBUG] [app] Starting request: urn:request:b2d07fce-21d4-495b-a91d-18af205f6076 (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:09:43,097 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:43,097 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:43,098 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,107 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:43,107 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:43,107 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:43,107 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:43,107 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:43,107 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:43,107 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:43,107 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:43,109 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:43,115 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:43,116 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,121 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."email", "t1"."code", "t1"."confirmed", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositoryauthorizedemail" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t1"."email" = %s)) AND ("t2"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 'hu_weihua@163.com', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,124 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,126 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['vulnerability_found', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,128 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['email', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,130 [278] [DEBUG] [peewee] ('INSERT INTO "repositorynotification" ("uuid", "repository_id", "event_id", "method_id", "title", "config_json", "event_config_json", "number_of_failures") VALUES (%s, %s, %s, %s, %s, %s, %s, %s) RETURNING "repositorynotification"."id"', ['821e891b-da3f-4153-b053-c6689eea2a99', 1, 6, 1, 'vul mail', '{"email": "hu_weihua@163.com"}', '{"level": "2"}', 0])
gunicorn-web stdout | 2024-04-22 04:09:43,135 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,138 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,140 [278] [DEBUG] [peewee] ('INSERT INTO "logentry3" ("kind_id", "account_id", "performer_id", "repository_id", "datetime", "ip", "metadata_json") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "logentry3"."id"', [6, 2, 1, 1, datetime.datetime(2024, 4, 22, 4, 9, 43, 138220), '10.131.0.9', '{"repo": "pushno", "namespace": "build_test", "notification_id": "821e891b-da3f-4153-b053-c6689eea2a99", "event": "vulnerability_found", "method": "email"}'])
gunicorn-web stdout | 2024-04-22 04:09:43,144 [278] [DEBUG] [app] Ending request: urn:request:b2d07fce-21d4-495b-a91d-18af205f6076 (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:b2d07fce-21d4-495b-a91d-18af205f6076', 'remote_addr': '10.131.0.9', 'http_method': 'POST', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': {'event': 'vulnerability_found', 'method': 'email', 'config': {'email': 'hu_weihua@163.com'}, 'eventConfig': {'level': '2'}, 'title': 'vul mail'}, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:43,145 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:43,145 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:09:43 +0000] "POST /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 201 220 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:09:43 +0000] "POST /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 201 220 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.049 1864 0.049)
gunicorn-web stdout | 2024-04-22 04:09:43,504 [278] [DEBUG] [app] Starting request: urn:request:e66d1dff-33ba-4425-8be8-be87a1eef0cb (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:09:43,504 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:43,504 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:43,505 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,506 [282] [DEBUG] [app] Starting request: urn:request:6ec9b943-f3d9-401f-ac4b-8066f8a7eff9 (/api/v1/repository/build_test/pushno/tag/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:09:43,506 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:43,506 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:43,507 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,513 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:43,514 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:43,514 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:43,514 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:43,514 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:43,514 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:43,514 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:43,514 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:43,516 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:43,516 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:43,516 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:43,516 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:43,516 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:43,516 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:43,516 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:43,516 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:43,517 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:43,519 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:43,522 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:43,522 [278] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:43,523 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,526 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:43,526 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,527 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,528 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:09:43,530 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:43,530 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:43,531 [278] [DEBUG] [app] Ending request: urn:request:e66d1dff-33ba-4425-8be8-be87a1eef0cb (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:e66d1dff-33ba-4425-8be8-be87a1eef0cb', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeStats=true&includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeStats': 'true', 'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:43,531 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,531 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:43,531 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:09:43 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.0" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:09:43 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.1" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.028 1576 0.028)
gunicorn-web stdout | 2024-04-22 04:09:43,533 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,535 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,538 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."repository_id", "t1"."manifest_id", "t1"."lifetime_start_ms", "t1"."lifetime_end_ms", "t1"."hidden", "t1"."reversion", "t1"."tag_kind_id", "t1"."linked_tag_id", "t2"."id", "t2"."digest", "t2"."media_type_id", "t2"."layers_compressed_size", "t2"."config_media_type" FROM "tag" AS "t1" INNER JOIN "manifest" AS "t2" ON ("t1"."manifest_id" = "t2"."id") WHERE ((("t1"."repository_id" = %s) AND (("t1"."lifetime_end_ms" IS %s) OR ("t1"."lifetime_end_ms" > %s))) AND ("t1"."hidden" = %s)) ORDER BY "t1"."lifetime_start_ms" DESC, "t1"."name" LIMIT %s OFFSET %s', [1, None, 1713758983538, False, 101, 0])
gunicorn-web stdout | 2024-04-22 04:09:43,541 [282] [DEBUG] [app] Ending request: urn:request:6ec9b943-f3d9-401f-ac4b-8066f8a7eff9 (/api/v1/repository/build_test/pushno/tag/) {'endpoint': 'api.listrepositorytags', 'request_id': 'urn:request:6ec9b943-f3d9-401f-ac4b-8066f8a7eff9', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true', 'path': '/api/v1/repository/build_test/pushno/tag/', 'parameters': {'limit': '100', 'page': '1', 'onlyActiveTags': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:43,542 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:09:43 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.1" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.038 1582 0.037)
gunicorn-web stdout | 2024-04-22 04:09:43,542 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:09:43 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
notificationworker stdout | 2024-04-22 04:09:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:09:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:09:53.759375+00:00 (in 9.999513 seconds)
notificationworker stdout | 2024-04-22 04:09:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:09:53 UTC)" (scheduled at 2024-04-22 04:09:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:09:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:09:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 9, 43, 760231), True, datetime.datetime(2024, 4, 22, 4, 9, 43, 760231), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:09:43,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:09:43,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:09:43,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:09:53 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:09:44,640 [278] [DEBUG] [app] Starting request: urn:request:7ff113dc-6518-47d4-acd1-595b64364ec1 (/api/v1/repository/build_test/pushno/permissions/user/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:09:44,640 [279] [DEBUG] [app] Starting request: urn:request:4e308c1b-239d-4aad-8824-e49851779921 (/api/v1/repository/build_test/pushno/permissions/team/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:09:44,640 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:44,640 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:44,640 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:44,640 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:44,641 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,641 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,650 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:44,650 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:44,650 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:44,650 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:44,650 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:44,650 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:44,650 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:44,650 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:44,650 [279] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:44,650 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:44,651 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:44,651 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:44,651 [279] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:44,651 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:44,651 [279] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:44,651 [279] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:44,653 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:44,653 [279] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:44,659 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:44,660 [279] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:44,660 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,660 [279] [DEBUG] [peewee] ('SELECT "t1"."name", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "team" AS "t1" ON ("t3"."team_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:09:44,663 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed", "t2"."id", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "user" AS "t1" ON ("t3"."user_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:09:44,663 [279] [DEBUG] [app] Ending request: urn:request:4e308c1b-239d-4aad-8824-e49851779921 (/api/v1/repository/build_test/pushno/permissions/team/) {'endpoint': 'api.repositoryteampermissionlist', 'request_id': 'urn:request:4e308c1b-239d-4aad-8824-e49851779921', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/team/', 'path': '/api/v1/repository/build_test/pushno/permissions/team/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:44,663 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:44,664 [279] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:09:44 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.0" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:09:44 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.1" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.025 1539 0.025)
gunicorn-web stdout | 2024-04-22 04:09:44,664 [282] [DEBUG] [app] Starting request: urn:request:746e7afd-934c-49f4-9aff-def58f201312 (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:09:44,665 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:44,665 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:44,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,666 [278] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."username" FROM "user" AS "t1" INNER JOIN "teammember" AS "t2" ON ("t2"."user_id" = "t1"."id") INNER JOIN "team" AS "t3" ON ("t2"."team_id" = "t3"."id") WHERE ((("t3"."organization_id" = %s) AND ("t1"."robot" = %s)) AND ("t1"."id" IN (%s)))', [2, False, 1])
gunicorn-web stdout | 2024-04-22 04:09:44,669 [278] [DEBUG] [app] Ending request: urn:request:7ff113dc-6518-47d4-acd1-595b64364ec1 (/api/v1/repository/build_test/pushno/permissions/user/) {'endpoint': 'api.repositoryuserpermissionlist', 'request_id': 'urn:request:7ff113dc-6518-47d4-acd1-595b64364ec1', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/user/', 'path': '/api/v1/repository/build_test/pushno/permissions/user/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:44,669 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:44,669 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:09:44 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.0" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:09:44 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.1" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1539 0.030)
gunicorn-web stdout | 2024-04-22 04:09:44,674 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:44,675 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:44,675 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:44,675 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:44,675 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:44,675 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:44,675 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:44,675 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:44,677 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:44,683 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:44,685 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,688 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t3"."username" = %s) AND ("t2"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:09:44,691 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,693 [278] [DEBUG] [app] Starting request: urn:request:3e141e3e-f757-4eb2-a10c-1e5cdcd1a645 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:09:44,693 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:44,693 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:44,693 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [4, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,694 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,696 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,698 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,700 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,702 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,702 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:44,702 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:44,702 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:44,702 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:44,702 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:44,702 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:44,703 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:44,703 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:44,704 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,705 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:44,706 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,708 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,710 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [4, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,711 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:44,712 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,712 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,714 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:44,716 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:09:44,716 [282] [DEBUG] [app] Ending request: urn:request:746e7afd-934c-49f4-9aff-def58f201312 (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:746e7afd-934c-49f4-9aff-def58f201312', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:44,717 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:09:44 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 200 1792 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.054 1535 0.054)
gunicorn-web stdout | 2024-04-22 04:09:44,717 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:09:44 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 200 1792 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:09:44,720 [278] [DEBUG] [app] Ending request: urn:request:3e141e3e-f757-4eb2-a10c-1e5cdcd1a645 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:3e141e3e-f757-4eb2-a10c-1e5cdcd1a645', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:44,721 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:44,721 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:09:44 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:09:44 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.029 1536 0.029)
gcworker stdout | 2024-04-22 04:09:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:09:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:14.952062+00:00 (in 29.999540 seconds)
gcworker stdout | 2024-04-22 04:09:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:14 UTC)" (scheduled at 2024-04-22 04:09:44.952062+00:00)
gcworker stdout | 2024-04-22 04:09:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549384952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:09:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:09:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:09:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:09:45,653 [278] [DEBUG] [app] Starting request: urn:request:ea61a0c3-ff8d-4c36-8036-405c617e555e (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:09:45,653 [282] [DEBUG] [app] Starting request: urn:request:812d5cc7-f747-4d36-b59b-7f0def6bb722 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:09:45,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:09:45,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:09:45,656 [292] [DEBUG] [app] Starting request: urn:request:33c266d3-9dc0-4101-98ef-4e040e3d04d7 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:09:45,656 [285] [DEBUG] [app] Starting request: urn:request:33e05f9c-d4e7-43da-a0e7-97411d33dc9b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:09:45,657 [292] [DEBUG] [app] Ending request: urn:request:33c266d3-9dc0-4101-98ef-4e040e3d04d7 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:33c266d3-9dc0-4101-98ef-4e040e3d04d7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:09:45,657 [285] [DEBUG] [app] Ending request: urn:request:33e05f9c-d4e7-43da-a0e7-97411d33dc9b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:33e05f9c-d4e7-43da-a0e7-97411d33dc9b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:09:45,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:09:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:09:45,657 [285] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:09:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:09:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:09:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:09:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:09:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:09:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:09:45,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:09:45,660 [282] [DEBUG] [app] Starting request: urn:request:a8395ad7-bb72-4d81-852c-e517a0fc2ec8 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:09:45,660 [281] [DEBUG] [app] Starting request: urn:request:b45b3685-7f2d-481f-8b08-e1b45b827b8c (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:09:45,660 [282] [DEBUG] [app] Ending request: urn:request:a8395ad7-bb72-4d81-852c-e517a0fc2ec8 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a8395ad7-bb72-4d81-852c-e517a0fc2ec8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:09:45,660 [281] [DEBUG] [app] Ending request: urn:request:b45b3685-7f2d-481f-8b08-e1b45b827b8c (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b45b3685-7f2d-481f-8b08-e1b45b827b8c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:09:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:09:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:09:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:09:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:09:45,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:09:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:09:45,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:09:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:09:45,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:09:45,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:09:45,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:09:45,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:09:45,673 [278] [DEBUG] [app] Ending request: urn:request:ea61a0c3-ff8d-4c36-8036-405c617e555e (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:ea61a0c3-ff8d-4c36-8036-405c617e555e', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:09:45,673 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:45,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:09:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:09:45,674 [282] [DEBUG] [app] Ending request: urn:request:812d5cc7-f747-4d36-b59b-7f0def6bb722 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:812d5cc7-f747-4d36-b59b-7f0def6bb722', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:09:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.021)
gunicorn-web stdout | 2024-04-22 04:09:45,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:09:45,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:09:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:09:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.021)
quotatotalworker stdout | 2024-04-22 04:09:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:09:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:01.054492+00:00 (in 14.999459 seconds)
quotatotalworker stdout | 2024-04-22 04:09:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:10:01 UTC)" (scheduled at 2024-04-22 04:09:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:09:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:09:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:09:46,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:10:01 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:09:46,931 [278] [DEBUG] [app] Starting request: urn:request:7d3c8686-ede2-420c-bda2-20ccdaff9276 (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:09:46,931 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:46,931 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:46,932 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:46,941 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:09:46,942 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:09:46,942 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:46,942 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:46,942 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:46,942 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:46,942 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:46,942 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:46,945 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:09:46,951 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:09:46,951 [278] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:09:46,952 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:46,954 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:09:46,957 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:09:46,959 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:46,959 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:09:46,959 [278] [DEBUG] [app] Ending request: urn:request:7d3c8686-ede2-420c-bda2-20ccdaff9276 (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:7d3c8686-ede2-420c-bda2-20ccdaff9276', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:09:46,960 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:09:46 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.1" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1546 0.030)
gunicorn-web stdout | 2024-04-22 04:09:46,960 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:09:46 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.0" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
buildlogsarchiver stdout | 2024-04-22 04:09:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:09:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:17.052354+00:00 (in 29.999523 seconds)
buildlogsarchiver stdout | 2024-04-22 04:09:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:17 UTC)" (scheduled at 2024-04-22 04:09:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:09:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 9, 47, 53163), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:09:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:09:47,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:09:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:09:50,349 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:09:51,748 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:09:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:09:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:03.759375+00:00 (in 9.999434 seconds)
notificationworker stdout | 2024-04-22 04:09:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:10:03 UTC)" (scheduled at 2024-04-22 04:09:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:09:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:09:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 9, 53, 760425), True, datetime.datetime(2024, 4, 22, 4, 9, 53, 760425), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:09:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:09:53,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:09:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:10:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:09:55,414 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:09:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:09:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:05.871852+00:00 (in 8.998246 seconds)
securityworker stdout | 2024-04-22 04:09:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:26 UTC)" (scheduled at 2024-04-22 04:09:56.873109+00:00)
securityworker stdout | 2024-04-22 04:09:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:09:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:09:56,875 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:09:56,875 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:09:56,875 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:09:56,876 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:09:56,876 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:09:56,878 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:09:56,879 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:09:56,889 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:09:56,891 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:09:56,891 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:09:56,892 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 4, 56, 879421), 1, 2])
securityworker stdout | 2024-04-22 04:09:56,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:09:56,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:09:56,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 4, 56, 879421), 1, 2])
securityworker stdout | 2024-04-22 04:09:56,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:09:56,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:09:56,897 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:09:56,897 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:09:56,897 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:09:56,897 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:09:56,897 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:09:56,898 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:09:56,898 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:09:56,898 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:09:57,178 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:09:58,378 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:09:58,498 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:10:00,178 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:10:00,182 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:10:00,184 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:10:00,197 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:10:00,201 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:10:00,438 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:10:00,528 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:10:00,653 [282] [DEBUG] [app] Starting request: urn:request:b2e94667-bc57-43ae-918f-0da5997b634a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:10:00,653 [281] [DEBUG] [app] Starting request: urn:request:6d2807b0-106a-4eca-90d9-4523353c57ac (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:10:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:10:00,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:10:00,656 [292] [DEBUG] [app] Starting request: urn:request:423d3ea8-5d24-46ea-b870-74d45c1ff99b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:10:00,656 [284] [DEBUG] [app] Starting request: urn:request:38bdc257-f927-45fa-8b11-eb9d8dabd27b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:10:00,656 [292] [DEBUG] [app] Ending request: urn:request:423d3ea8-5d24-46ea-b870-74d45c1ff99b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:423d3ea8-5d24-46ea-b870-74d45c1ff99b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:10:00,656 [284] [DEBUG] [app] Ending request: urn:request:38bdc257-f927-45fa-8b11-eb9d8dabd27b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:38bdc257-f927-45fa-8b11-eb9d8dabd27b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:10:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:10:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:10:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:10:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:10:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:10:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:10:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:10:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:10:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:10:00,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:10:00,659 [281] [DEBUG] [app] Starting request: urn:request:dc9be8a7-094d-440d-bc17-a92ddd779478 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:10:00,660 [278] [DEBUG] [app] Starting request: urn:request:f2281f79-a104-4ec0-bcf2-08b0d78823ce (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:10:00,660 [281] [DEBUG] [app] Ending request: urn:request:dc9be8a7-094d-440d-bc17-a92ddd779478 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:dc9be8a7-094d-440d-bc17-a92ddd779478', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:10:00,660 [278] [DEBUG] [app] Ending request: urn:request:f2281f79-a104-4ec0-bcf2-08b0d78823ce (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:f2281f79-a104-4ec0-bcf2-08b0d78823ce', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:10:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:10:00,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:10:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:10:00,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:10:00,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:10:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:10:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:10:00,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:10:00,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:10:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:10:00,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:10:00,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:10:00,674 [282] [DEBUG] [app] Ending request: urn:request:b2e94667-bc57-43ae-918f-0da5997b634a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b2e94667-bc57-43ae-918f-0da5997b634a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:10:00,675 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:10:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:10:00,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:10:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:10:00,675 [281] [DEBUG] [app] Ending request: urn:request:6d2807b0-106a-4eca-90d9-4523353c57ac (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:6d2807b0-106a-4eca-90d9-4523353c57ac', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:10:00,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:00,676 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:10:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:10:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.024)
quotatotalworker stdout | 2024-04-22 04:10:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:10:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:16.054492+00:00 (in 14.999450 seconds)
quotatotalworker stdout | 2024-04-22 04:10:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:10:16 UTC)" (scheduled at 2024-04-22 04:10:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:10:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:10:01,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:10:01,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:10:16 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:10:01,393 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:10:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:10:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:16.552337+00:00 (in 13.995575 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:10:02,557 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:02 UTC)" (scheduled at 2024-04-22 04:10:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:10:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:10:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:10:02,903 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:10:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:10:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:13.759375+00:00 (in 9.999443 seconds)
notificationworker stdout | 2024-04-22 04:10:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:10:13 UTC)" (scheduled at 2024-04-22 04:10:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:10:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:10:03,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 10, 3, 760254), True, datetime.datetime(2024, 4, 22, 4, 10, 3, 760254), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:10:03,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:10:03,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:10:03,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:10:13 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:10:04,312 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:10:04,606 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
gunicorn-secscan stdout | 2024-04-22 04:10:04,763 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:10:04,767 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:10:04,770 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
exportactionlogsworker stdout | 2024-04-22 04:10:04,794 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
logrotateworker stdout | 2024-04-22 04:10:05,870 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
securityworker stdout | 2024-04-22 04:10:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:10:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:26.873109+00:00 (in 21.000803 seconds)
securityworker stdout | 2024-04-22 04:10:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:35 UTC)" (scheduled at 2024-04-22 04:10:05.871852+00:00)
securityworker stdout | 2024-04-22 04:10:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:10:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:10:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:10:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:10:05,890 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:10:05,892 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:10:05,892 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:35 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:10:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:10:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:13.555667+00:00 (in 7.002730 seconds)
repositorygcworker stdout | 2024-04-22 04:10:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:06 UTC)" (scheduled at 2024-04-22 04:10:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:10:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:10:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 10, 6, 553276), True, datetime.datetime(2024, 4, 22, 4, 10, 6, 553276), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:10:06,563 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:10:06,563 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:10:06,563 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:06 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:10:07,087 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:10:07,102 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:10:07,256 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:10:08,201 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:10:09,557 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:10:09,582 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:10:09,964 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:10:09,988 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:10:11,082 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:10:11,087 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:10:11,089 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:10:11,093 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:10:11,096 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:10:11,099 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:10:11,106 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:10:11,109 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:10:11,112 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 04:10:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:10:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:41.264267+00:00 (in 29.999494 seconds)
autopruneworker stdout | 2024-04-22 04:10:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:41 UTC)" (scheduled at 2024-04-22 04:10:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:10:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758951271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:10:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:10:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:10:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:41 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:10:11,306 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:10:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:10:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:06.552482+00:00 (in 52.996358 seconds)
repositorygcworker stdout | 2024-04-22 04:10:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:13 UTC)" (scheduled at 2024-04-22 04:10:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:10:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:10:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:10:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:10:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:19.762424+00:00 (in 6.002575 seconds)
notificationworker stdout | 2024-04-22 04:10:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:10:23 UTC)" (scheduled at 2024-04-22 04:10:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:10:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:10:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 10, 13, 760276), True, datetime.datetime(2024, 4, 22, 4, 10, 13, 760276), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:10:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:10:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:10:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:10:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:10:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:10:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:44.952062+00:00 (in 29.999493 seconds)
gcworker stdout | 2024-04-22 04:10:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:44 UTC)" (scheduled at 2024-04-22 04:10:14.952062+00:00)
gcworker stdout | 2024-04-22 04:10:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549414952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:10:14,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:10:14,964 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:10:14,964 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:10:15,653 [278] [DEBUG] [app] Starting request: urn:request:fe09650c-2acc-4eb1-bb16-75a310870d2b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:10:15,653 [281] [DEBUG] [app] Starting request: urn:request:e7dba463-904e-4520-af45-a2cb0193737f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:10:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:10:15,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:10:15,656 [284] [DEBUG] [app] Starting request: urn:request:9fb8efac-7c76-4b59-a152-b083ab5f1332 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:10:15,656 [291] [DEBUG] [app] Starting request: urn:request:13a07adf-a723-4789-9ff7-aad862f48959 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:10:15,656 [291] [DEBUG] [app] Ending request: urn:request:13a07adf-a723-4789-9ff7-aad862f48959 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:13a07adf-a723-4789-9ff7-aad862f48959', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:10:15,656 [284] [DEBUG] [app] Ending request: urn:request:9fb8efac-7c76-4b59-a152-b083ab5f1332 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:9fb8efac-7c76-4b59-a152-b083ab5f1332', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:10:15,656 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:10:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:10:15,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:10:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:10:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:10:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:10:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:10:15,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:10:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:10:15,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:10:15,659 [282] [DEBUG] [app] Starting request: urn:request:20fca4dd-1462-470c-a383-fe064afd3a77 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:10:15,659 [279] [DEBUG] [app] Starting request: urn:request:9f0e100c-7ab6-4697-ba93-b8618bdd7051 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:10:15,660 [279] [DEBUG] [app] Ending request: urn:request:9f0e100c-7ab6-4697-ba93-b8618bdd7051 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9f0e100c-7ab6-4697-ba93-b8618bdd7051', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:10:15,660 [282] [DEBUG] [app] Ending request: urn:request:20fca4dd-1462-470c-a383-fe064afd3a77 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:20fca4dd-1462-470c-a383-fe064afd3a77', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:10:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:10:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:10:15,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:10:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:10:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:10:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:10:15,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:10:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:10:15,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:10:15,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:10:15,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:10:15,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:10:15,673 [281] [DEBUG] [app] Ending request: urn:request:e7dba463-904e-4520-af45-a2cb0193737f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e7dba463-904e-4520-af45-a2cb0193737f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:10:15,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:15,674 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:10:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:10:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:10:15,674 [278] [DEBUG] [app] Ending request: urn:request:fe09650c-2acc-4eb1-bb16-75a310870d2b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:fe09650c-2acc-4eb1-bb16-75a310870d2b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:10:15,674 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:10:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.023)
gunicorn-web stdout | 2024-04-22 04:10:15,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:10:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:10:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:10:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:31.054492+00:00 (in 14.999462 seconds)
quotatotalworker stdout | 2024-04-22 04:10:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:10:31 UTC)" (scheduled at 2024-04-22 04:10:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:10:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:10:16,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:10:16,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:10:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:10:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:10:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:02.556208+00:00 (in 46.003281 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:10:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:16 UTC)" (scheduled at 2024-04-22 04:10:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:10:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:10:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 10, 16, 553347), True, datetime.datetime(2024, 4, 22, 4, 10, 16, 553347), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:10:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:10:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:10:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:10:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:10:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:47.052354+00:00 (in 29.999492 seconds)
buildlogsarchiver stdout | 2024-04-22 04:10:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:47 UTC)" (scheduled at 2024-04-22 04:10:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:10:17,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 10, 17, 53275), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:10:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:10:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:10:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:10:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:10:19,763 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:23.759375+00:00 (in 3.996378 seconds)
notificationworker stdout | 2024-04-22 04:10:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:19 UTC)" (scheduled at 2024-04-22 04:10:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:10:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:10:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:10:20,383 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
gunicorn-web stdout | 2024-04-22 04:10:21,490 [282] [DEBUG] [app] Starting request: urn:request:f3868233-ed0f-4aa0-900a-b2cd6111b592 (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:10:21,491 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:21,491 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:21,491 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:21,500 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:10:21,500 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:10:21,501 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:21,501 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:21,501 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:21,501 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:21,501 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:21,501 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:21,503 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:10:21,509 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:21,510 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:21,514 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:21,516 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['vulnerability_found', 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:21,518 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['webhook', 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:21,520 [282] [DEBUG] [peewee] ('INSERT INTO "repositorynotification" ("uuid", "repository_id", "event_id", "method_id", "title", "config_json", "event_config_json", "number_of_failures") VALUES (%s, %s, %s, %s, %s, %s, %s, %s) RETURNING "repositorynotification"."id"', ['55d1704d-84c4-48e0-a0be-df13625280c4', 1, 6, 6, 'vul webhook', '{"url": "https://webhook.site/ffd85e96-d5d9-4a80-a40b-342ae3308119"}', '{"level": "2"}', 0])
gunicorn-web stdout | 2024-04-22 04:10:21,526 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:21,528 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:21,530 [282] [DEBUG] [peewee] ('INSERT INTO "logentry3" ("kind_id", "account_id", "performer_id", "repository_id", "datetime", "ip", "metadata_json") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "logentry3"."id"', [6, 2, 1, 1, datetime.datetime(2024, 4, 22, 4, 10, 21, 528172), '10.128.2.8', '{"repo": "pushno", "namespace": "build_test", "notification_id": "55d1704d-84c4-48e0-a0be-df13625280c4", "event": "vulnerability_found", "method": "webhook"}'])
gunicorn-web stdout | 2024-04-22 04:10:21,534 [282] [DEBUG] [app] Ending request: urn:request:f3868233-ed0f-4aa0-900a-b2cd6111b592 (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:f3868233-ed0f-4aa0-900a-b2cd6111b592', 'remote_addr': '10.128.2.8', 'http_method': 'POST', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': {'event': 'vulnerability_found', 'method': 'webhook', 'config': {'url': 'https://webhook.site/ffd85e96-d5d9-4a80-a40b-342ae3308119'}, 'eventConfig': {'level': '2'}, 'title': 'vul webhook'}, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:10:21,535 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:21,535 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:10:21 +0000] "POST /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 201 263 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:10:21 +0000] "POST /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 201 263 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.047 1888 0.046)
securityscanningnotificationworker stdout | 2024-04-22 04:10:21,785 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
gunicorn-web stdout | 2024-04-22 04:10:21,862 [282] [DEBUG] [app] Starting request: urn:request:5b63fde7-5ae6-47b9-ab21-71cda6accdd1 (/api/v1/repository/build_test/pushno/tag/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:10:21,862 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:21,862 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:21,863 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:21,871 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:10:21,871 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:10:21,871 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:21,872 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:21,872 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:21,872 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:21,872 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:21,872 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:21,874 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:10:21,880 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:21,881 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:21,885 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:21,887 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:21,889 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:21,892 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."repository_id", "t1"."manifest_id", "t1"."lifetime_start_ms", "t1"."lifetime_end_ms", "t1"."hidden", "t1"."reversion", "t1"."tag_kind_id", "t1"."linked_tag_id", "t2"."id", "t2"."digest", "t2"."media_type_id", "t2"."layers_compressed_size", "t2"."config_media_type" FROM "tag" AS "t1" INNER JOIN "manifest" AS "t2" ON ("t1"."manifest_id" = "t2"."id") WHERE ((("t1"."repository_id" = %s) AND (("t1"."lifetime_end_ms" IS %s) OR ("t1"."lifetime_end_ms" > %s))) AND ("t1"."hidden" = %s)) ORDER BY "t1"."lifetime_start_ms" DESC, "t1"."name" LIMIT %s OFFSET %s', [1, None, 1713759021892, False, 101, 0])
gunicorn-web stdout | 2024-04-22 04:10:21,895 [282] [DEBUG] [app] Ending request: urn:request:5b63fde7-5ae6-47b9-ab21-71cda6accdd1 (/api/v1/repository/build_test/pushno/tag/) {'endpoint': 'api.listrepositorytags', 'request_id': 'urn:request:5b63fde7-5ae6-47b9-ab21-71cda6accdd1', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true', 'path': '/api/v1/repository/build_test/pushno/tag/', 'parameters': {'limit': '100', 'page': '1', 'onlyActiveTags': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:10:21,896 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:21,896 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:10:21 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:10:21 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.1" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.036 1563 0.036)
namespacegcworker stdout | 2024-04-22 04:10:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:10:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:43.057186+00:00 (in 20.997697 seconds)
namespacegcworker stdout | 2024-04-22 04:10:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:22 UTC)" (scheduled at 2024-04-22 04:10:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:10:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:10:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:22 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:10:22,583 [282] [DEBUG] [app] Starting request: urn:request:9f11511a-73ba-4329-a818-d2d524414800 (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:10:22,583 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:22,583 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:22,584 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:22,595 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:10:22,595 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:10:22,595 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:22,596 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:22,596 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:22,596 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:22,596 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:22,596 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:22,598 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:10:22,605 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:22,605 [282] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:22,605 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:22,608 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:22,610 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:10:22,612 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:22,612 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:22,613 [282] [DEBUG] [app] Ending request: urn:request:9f11511a-73ba-4329-a818-d2d524414800 (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:9f11511a-73ba-4329-a818-d2d524414800', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeStats=true&includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeStats': 'true', 'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:10:22,614 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:22,614 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:10:22 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.0" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:10:22 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.1" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.033 1557 0.033)
gunicorn-web stdout | 2024-04-22 04:10:23,001 [281] [DEBUG] [app] Starting request: urn:request:9a10b0c0-5a0f-49c0-b52f-e3d94bade887 (/api/v1/repository/build_test/pushno/permissions/team/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:10:23,001 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:23,001 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:23,002 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,004 [278] [DEBUG] [app] Starting request: urn:request:b01d50ef-436b-4c0d-bc11-97e3788a0d22 (/api/v1/repository/build_test/pushno/permissions/user/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:10:23,004 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:23,005 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:23,005 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,012 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:10:23,012 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:10:23,012 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:23,012 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:23,012 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:23,012 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:23,012 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:23,012 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:23,014 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:10:23,014 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:10:23,014 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:23,014 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:23,014 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:23,014 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:23,014 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:23,014 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:23,014 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:10:23,016 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:10:23,021 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:23,022 [281] [DEBUG] [peewee] ('SELECT "t1"."name", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "team" AS "t1" ON ("t3"."team_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:10:23,023 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:23,023 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,025 [281] [DEBUG] [app] Ending request: urn:request:9a10b0c0-5a0f-49c0-b52f-e3d94bade887 (/api/v1/repository/build_test/pushno/permissions/team/) {'endpoint': 'api.repositoryteampermissionlist', 'request_id': 'urn:request:9a10b0c0-5a0f-49c0-b52f-e3d94bade887', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/team/', 'path': '/api/v1/repository/build_test/pushno/permissions/team/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:10:23,025 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:23,025 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:10:23 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.0" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:10:23 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.1" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.025 1558 0.025)
gunicorn-web stdout | 2024-04-22 04:10:23,026 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed", "t2"."id", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "user" AS "t1" ON ("t3"."user_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:10:23,029 [278] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."username" FROM "user" AS "t1" INNER JOIN "teammember" AS "t2" ON ("t2"."user_id" = "t1"."id") INNER JOIN "team" AS "t3" ON ("t2"."team_id" = "t3"."id") WHERE ((("t3"."organization_id" = %s) AND ("t1"."robot" = %s)) AND ("t1"."id" IN (%s)))', [2, False, 1])
gunicorn-web stdout | 2024-04-22 04:10:23,031 [278] [DEBUG] [app] Ending request: urn:request:b01d50ef-436b-4c0d-bc11-97e3788a0d22 (/api/v1/repository/build_test/pushno/permissions/user/) {'endpoint': 'api.repositoryuserpermissionlist', 'request_id': 'urn:request:b01d50ef-436b-4c0d-bc11-97e3788a0d22', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/user/', 'path': '/api/v1/repository/build_test/pushno/permissions/user/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:10:23,032 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:10:23 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.1" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.029 1558 0.029)
gunicorn-web stdout | 2024-04-22 04:10:23,032 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:10:23 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.0" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:10:23,733 [282] [DEBUG] [app] Starting request: urn:request:f9d23801-e05f-48b7-a4f2-33f9bb549d50 (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:10:23,733 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:23,733 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:23,734 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,743 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:10:23,743 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:10:23,743 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:23,743 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:23,743 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:23,743 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:23,743 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:23,743 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:23,745 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:10:23,751 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:23,752 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,756 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t3"."username" = %s) AND ("t2"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:10:23,758 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
notificationworker stdout | 2024-04-22 04:10:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:10:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:33.759375+00:00 (in 9.999538 seconds)
notificationworker stdout | 2024-04-22 04:10:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:10:33 UTC)" (scheduled at 2024-04-22 04:10:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:10:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
gunicorn-web stdout | 2024-04-22 04:10:23,760 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [4, 1, 0])
notificationworker stdout | 2024-04-22 04:10:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 10, 23, 760304), True, datetime.datetime(2024, 4, 22, 4, 10, 23, 760304), 0, 'notification/%', 50, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,761 [281] [DEBUG] [app] Starting request: urn:request:5a6f6825-40fe-4482-8a94-1f4cf936ab23 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:10:23,761 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:23,761 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:23,762 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,763 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,765 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,767 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,769 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
notificationworker stdout | 2024-04-22 04:10:23,769 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:10:23,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:10:23,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:10:33 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:10:23,770 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:10:23,770 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:10:23,770 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:23,770 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:23,771 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:23,771 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:23,771 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:23,771 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:23,771 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,773 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:10:23,773 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,775 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,777 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [4, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,779 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:23,779 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,780 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,781 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,783 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,784 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:10:23,785 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:23,787 [282] [DEBUG] [app] Ending request: urn:request:f9d23801-e05f-48b7-a4f2-33f9bb549d50 (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:f9d23801-e05f-48b7-a4f2-33f9bb549d50', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:10:23,788 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:10:23 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 200 2056 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.056 1535 0.056)
gunicorn-web stdout | 2024-04-22 04:10:23,788 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:10:23 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 200 2056 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:10:23,788 [281] [DEBUG] [app] Ending request: urn:request:5a6f6825-40fe-4482-8a94-1f4cf936ab23 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:5a6f6825-40fe-4482-8a94-1f4cf936ab23', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:10:23,789 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:23,789 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:10:23 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:10:23 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.029 1536 0.029)
quotaregistrysizeworker stdout | 2024-04-22 04:10:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:10:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:24.361582+00:00 (in 59.999467 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:10:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:24 UTC)" (scheduled at 2024-04-22 04:10:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:10:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:10:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:10:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:10:25,433 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:10:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:10:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:35.871852+00:00 (in 8.998222 seconds)
securityworker stdout | 2024-04-22 04:10:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:56 UTC)" (scheduled at 2024-04-22 04:10:26.873109+00:00)
securityworker stdout | 2024-04-22 04:10:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:10:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:10:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:10:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:10:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:10:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:10:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:10:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:10:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:10:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:10:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:10:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:10:26,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 5, 26, 881199), 1, 2])
securityworker stdout | 2024-04-22 04:10:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:10:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:10:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 5, 26, 881199), 1, 2])
securityworker stdout | 2024-04-22 04:10:26,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:10:26,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:10:26,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:10:26,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:10:26,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:10:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:10:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:10:26,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:10:26,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:10:26,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:10:56 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:10:27,176 [282] [DEBUG] [app] Starting request: urn:request:caa425f1-c700-4f13-9be1-10ca715a221c (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:10:27,176 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:27,176 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:27,177 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:27,186 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:10:27,186 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:10:27,186 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:27,186 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:27,186 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:27,186 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:27,186 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:27,186 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
repositoryactioncounter stdout | 2024-04-22 04:10:27,187 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
gunicorn-web stdout | 2024-04-22 04:10:27,189 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:10:27,194 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:27,195 [282] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:27,195 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:27,198 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:27,200 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:10:27,202 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:27,202 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:27,203 [282] [DEBUG] [app] Ending request: urn:request:caa425f1-c700-4f13-9be1-10ca715a221c (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:caa425f1-c700-4f13-9be1-10ca715a221c', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:10:27,203 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:27,204 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:10:27 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.0" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:10:27 +0000] "GET /api/v1/repository/build_test/pushno?includeTags=false HTTP/1.1" 200 339 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.028 1546 0.028)
quotatotalworker stdout | 2024-04-22 04:10:28,412 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:10:28,532 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:10:30,188 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:10:30,191 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:10:30,194 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:10:30,208 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:10:30,212 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:10:30,458 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:10:30,565 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:10:30,653 [281] [DEBUG] [app] Starting request: urn:request:4a7a611a-bda4-45ca-9ce3-6f07d719e009 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:10:30,653 [282] [DEBUG] [app] Starting request: urn:request:0d12b902-e450-4930-bf90-e4729eecd3b1 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:10:30,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:10:30,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:10:30,656 [290] [DEBUG] [app] Starting request: urn:request:ebb13670-917d-4375-b4d2-bf01e2ace7b5 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:10:30,656 [284] [DEBUG] [app] Starting request: urn:request:f23ccd64-164b-440f-9660-0343c6c7b403 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:10:30,656 [290] [DEBUG] [app] Ending request: urn:request:ebb13670-917d-4375-b4d2-bf01e2ace7b5 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:ebb13670-917d-4375-b4d2-bf01e2ace7b5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:10:30,656 [284] [DEBUG] [app] Ending request: urn:request:f23ccd64-164b-440f-9660-0343c6c7b403 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f23ccd64-164b-440f-9660-0343c6c7b403', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:10:30,656 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:10:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:10:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:10:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:10:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:10:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:10:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:10:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:10:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:10:30,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:10:30,659 [281] [DEBUG] [app] Starting request: urn:request:042d2d78-84d2-4c2e-86d6-d9fe41b99cf0 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:10:30,659 [279] [DEBUG] [app] Starting request: urn:request:ae233432-45a0-40b3-bd80-de4366d69ce2 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:10:30,660 [281] [DEBUG] [app] Ending request: urn:request:042d2d78-84d2-4c2e-86d6-d9fe41b99cf0 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:042d2d78-84d2-4c2e-86d6-d9fe41b99cf0', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:10:30,660 [279] [DEBUG] [app] Ending request: urn:request:ae233432-45a0-40b3-bd80-de4366d69ce2 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:ae233432-45a0-40b3-bd80-de4366d69ce2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:10:30,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:10:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:10:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:10:30,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:10:30,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:10:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:10:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:10:30,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:10:30,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:10:30,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:10:30,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:10:30,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:10:30,674 [282] [DEBUG] [app] Ending request: urn:request:0d12b902-e450-4930-bf90-e4729eecd3b1 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:0d12b902-e450-4930-bf90-e4729eecd3b1', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:10:30,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:30,674 [281] [DEBUG] [app] Ending request: urn:request:4a7a611a-bda4-45ca-9ce3-6f07d719e009 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:4a7a611a-bda4-45ca-9ce3-6f07d719e009', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:10:30,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:10:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:10:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:10:30,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:30,674 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:10:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:10:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
quotatotalworker stdout | 2024-04-22 04:10:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:10:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:46.054492+00:00 (in 14.999467 seconds)
quotatotalworker stdout | 2024-04-22 04:10:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:10:46 UTC)" (scheduled at 2024-04-22 04:10:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:10:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:10:31,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:10:31,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:10:46 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:10:31,405 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:10:32,921 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:10:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:10:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:43.759375+00:00 (in 9.999519 seconds)
notificationworker stdout | 2024-04-22 04:10:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:10:43 UTC)" (scheduled at 2024-04-22 04:10:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:10:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:10:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 10, 33, 760314), True, datetime.datetime(2024, 4, 22, 4, 10, 33, 760314), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:10:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:10:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:10:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:10:43 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:10:34,337 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:10:34,617 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
gunicorn-secscan stdout | 2024-04-22 04:10:34,771 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:10:34,774 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:10:34,776 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
exportactionlogsworker stdout | 2024-04-22 04:10:34,809 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:10:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:10:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:56.873109+00:00 (in 21.000706 seconds)
securityworker stdout | 2024-04-22 04:10:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:05 UTC)" (scheduled at 2024-04-22 04:10:35.871852+00:00)
securityworker stdout | 2024-04-22 04:10:35,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:10:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:10:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:10:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:10:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:10:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:10:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:05 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:10:35,905 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:10:37,114 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:10:37,120 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:10:37,277 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:10:38,237 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
exportactionlogsworker stdout | 2024-04-22 04:10:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:10:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:41.564959+00:00 (in 1.997462 seconds)
exportactionlogsworker stdout | 2024-04-22 04:10:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:39 UTC)" (scheduled at 2024-04-22 04:10:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:10:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:10:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:39 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:10:39,581 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:10:39,615 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:10:39,972 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:10:40,020 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:10:41,091 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:10:41,096 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:10:41,099 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:10:41,102 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:10:41,105 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:10:41,107 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:10:41,119 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:10:41,122 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:10:41,125 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 04:10:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:10:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:11.264267+00:00 (in 29.999504 seconds)
autopruneworker stdout | 2024-04-22 04:10:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:11 UTC)" (scheduled at 2024-04-22 04:10:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:10:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713758981271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:10:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:10:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:10:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:11 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:10:41,342 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
exportactionlogsworker stdout | 2024-04-22 04:10:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:10:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:39.566970+00:00 (in 58.001460 seconds)
exportactionlogsworker stdout | 2024-04-22 04:10:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:41 UTC)" (scheduled at 2024-04-22 04:10:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:10:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:10:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 10, 41, 565819), True, datetime.datetime(2024, 4, 22, 4, 10, 41, 565819), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:10:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:10:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:10:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:10:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:10:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:22.058978+00:00 (in 39.001285 seconds)
namespacegcworker stdout | 2024-04-22 04:10:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:43 UTC)" (scheduled at 2024-04-22 04:10:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:10:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:10:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 10, 43, 58014), True, datetime.datetime(2024, 4, 22, 4, 10, 43, 58014), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:10:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:10:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:10:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:11:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:10:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:10:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:10:53.759375+00:00 (in 9.999528 seconds)
notificationworker stdout | 2024-04-22 04:10:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:10:53 UTC)" (scheduled at 2024-04-22 04:10:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:10:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:10:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 10, 43, 760260), True, datetime.datetime(2024, 4, 22, 4, 10, 43, 760260), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:10:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:10:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:10:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:10:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:10:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:10:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:14.952062+00:00 (in 29.999516 seconds)
gcworker stdout | 2024-04-22 04:10:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:14 UTC)" (scheduled at 2024-04-22 04:10:44.952062+00:00)
gcworker stdout | 2024-04-22 04:10:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549444952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:10:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:10:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:10:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:10:45,653 [282] [DEBUG] [app] Starting request: urn:request:2b0cb473-26b5-4bb6-a786-d047cc328506 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:10:45,653 [278] [DEBUG] [app] Starting request: urn:request:db643bff-bd19-4dbb-b4ff-8481b24895ea (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:10:45,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:10:45,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:10:45,657 [285] [DEBUG] [app] Starting request: urn:request:32a66c33-8256-4db8-998a-2bd49c3effe7 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:10:45,657 [284] [DEBUG] [app] Starting request: urn:request:57247a81-b28d-49ee-b3e8-fdab845b3f4c (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:10:45,657 [285] [DEBUG] [app] Ending request: urn:request:32a66c33-8256-4db8-998a-2bd49c3effe7 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:32a66c33-8256-4db8-998a-2bd49c3effe7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:10:45,657 [284] [DEBUG] [app] Ending request: urn:request:57247a81-b28d-49ee-b3e8-fdab845b3f4c (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:57247a81-b28d-49ee-b3e8-fdab845b3f4c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:10:45,658 [285] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:10:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:10:45,658 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:10:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:10:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:10:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-web stdout | 2024-04-22 04:10:45,658 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:10:45,658 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:10:45,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:10:45,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:10:45,660 [278] [DEBUG] [app] Starting request: urn:request:7a246b30-dda0-4158-b3af-9c45234a9810 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:10:45,660 [278] [DEBUG] [app] Ending request: urn:request:7a246b30-dda0-4158-b3af-9c45234a9810 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:7a246b30-dda0-4158-b3af-9c45234a9810', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:10:45,660 [279] [DEBUG] [app] Starting request: urn:request:f91736ff-7a3f-47b7-b801-70a581fdd574 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:10:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:10:45,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:10:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:10:45,661 [279] [DEBUG] [app] Ending request: urn:request:f91736ff-7a3f-47b7-b801-70a581fdd574 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:f91736ff-7a3f-47b7-b801-70a581fdd574', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:10:45,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:10:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:10:45,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:10:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:10:45,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:10:45,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:10:45,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:10:45,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:10:45,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:10:45,675 [278] [DEBUG] [app] Ending request: urn:request:db643bff-bd19-4dbb-b4ff-8481b24895ea (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:db643bff-bd19-4dbb-b4ff-8481b24895ea', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:10:45,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:45,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:10:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:10:45,675 [282] [DEBUG] [app] Ending request: urn:request:2b0cb473-26b5-4bb6-a786-d047cc328506 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2b0cb473-26b5-4bb6-a786-d047cc328506', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:10:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:10:45,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:45,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:10:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:10:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
quotatotalworker stdout | 2024-04-22 04:10:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:10:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:01.054492+00:00 (in 14.999451 seconds)
quotatotalworker stdout | 2024-04-22 04:10:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:11:01 UTC)" (scheduled at 2024-04-22 04:10:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:10:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:10:46,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:10:46,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:11:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:10:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:10:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:17.052354+00:00 (in 29.999486 seconds)
buildlogsarchiver stdout | 2024-04-22 04:10:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:17 UTC)" (scheduled at 2024-04-22 04:10:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:10:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 10, 47, 53257), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:10:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:10:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:10:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:10:50,419 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:10:51,821 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
gunicorn-web stdout | 2024-04-22 04:10:53,729 [281] [DEBUG] [app] Starting request: urn:request:61c1a012-4ad2-4d3c-b417-8e64cc3a62af (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:10:53,729 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:53,729 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:53,729 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:53,738 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:10:53,739 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:10:53,739 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:53,739 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:53,739 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:53,739 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:53,739 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:53,739 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:53,741 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:10:53,747 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:53,748 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:53,752 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:53,755 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['vulnerability_found', 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:53,757 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['slack', 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:53,759 [281] [DEBUG] [peewee] ('INSERT INTO "repositorynotification" ("uuid", "repository_id", "event_id", "method_id", "title", "config_json", "event_config_json", "number_of_failures") VALUES (%s, %s, %s, %s, %s, %s, %s, %s) RETURNING "repositorynotification"."id"', ['27d600e3-69ac-4c25-9b0d-4999e865fe2c', 1, 6, 5, 'vul slack', '{"url": "https://hooks.slack.com/services/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"}', '{"level": "2"}', 0])
notificationworker stdout | 2024-04-22 04:10:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:10:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:03.759375+00:00 (in 9.999553 seconds)
notificationworker stdout | 2024-04-22 04:10:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:11:03 UTC)" (scheduled at 2024-04-22 04:10:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:10:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:10:53,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 10, 53, 760215), True, datetime.datetime(2024, 4, 22, 4, 10, 53, 760215), 0, 'notification/%', 50, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:53,764 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:53,767 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:53,769 [281] [DEBUG] [peewee] ('INSERT INTO "logentry3" ("kind_id", "account_id", "performer_id", "repository_id", "datetime", "ip", "metadata_json") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "logentry3"."id"', [6, 2, 1, 1, datetime.datetime(2024, 4, 22, 4, 10, 53, 766854), '10.128.2.8', '{"repo": "pushno", "namespace": "build_test", "notification_id": "27d600e3-69ac-4c25-9b0d-4999e865fe2c", "event": "vulnerability_found", "method": "slack"}'])
notificationworker stdout | 2024-04-22 04:10:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:10:53,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:10:53,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:11:03 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:10:53,773 [281] [DEBUG] [app] Ending request: urn:request:61c1a012-4ad2-4d3c-b417-8e64cc3a62af (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:61c1a012-4ad2-4d3c-b417-8e64cc3a62af', 'remote_addr': '10.128.2.8', 'http_method': 'POST', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': {'event': 'vulnerability_found', 'method': 'slack', 'config': {'url': 'https://hooks.slack.com/services/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'}, 'eventConfig': {'level': '2'}, 'title': 'vul slack'}, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:10:53,774 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:53,774 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:10:53 +0000] "POST /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 201 283 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:10:53 +0000] "POST /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 201 283 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno/create-notification" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.048 1927 0.047)
gunicorn-web stdout | 2024-04-22 04:10:54,111 [278] [DEBUG] [app] Starting request: urn:request:93a29cb4-98c8-40de-9408-94668ff7af4b (/api/v1/repository/build_test/pushno/tag/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:10:54,111 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:54,111 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:54,112 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:54,121 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:10:54,121 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:10:54,121 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:54,121 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:54,121 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:54,121 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:54,122 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:54,122 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:54,124 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:10:54,130 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:54,131 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:54,135 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:54,138 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:54,140 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:54,142 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."repository_id", "t1"."manifest_id", "t1"."lifetime_start_ms", "t1"."lifetime_end_ms", "t1"."hidden", "t1"."reversion", "t1"."tag_kind_id", "t1"."linked_tag_id", "t2"."id", "t2"."digest", "t2"."media_type_id", "t2"."layers_compressed_size", "t2"."config_media_type" FROM "tag" AS "t1" INNER JOIN "manifest" AS "t2" ON ("t1"."manifest_id" = "t2"."id") WHERE ((("t1"."repository_id" = %s) AND (("t1"."lifetime_end_ms" IS %s) OR ("t1"."lifetime_end_ms" > %s))) AND ("t1"."hidden" = %s)) ORDER BY "t1"."lifetime_start_ms" DESC, "t1"."name" LIMIT %s OFFSET %s', [1, None, 1713759054142, False, 101, 0])
gunicorn-web stdout | 2024-04-22 04:10:54,145 [278] [DEBUG] [app] Ending request: urn:request:93a29cb4-98c8-40de-9408-94668ff7af4b (/api/v1/repository/build_test/pushno/tag/) {'endpoint': 'api.listrepositorytags', 'request_id': 'urn:request:93a29cb4-98c8-40de-9408-94668ff7af4b', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true', 'path': '/api/v1/repository/build_test/pushno/tag/', 'parameters': {'limit': '100', 'page': '1', 'onlyActiveTags': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:10:54,146 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:54,146 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:10:54 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:10:54 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.1" 200 49 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.036 1582 0.036)
gunicorn-web stdout | 2024-04-22 04:10:54,847 [278] [DEBUG] [app] Starting request: urn:request:590e75c9-3697-4907-acba-88df638d60c2 (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:10:54,847 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:54,847 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:54,848 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:54,857 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:10:54,857 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:10:54,857 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:54,857 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:54,857 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:54,857 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:54,857 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:54,858 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:54,859 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:10:54,866 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:54,866 [278] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:54,867 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:54,869 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:54,871 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:10:54,873 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:54,873 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:54,874 [278] [DEBUG] [app] Ending request: urn:request:590e75c9-3697-4907-acba-88df638d60c2 (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:590e75c9-3697-4907-acba-88df638d60c2', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeStats=true&includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeStats': 'true', 'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:10:54,875 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:54,875 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:10:54 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.0" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:10:54 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.1" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1557 0.030)
gunicorn-web stdout | 2024-04-22 04:10:55,264 [278] [DEBUG] [app] Starting request: urn:request:700f5fe9-979b-4037-bba7-0cf516fd7967 (/api/v1/repository/build_test/pushno/permissions/user/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:10:55,264 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:55,264 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:55,265 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:55,273 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:10:55,274 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:10:55,274 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:55,274 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:55,274 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:55,274 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:55,274 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:55,274 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:55,276 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:10:55,282 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:55,283 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:55,285 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed", "t2"."id", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "user" AS "t1" ON ("t3"."user_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:10:55,288 [278] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."username" FROM "user" AS "t1" INNER JOIN "teammember" AS "t2" ON ("t2"."user_id" = "t1"."id") INNER JOIN "team" AS "t3" ON ("t2"."team_id" = "t3"."id") WHERE ((("t3"."organization_id" = %s) AND ("t1"."robot" = %s)) AND ("t1"."id" IN (%s)))', [2, False, 1])
gunicorn-web stdout | 2024-04-22 04:10:55,291 [278] [DEBUG] [app] Ending request: urn:request:700f5fe9-979b-4037-bba7-0cf516fd7967 (/api/v1/repository/build_test/pushno/permissions/user/) {'endpoint': 'api.repositoryuserpermissionlist', 'request_id': 'urn:request:700f5fe9-979b-4037-bba7-0cf516fd7967', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/user/', 'path': '/api/v1/repository/build_test/pushno/permissions/user/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:10:55,291 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:10:55 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.1" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.028 1539 0.028)
gunicorn-web stdout | 2024-04-22 04:10:55,291 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:10:55 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.0" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
builder stdout | 2024-04-22 04:10:55,469 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
gunicorn-web stdout | 2024-04-22 04:10:55,987 [278] [DEBUG] [app] Starting request: urn:request:018494c0-f918-476c-ac82-f8569ff9d9dc (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:10:55,987 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:55,987 [279] [DEBUG] [app] Starting request: urn:request:a9039ca0-b432-4f39-839d-3b3d5f1b53fc (/api/v1/repository/build_test/pushno/permissions/team/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:10:55,987 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:55,988 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:55,988 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:55,988 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:55,988 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:55,997 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:10:55,997 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:10:55,997 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:10:55,997 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:55,997 [279] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:55,997 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:10:55,998 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:55,998 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:55,998 [279] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:55,998 [279] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:55,998 [279] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:55,998 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:55,998 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:55,998 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:55,998 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:55,998 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:56,000 [279] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:10:56,000 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:10:56,006 [279] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:56,006 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:56,007 [279] [DEBUG] [peewee] ('SELECT "t1"."name", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "team" AS "t1" ON ("t3"."team_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:10:56,007 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,009 [279] [DEBUG] [app] Ending request: urn:request:a9039ca0-b432-4f39-839d-3b3d5f1b53fc (/api/v1/repository/build_test/pushno/permissions/team/) {'endpoint': 'api.repositoryteampermissionlist', 'request_id': 'urn:request:a9039ca0-b432-4f39-839d-3b3d5f1b53fc', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/team/', 'path': '/api/v1/repository/build_test/pushno/permissions/team/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:10:56,010 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:56,010 [279] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:10:56 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.0" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:10:56 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.1" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.024 1539 0.024)
gunicorn-web stdout | 2024-04-22 04:10:56,011 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t3"."username" = %s) AND ("t2"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:10:56,014 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,016 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [4, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,018 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,020 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,021 [282] [DEBUG] [app] Starting request: urn:request:bdaed06f-8176-4863-9414-ece9fcc16160 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:10:56,021 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:56,021 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:56,022 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,022 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,025 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,027 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,029 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,030 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:10:56,030 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:10:56,030 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:56,031 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:10:56,031 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:10:56,031 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:56,031 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:56,031 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:56,031 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,033 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [4, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,033 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:10:56,035 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,037 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,039 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:10:56,039 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,040 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,041 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,043 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,044 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:10:56,045 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:10:56,048 [278] [DEBUG] [app] Ending request: urn:request:018494c0-f918-476c-ac82-f8569ff9d9dc (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:018494c0-f918-476c-ac82-f8569ff9d9dc', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:10:56,048 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:56,048 [282] [DEBUG] [app] Ending request: urn:request:bdaed06f-8176-4863-9414-ece9fcc16160 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:bdaed06f-8176-4863-9414-ece9fcc16160', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:10:56 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 200 2340 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.062 1535 0.062)
gunicorn-web stdout | 2024-04-22 04:10:56,048 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:10:56 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 200 2340 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:10:56,049 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:10:56,049 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:10:56 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:10:56 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.029 1536 0.029)
securityworker stdout | 2024-04-22 04:10:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:10:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:05.871852+00:00 (in 8.998244 seconds)
securityworker stdout | 2024-04-22 04:10:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:26 UTC)" (scheduled at 2024-04-22 04:10:56.873109+00:00)
securityworker stdout | 2024-04-22 04:10:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:10:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:10:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:10:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:10:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:10:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:10:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:10:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:10:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:10:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:10:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:10:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:10:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 5, 56, 880914), 1, 2])
securityworker stdout | 2024-04-22 04:10:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:10:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:10:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 5, 56, 880914), 1, 2])
securityworker stdout | 2024-04-22 04:10:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:10:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:10:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:10:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:10:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:10:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:10:56,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:10:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:10:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:10:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:10:57,224 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:10:58,428 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:10:58,546 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:11:00,199 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:11:00,201 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:11:00,205 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:11:00,218 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:11:00,222 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:11:00,495 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:11:00,592 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:11:00,652 [279] [DEBUG] [app] Starting request: urn:request:6a664ba0-5017-4b5a-a40f-835246c43ccb (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:11:00,652 [282] [DEBUG] [app] Starting request: urn:request:be90d601-636e-491e-b407-746e35807348 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:11:00,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:11:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:11:00,655 [284] [DEBUG] [app] Starting request: urn:request:eef5a57a-fef6-46da-b7bd-392bc304ddc2 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:11:00,655 [291] [DEBUG] [app] Starting request: urn:request:3671f286-3c1d-4c61-aac9-013bedbd962a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:11:00,656 [284] [DEBUG] [app] Ending request: urn:request:eef5a57a-fef6-46da-b7bd-392bc304ddc2 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:eef5a57a-fef6-46da-b7bd-392bc304ddc2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:11:00,656 [291] [DEBUG] [app] Ending request: urn:request:3671f286-3c1d-4c61-aac9-013bedbd962a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:3671f286-3c1d-4c61-aac9-013bedbd962a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:11:00,656 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:11:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:11:00,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:11:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:11:00,656 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:11:00,656 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:11:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:11:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:11:00,657 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:11:00,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:11:00,659 [282] [DEBUG] [app] Starting request: urn:request:92fc9641-08a0-4d68-b86a-5364a50f9ce3 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:11:00,659 [282] [DEBUG] [app] Ending request: urn:request:92fc9641-08a0-4d68-b86a-5364a50f9ce3 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:92fc9641-08a0-4d68-b86a-5364a50f9ce3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:11:00,659 [278] [DEBUG] [app] Starting request: urn:request:7481d63f-3aa8-427e-b0f9-6942ea02f7b4 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:11:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:11:00,659 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:11:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:11:00,659 [278] [DEBUG] [app] Ending request: urn:request:7481d63f-3aa8-427e-b0f9-6942ea02f7b4 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:7481d63f-3aa8-427e-b0f9-6942ea02f7b4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:11:00,659 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:11:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:11:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:11:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:11:00,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:11:00,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:11:00,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:11:00,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:11:00,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:11:00,673 [279] [DEBUG] [app] Ending request: urn:request:6a664ba0-5017-4b5a-a40f-835246c43ccb (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:6a664ba0-5017-4b5a-a40f-835246c43ccb', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:11:00,673 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:11:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:11:00,674 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:11:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:11:00,674 [282] [DEBUG] [app] Ending request: urn:request:be90d601-636e-491e-b407-746e35807348 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:be90d601-636e-491e-b407-746e35807348', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:11:00,674 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:11:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.022)
gunicorn-web stdout | 2024-04-22 04:11:00,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:11:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:11:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:11:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:16.054492+00:00 (in 14.999469 seconds)
quotatotalworker stdout | 2024-04-22 04:11:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:11:16 UTC)" (scheduled at 2024-04-22 04:11:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:11:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:11:01,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:11:01,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:11:16 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:11:01,441 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:11:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:11:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:16.552337+00:00 (in 13.995506 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:11:02,557 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:02 UTC)" (scheduled at 2024-04-22 04:11:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:11:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:11:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:11:02,957 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:11:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:11:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:13.759375+00:00 (in 9.999491 seconds)
notificationworker stdout | 2024-04-22 04:11:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:11:13 UTC)" (scheduled at 2024-04-22 04:11:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:11:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:11:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 11, 3, 760195), True, datetime.datetime(2024, 4, 22, 4, 11, 3, 760195), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:11:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:11:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:11:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:11:13 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:11:04,373 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:11:04,626 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
gunicorn-secscan stdout | 2024-04-22 04:11:04,779 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:11:04,781 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:11:04,784 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
exportactionlogsworker stdout | 2024-04-22 04:11:04,846 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:11:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:11:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:26.873109+00:00 (in 21.000723 seconds)
securityworker stdout | 2024-04-22 04:11:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:35 UTC)" (scheduled at 2024-04-22 04:11:05.871852+00:00)
securityworker stdout | 2024-04-22 04:11:05,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:11:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:11:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:11:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:11:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:11:05,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:11:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:35 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:11:05,941 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
repositorygcworker stdout | 2024-04-22 04:11:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:11:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:13.555667+00:00 (in 7.002656 seconds)
repositorygcworker stdout | 2024-04-22 04:11:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:06 UTC)" (scheduled at 2024-04-22 04:11:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:11:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:11:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 11, 6, 553424), True, datetime.datetime(2024, 4, 22, 4, 11, 6, 553424), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:11:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:11:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:11:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:06 UTC)" executed successfully
autopruneworker stdout | 2024-04-22 04:11:07,140 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:11:07,155 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:11:07,313 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:11:08,272 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:11:09,618 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:11:09,651 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:11:10,008 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:11:10,055 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:11:11,100 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:11:11,105 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:11:11,110 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:11:11,112 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:11:11,115 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:11:11,118 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:11:11,132 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:11:11,134 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:11:11,137 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 04:11:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:11:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:41.264267+00:00 (in 29.999443 seconds)
autopruneworker stdout | 2024-04-22 04:11:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:41 UTC)" (scheduled at 2024-04-22 04:11:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:11:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759011272, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:11:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:11:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:11:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:41 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:11:11,378 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:11:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:11:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:51.555445+00:00 (in 37.999257 seconds)
repositorygcworker stdout | 2024-04-22 04:11:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:13 UTC)" (scheduled at 2024-04-22 04:11:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:11:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:11:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:11:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:11:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:19.762424+00:00 (in 6.002528 seconds)
notificationworker stdout | 2024-04-22 04:11:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:11:23 UTC)" (scheduled at 2024-04-22 04:11:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:11:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:11:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 11, 13, 760332), True, datetime.datetime(2024, 4, 22, 4, 11, 13, 760332), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:11:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:11:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:11:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:11:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:11:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:11:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:44.952062+00:00 (in 29.999552 seconds)
gcworker stdout | 2024-04-22 04:11:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:44 UTC)" (scheduled at 2024-04-22 04:11:14.952062+00:00)
gcworker stdout | 2024-04-22 04:11:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549474952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:11:14,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:11:14,964 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:11:14,964 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:11:15,652 [279] [DEBUG] [app] Starting request: urn:request:b279a13d-c26e-4bab-808e-5678ec41dcbb (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:11:15,652 [282] [DEBUG] [app] Starting request: urn:request:f0406173-dd82-46ee-aa96-81af4cabd53e (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:11:15,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:11:15,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:11:15,656 [284] [DEBUG] [app] Starting request: urn:request:1576cf8a-3df0-4b7c-aa47-eebd7998720f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:11:15,656 [292] [DEBUG] [app] Starting request: urn:request:2bafa40d-7ddf-45a3-956b-6b2e805a5f98 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:11:15,656 [292] [DEBUG] [app] Ending request: urn:request:2bafa40d-7ddf-45a3-956b-6b2e805a5f98 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:2bafa40d-7ddf-45a3-956b-6b2e805a5f98', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:11:15,656 [284] [DEBUG] [app] Ending request: urn:request:1576cf8a-3df0-4b7c-aa47-eebd7998720f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:1576cf8a-3df0-4b7c-aa47-eebd7998720f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:11:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:11:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:11:15,656 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:11:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:11:15,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:11:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:11:15,656 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:11:15,656 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:11:15,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:11:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:11:15,659 [279] [DEBUG] [app] Starting request: urn:request:44f6928f-94f4-4b77-992d-48b46bd36224 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:11:15,659 [279] [DEBUG] [app] Ending request: urn:request:44f6928f-94f4-4b77-992d-48b46bd36224 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:44f6928f-94f4-4b77-992d-48b46bd36224', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:11:15,659 [278] [DEBUG] [app] Starting request: urn:request:832a2273-bc1c-493b-b7a8-6122aa8ce417 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:11:15,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:11:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:11:15,660 [278] [DEBUG] [app] Ending request: urn:request:832a2273-bc1c-493b-b7a8-6122aa8ce417 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:832a2273-bc1c-493b-b7a8-6122aa8ce417', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:11:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:11:15,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:11:15,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:11:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:11:15,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:11:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:11:15,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:11:15,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:11:15,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:11:15,673 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:11:15,674 [282] [DEBUG] [app] Ending request: urn:request:f0406173-dd82-46ee-aa96-81af4cabd53e (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f0406173-dd82-46ee-aa96-81af4cabd53e', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:11:15,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:11:15,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:11:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:11:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 04:11:15,681 [279] [DEBUG] [app] Ending request: urn:request:b279a13d-c26e-4bab-808e-5678ec41dcbb (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b279a13d-c26e-4bab-808e-5678ec41dcbb', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:11:15,681 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:11:15,681 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:11:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:11:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.030 118 0.030)
quotatotalworker stdout | 2024-04-22 04:11:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:11:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:31.054492+00:00 (in 14.999470 seconds)
quotatotalworker stdout | 2024-04-22 04:11:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:11:31 UTC)" (scheduled at 2024-04-22 04:11:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:11:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:11:16,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:11:16,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:11:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:11:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:11:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:02.556208+00:00 (in 46.003288 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:11:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:16 UTC)" (scheduled at 2024-04-22 04:11:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:11:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:11:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 11, 16, 553357), True, datetime.datetime(2024, 4, 22, 4, 11, 16, 553357), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:11:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:11:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:11:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:11:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:11:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:47.052354+00:00 (in 29.999449 seconds)
buildlogsarchiver stdout | 2024-04-22 04:11:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:47 UTC)" (scheduled at 2024-04-22 04:11:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:11:17,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 11, 17, 53299), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:11:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:11:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:11:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:11:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:11:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:23.759375+00:00 (in 3.996441 seconds)
notificationworker stdout | 2024-04-22 04:11:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:19 UTC)" (scheduled at 2024-04-22 04:11:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:11:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:11:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:11:20,453 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:11:21,858 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 04:11:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:11:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:43.057186+00:00 (in 20.997641 seconds)
namespacegcworker stdout | 2024-04-22 04:11:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:22 UTC)" (scheduled at 2024-04-22 04:11:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:11:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:11:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:11:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:11:23,760 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:33.759375+00:00 (in 9.999398 seconds)
notificationworker stdout | 2024-04-22 04:11:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:11:33 UTC)" (scheduled at 2024-04-22 04:11:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:11:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:11:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 11, 23, 760368), True, datetime.datetime(2024, 4, 22, 4, 11, 23, 760368), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:11:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:11:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:11:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:11:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:11:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:11:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:24.361582+00:00 (in 59.999452 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:11:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:24 UTC)" (scheduled at 2024-04-22 04:11:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:11:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:11:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:11:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:11:25,507 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
gunicorn-web stdout | 2024-04-22 04:11:26,419 [278] [DEBUG] [app] Starting request: urn:request:e8b74243-f87a-4a1c-b2dd-eab0887ed442 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:11:26,420 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:11:26,420 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:11:26,420 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:11:26,430 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:11:26,430 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:11:26,430 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:11:26,430 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:11:26,430 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:11:26,430 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:11:26,430 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:11:26,430 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:11:26,432 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:11:26,438 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:11:26,439 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:11:26,444 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:11:26,448 [278] [DEBUG] [app] Ending request: urn:request:e8b74243-f87a-4a1c-b2dd-eab0887ed442 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:e8b74243-f87a-4a1c-b2dd-eab0887ed442', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:11:26,448 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:11:26,449 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:11:26 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:11:26 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.031 1555 0.031)
securityworker stdout | 2024-04-22 04:11:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:11:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:35.871852+00:00 (in 8.998252 seconds)
securityworker stdout | 2024-04-22 04:11:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:56 UTC)" (scheduled at 2024-04-22 04:11:26.873109+00:00)
securityworker stdout | 2024-04-22 04:11:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:11:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:11:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:11:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:11:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:11:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:11:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:11:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:11:26,882 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:11:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:11:26,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:11:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:11:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 6, 26, 881973), 1, 2])
securityworker stdout | 2024-04-22 04:11:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:11:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:11:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 6, 26, 881973), 1, 2])
securityworker stdout | 2024-04-22 04:11:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:11:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:11:26,900 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:11:26,900 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:11:26,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:11:26,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:11:26,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:11:26,901 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:11:26,901 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:11:26,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:11:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:11:27,260 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:11:28,464 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:11:28,560 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:11:30,208 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:11:30,210 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:11:30,216 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:11:30,231 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:11:30,234 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:11:30,510 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:11:30,629 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:11:30,653 [279] [DEBUG] [app] Starting request: urn:request:61ee63a9-006f-481e-998f-33bc965d5bf7 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:11:30,653 [282] [DEBUG] [app] Starting request: urn:request:87125e19-4be6-405e-bff0-b21e38c1f794 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:11:30,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:11:30,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:11:30,656 [291] [DEBUG] [app] Starting request: urn:request:f025b808-8316-4d79-8751-77a412e6aa2b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:11:30,656 [291] [DEBUG] [app] Ending request: urn:request:f025b808-8316-4d79-8751-77a412e6aa2b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f025b808-8316-4d79-8751-77a412e6aa2b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:11:30,656 [284] [DEBUG] [app] Starting request: urn:request:f64c0474-753e-49d2-944d-27e4ada648c6 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:11:30,657 [284] [DEBUG] [app] Ending request: urn:request:f64c0474-753e-49d2-944d-27e4ada648c6 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f64c0474-753e-49d2-944d-27e4ada648c6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:11:30,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:11:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:11:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:11:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:11:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:11:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:11:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:11:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:11:30,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:11:30,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:11:30,659 [279] [DEBUG] [app] Starting request: urn:request:e48b81cb-4553-4b52-bc1d-992a6be96e35 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:11:30,659 [278] [DEBUG] [app] Starting request: urn:request:55a01dcf-cd66-4728-8fd2-a7519bc9237c (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:11:30,660 [279] [DEBUG] [app] Ending request: urn:request:e48b81cb-4553-4b52-bc1d-992a6be96e35 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e48b81cb-4553-4b52-bc1d-992a6be96e35', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:11:30,660 [278] [DEBUG] [app] Ending request: urn:request:55a01dcf-cd66-4728-8fd2-a7519bc9237c (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:55a01dcf-cd66-4728-8fd2-a7519bc9237c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:11:30,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:11:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:11:30,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:11:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:11:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:11:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:11:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:11:30,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:11:30,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:11:30,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:11:30,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:11:30,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:11:30,674 [279] [DEBUG] [app] Ending request: urn:request:61ee63a9-006f-481e-998f-33bc965d5bf7 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:61ee63a9-006f-481e-998f-33bc965d5bf7', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:11:30,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:11:30,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:11:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:11:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:11:30,684 [282] [DEBUG] [app] Ending request: urn:request:87125e19-4be6-405e-bff0-b21e38c1f794 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:87125e19-4be6-405e-bff0-b21e38c1f794', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:11:30,684 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:11:30,684 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:11:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:11:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.032 118 0.032)
quotatotalworker stdout | 2024-04-22 04:11:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:11:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:46.054492+00:00 (in 14.999464 seconds)
quotatotalworker stdout | 2024-04-22 04:11:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:11:46 UTC)" (scheduled at 2024-04-22 04:11:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:11:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:11:31,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:11:31,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:11:46 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:11:31,478 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:11:32,977 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:11:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:11:33,760 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:43.759375+00:00 (in 9.999314 seconds)
notificationworker stdout | 2024-04-22 04:11:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:11:43 UTC)" (scheduled at 2024-04-22 04:11:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:11:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:11:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 11, 33, 760480), True, datetime.datetime(2024, 4, 22, 4, 11, 33, 760480), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:11:33,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:11:33,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:11:33,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:11:43 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:11:34,405 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:11:34,662 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
gunicorn-secscan stdout | 2024-04-22 04:11:34,787 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:11:34,790 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:11:34,792 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
exportactionlogsworker stdout | 2024-04-22 04:11:34,883 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:11:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:11:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:56.873109+00:00 (in 21.000734 seconds)
securityworker stdout | 2024-04-22 04:11:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:12:05 UTC)" (scheduled at 2024-04-22 04:11:35.871852+00:00)
securityworker stdout | 2024-04-22 04:11:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:11:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:11:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:11:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:11:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:11:35,887 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:11:35,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:12:05 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:11:35,961 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:11:37,152 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:11:37,192 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:11:37,321 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:11:38,302 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
exportactionlogsworker stdout | 2024-04-22 04:11:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:11:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:41.564959+00:00 (in 1.997411 seconds)
exportactionlogsworker stdout | 2024-04-22 04:11:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:39 UTC)" (scheduled at 2024-04-22 04:11:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:11:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:11:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:39 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:11:39,635 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:11:39,687 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:11:40,044 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:11:40,069 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:11:41,110 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:11:41,113 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:11:41,119 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:11:41,123 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:11:41,126 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:11:41,129 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:11:41,140 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:11:41,144 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:11:41,147 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 04:11:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:11:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:11.264267+00:00 (in 29.999433 seconds)
autopruneworker stdout | 2024-04-22 04:11:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:12:11 UTC)" (scheduled at 2024-04-22 04:11:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:11:41,275 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759041275, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:11:41,279 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:11:41,279 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:11:41,279 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:12:11 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:11:41,406 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
exportactionlogsworker stdout | 2024-04-22 04:11:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:11:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:53.566665+00:00 (in 12.001203 seconds)
exportactionlogsworker stdout | 2024-04-22 04:11:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:41 UTC)" (scheduled at 2024-04-22 04:11:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:11:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:11:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 11, 41, 565754), True, datetime.datetime(2024, 4, 22, 4, 11, 41, 565754), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:11:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:11:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:11:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:41 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 04:11:42,969 [61] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
blobuploadcleanupworker stdout | 2024-04-22 04:11:42,969 [61] [INFO] [apscheduler.executors.default] Running job "BlobUploadCleanupWorker._try_cleanup_uploads (trigger: interval[1:00:00], next run at: 2024-04-22 04:11:42 UTC)" (scheduled at 2024-04-22 04:11:42.968897+00:00)
blobuploadcleanupworker stdout | 2024-04-22 04:11:42,969 [61] [DEBUG] [util.locking] Acquiring global lock BLOB_CLEANUP
blobuploadcleanupworker stdout | 2024-04-22 04:11:42,970 [61] [DEBUG] [redis_lock.acquire] Getting 'lock:BLOB_CLEANUP' ...
blobuploadcleanupworker stdout | 2024-04-22 04:11:42,970 [61] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 05:11:42.968897+00:00 (in 3599.998620 seconds)
blobuploadcleanupworker stdout | 2024-04-22 04:11:42,973 [61] [INFO] [redis_lock.acquire] Got lock for 'lock:BLOB_CLEANUP'.
blobuploadcleanupworker stdout | 2024-04-22 04:11:42,973 [61] [DEBUG] [util.locking] Acquired lock BLOB_CLEANUP
blobuploadcleanupworker stdout | 2024-04-22 04:11:42,973 [61] [DEBUG] [__main__] Performing blob upload cleanup
blobuploadcleanupworker stdout | 2024-04-22 04:11:42,974 [61] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."created" <= %s) LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 20, 4, 11, 42, 973267), 1, 0])
blobuploadcleanupworker stdout | 2024-04-22 04:11:42,983 [61] [DEBUG] [__main__] No additional stale blob uploads found
blobuploadcleanupworker stdout | 2024-04-22 04:11:42,983 [61] [DEBUG] [data.database] Disconnecting from database.
blobuploadcleanupworker stdout | 2024-04-22 04:11:42,983 [61] [DEBUG] [__main__] Cleaning partial uploads not applicable to storage location "default"
blobuploadcleanupworker stdout | 2024-04-22 04:11:42,983 [61] [DEBUG] [util.locking] Releasing lock BLOB_CLEANUP
blobuploadcleanupworker stdout | 2024-04-22 04:11:42,983 [61] [DEBUG] [redis_lock.release] Releasing 'lock:BLOB_CLEANUP'.
blobuploadcleanupworker stdout | 2024-04-22 04:11:42,984 [61] [DEBUG] [util.locking] Released lock BLOB_CLEANUP
blobuploadcleanupworker stdout | 2024-04-22 04:11:42,984 [61] [INFO] [apscheduler.executors.default] Job "BlobUploadCleanupWorker._try_cleanup_uploads (trigger: interval[1:00:00], next run at: 2024-04-22 05:11:42 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:11:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:11:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:22.058978+00:00 (in 39.001335 seconds)
namespacegcworker stdout | 2024-04-22 04:11:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:43 UTC)" (scheduled at 2024-04-22 04:11:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:11:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:11:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 11, 43, 57927), True, datetime.datetime(2024, 4, 22, 4, 11, 43, 57927), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:11:43,067 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:11:43,067 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:11:43,067 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:12:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:11:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:11:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:11:53.759375+00:00 (in 9.999471 seconds)
notificationworker stdout | 2024-04-22 04:11:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:11:53 UTC)" (scheduled at 2024-04-22 04:11:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:11:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:11:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 11, 43, 760236), True, datetime.datetime(2024, 4, 22, 4, 11, 43, 760236), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:11:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:11:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:11:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:11:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:11:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:11:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:14.952062+00:00 (in 29.999466 seconds)
gcworker stdout | 2024-04-22 04:11:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:12:14 UTC)" (scheduled at 2024-04-22 04:11:44.952062+00:00)
gcworker stdout | 2024-04-22 04:11:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549504952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:11:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:11:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:11:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:12:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:11:45,653 [282] [DEBUG] [app] Starting request: urn:request:3a598b06-fd55-4b1d-8f10-95fc3d099fb6 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:11:45,653 [279] [DEBUG] [app] Starting request: urn:request:6eaefa9e-b046-4919-ac54-4c719d3f3313 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:11:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:11:45,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:11:45,656 [290] [DEBUG] [app] Starting request: urn:request:4245da74-2b35-4f69-8405-8058cf94efab (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:11:45,656 [292] [DEBUG] [app] Starting request: urn:request:1980cace-add9-436f-aac1-de755c94a044 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:11:45,656 [290] [DEBUG] [app] Ending request: urn:request:4245da74-2b35-4f69-8405-8058cf94efab (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:4245da74-2b35-4f69-8405-8058cf94efab', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:11:45,656 [292] [DEBUG] [app] Ending request: urn:request:1980cace-add9-436f-aac1-de755c94a044 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:1980cace-add9-436f-aac1-de755c94a044', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:11:45,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:11:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:11:45,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:11:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:11:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:11:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-web stdout | 2024-04-22 04:11:45,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:11:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:11:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:11:45,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:11:45,659 [279] [DEBUG] [app] Starting request: urn:request:30bfe784-c0c5-4ca7-98f6-5698c9fae513 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:11:45,659 [279] [DEBUG] [app] Ending request: urn:request:30bfe784-c0c5-4ca7-98f6-5698c9fae513 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:30bfe784-c0c5-4ca7-98f6-5698c9fae513', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:11:45,659 [281] [DEBUG] [app] Starting request: urn:request:4ea2a64a-fa4b-43e5-9c22-6bd23568c0c7 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:11:45,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:11:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:11:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:11:45,660 [281] [DEBUG] [app] Ending request: urn:request:4ea2a64a-fa4b-43e5-9c22-6bd23568c0c7 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:4ea2a64a-fa4b-43e5-9c22-6bd23568c0c7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:11:45,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:11:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:11:45,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:11:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:11:45,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:11:45,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:11:45,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:11:45,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:11:45,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:11:45,674 [279] [DEBUG] [app] Ending request: urn:request:6eaefa9e-b046-4919-ac54-4c719d3f3313 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:6eaefa9e-b046-4919-ac54-4c719d3f3313', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:11:45,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:11:45,674 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:11:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:11:45,674 [282] [DEBUG] [app] Ending request: urn:request:3a598b06-fd55-4b1d-8f10-95fc3d099fb6 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:3a598b06-fd55-4b1d-8f10-95fc3d099fb6', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:11:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:11:45,674 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:11:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:11:45,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:11:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:11:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:11:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:01.054492+00:00 (in 14.999493 seconds)
quotatotalworker stdout | 2024-04-22 04:11:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:12:01 UTC)" (scheduled at 2024-04-22 04:11:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:11:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:11:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:11:46,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:12:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:11:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:11:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:17.052354+00:00 (in 29.999467 seconds)
buildlogsarchiver stdout | 2024-04-22 04:11:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:12:17 UTC)" (scheduled at 2024-04-22 04:11:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:11:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 11, 47, 53263), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:11:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:11:47,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:11:47,063 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:12:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:11:50,489 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
repositorygcworker stdout | 2024-04-22 04:11:51,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:11:51,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:06.552482+00:00 (in 14.996490 seconds)
repositorygcworker stdout | 2024-04-22 04:11:51,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:16:51 UTC)" (scheduled at 2024-04-22 04:11:51.555445+00:00)
repositorygcworker stdout | 2024-04-22 04:11:51,556 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 11, 51, 556368), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 04:11:51,566 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 11, 51, 556368), True, datetime.datetime(2024, 4, 22, 4, 11, 51, 556368), 0, 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 04:11:51,569 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 11, 51, 556368), True, datetime.datetime(2024, 4, 22, 4, 11, 51, 556368), 0, 'repositorygc/%', False, datetime.datetime(2024, 4, 22, 4, 11, 51, 556368), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 04:11:51,571 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:11:51,571 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:16:51 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:11:51,868 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
exportactionlogsworker stdout | 2024-04-22 04:11:53,566 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:11:53,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:39.566970+00:00 (in 45.999733 seconds)
exportactionlogsworker stdout | 2024-04-22 04:11:53,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:16:53 UTC)" (scheduled at 2024-04-22 04:11:53.566665+00:00)
exportactionlogsworker stdout | 2024-04-22 04:11:53,568 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 11, 53, 567496), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 04:11:53,577 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 11, 53, 567496), True, datetime.datetime(2024, 4, 22, 4, 11, 53, 567496), 0, 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 04:11:53,580 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 11, 53, 567496), True, datetime.datetime(2024, 4, 22, 4, 11, 53, 567496), 0, 'exportactionlogs/%', False, datetime.datetime(2024, 4, 22, 4, 11, 53, 567496), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 04:11:53,582 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:11:53,582 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:16:53 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:11:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:11:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:03.759375+00:00 (in 9.999432 seconds)
notificationworker stdout | 2024-04-22 04:11:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:12:03 UTC)" (scheduled at 2024-04-22 04:11:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:11:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:11:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 11, 53, 760409), True, datetime.datetime(2024, 4, 22, 4, 11, 53, 760409), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:11:53,776 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:11:53,777 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:11:53,777 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:12:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:11:55,521 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:11:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:11:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:05.871852+00:00 (in 8.998285 seconds)
securityworker stdout | 2024-04-22 04:11:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:12:26 UTC)" (scheduled at 2024-04-22 04:11:56.873109+00:00)
securityworker stdout | 2024-04-22 04:11:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:11:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:11:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:11:56,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:11:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:11:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:11:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:11:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:11:56,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:11:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:11:56,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:11:56,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:11:56,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 6, 56, 880587), 1, 2])
securityworker stdout | 2024-04-22 04:11:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:11:56,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:11:56,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 6, 56, 880587), 1, 2])
securityworker stdout | 2024-04-22 04:11:56,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:11:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:11:56,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:11:56,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:11:56,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:11:56,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:11:56,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:11:56,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:11:56,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:11:56,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:12:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:11:57,286 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
gunicorn-web stdout | 2024-04-22 04:11:57,518 [282] [DEBUG] [app] Starting request: urn:request:d8f9cc26-b036-4b73-b89e-b67d30dda2ab (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:11:57,518 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:11:57,518 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:11:57,519 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:11:57,528 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:11:57,528 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:11:57,528 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:11:57,528 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:11:57,528 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:11:57,528 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:11:57,528 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:11:57,528 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:11:57,531 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:11:57,537 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:11:57,538 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:11:57,542 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:11:57,546 [282] [DEBUG] [app] Ending request: urn:request:d8f9cc26-b036-4b73-b89e-b67d30dda2ab (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:d8f9cc26-b036-4b73-b89e-b67d30dda2ab', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:11:57,547 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:11:57 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.031 1536 0.031)
gunicorn-web stdout | 2024-04-22 04:11:57,547 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:11:57 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-registry stdout | 2024-04-22 04:11:57,592 [284] [DEBUG] [app] Starting request: urn:request:007516e6-37f5-4b21-bf7f-ebc6f5c9e19c (/v2/) {'X-Forwarded-For': '123.123.45.4, 10.128.2.8'}
gunicorn-registry stdout | 2024-04-22 04:11:57,593 [284] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {}
gunicorn-registry stdout | 2024-04-22 04:11:57,593 [284] [DEBUG] [auth.registry_jwt_auth] No auth header.
gunicorn-registry stdout | 2024-04-22 04:11:57,593 [284] [DEBUG] [app] Ending request: urn:request:007516e6-37f5-4b21-bf7f-ebc6f5c9e19c (/v2/) {'endpoint': 'v2.v2_support_enabled', 'request_id': 'urn:request:007516e6-37f5-4b21-bf7f-ebc6f5c9e19c', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/v2/', 'path': '/v2/', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'skopeo/1.14.2'}
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:11:57 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "skopeo/1.14.2" (0.002 522 0.002)
gunicorn-registry stdout | 2024-04-22 04:11:57,593 [284] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:11:57 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "skopeo/1.14.2"
gunicorn-registry stdout | 2024-04-22 04:11:58,394 [284] [DEBUG] [app] Starting request: urn:request:2b593752-a54b-4edc-a62c-f69807b553b1 (/v2/auth) {'X-Forwarded-For': '123.123.45.4, 10.131.0.9'}
gunicorn-registry stdout | 2024-04-22 04:11:58,394 [284] [DEBUG] [auth.basic] Attempt to process basic auth header
gunicorn-registry stdout | 2024-04-22 04:11:58,396 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) OR ("t1"."email" = %s)) LIMIT %s OFFSET %s', ['whuquay', 'whuquay', 1, 0])
gunicorn-registry stdout | 2024-04-22 04:11:58,396 [284] [DEBUG] [peewee.pool] No connection available in pool.
gunicorn-registry stdout | 2024-04-22 04:11:58,405 [284] [DEBUG] [peewee.pool] Created new connection 140532887700160.
quotatotalworker stdout | 2024-04-22 04:11:58,494 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:11:58,576 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-registry stdout | 2024-04-22 04:11:58,644 [284] [DEBUG] [auth.credentials] Successfully validated credentials for user whuquay
gunicorn-registry stdout | 2024-04-22 04:11:58,645 [284] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.basic: 'basic'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-registry stdout | 2024-04-22 04:11:58,645 [284] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-registry stdout | 2024-04-22 04:11:58,645 [284] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-registry stdout | 2024-04-22 04:11:58,645 [284] [DEBUG] [endpoints.v2.v2auth] Request audience: quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com
gunicorn-registry stdout | 2024-04-22 04:11:58,645 [284] [DEBUG] [endpoints.v2.v2auth] Scope request: ['repository:build_test/pushno:pull,push']
gunicorn-registry stdout | 2024-04-22 04:11:58,646 [284] [DEBUG] [endpoints.v2.v2auth] Match: ('build_test/pushno', 'build_test/pushno', 'pull,push')
gunicorn-registry stdout | 2024-04-22 04:11:58,647 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['build_test', 1, 0])
gunicorn-registry stdout | 2024-04-22 04:11:58,650 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:11:58,654 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:11:58,656 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:11:58,658 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1"', [])
gunicorn-registry stdout | 2024-04-22 04:11:58,661 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['public', 1, 0])
gunicorn-registry stdout | 2024-04-22 04:11:58,662 [284] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-registry stdout | 2024-04-22 04:11:58,663 [284] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-registry stdout | 2024-04-22 04:11:58,663 [284] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-registry stdout | 2024-04-22 04:11:58,663 [284] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-registry stdout | 2024-04-22 04:11:58,665 [284] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-registry stdout | 2024-04-22 04:11:58,671 [284] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-registry stdout | 2024-04-22 04:11:58,671 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."organization_id", "t1"."creation_date", "t1"."upstream_registry", "t1"."upstream_registry_username", "t1"."upstream_registry_password", "t1"."expiration_s", "t1"."insecure" FROM "proxycacheconfig" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") WHERE (("t2"."username" = %s) AND ("t2"."organization" = %s)) LIMIT %s OFFSET %s', ['build_test', True, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:11:58,674 [284] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-registry stdout | 2024-04-22 04:11:58,683 [284] [DEBUG] [app] Ending request: urn:request:2b593752-a54b-4edc-a62c-f69807b553b1 (/v2/auth) {'endpoint': 'v2.generate_registry_jwt', 'request_id': 'urn:request:2b593752-a54b-4edc-a62c-f69807b553b1', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/v2/auth?account=whuquay&scope=repository:build_test/pushno:pull,push&service=quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com', 'path': '/v2/auth', 'parameters': {'account': 'whuquay', 'scope': 'repository:build_test/pushno:pull,push', 'service': 'quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com'}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'skopeo/1.14.2'}
gunicorn-registry stdout | 2024-04-22 04:11:58,683 [284] [DEBUG] [data.database] Disconnecting from database.
gunicorn-registry stdout | 2024-04-22 04:11:58,683 [284] [DEBUG] [peewee.pool] Returning 140532887700160 to pool.
nginx stdout | 10.131.0.9 (-) - whuquay [22/Apr/2024:04:11:58 +0000] "GET /v2/auth?account=whuquay&scope=repository%3Abuild_test%2Fpushno%3Apull%2Cpush&service=quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com HTTP/1.1" 200 1106 "-" "skopeo/1.14.2" (0.290 687 0.290)
gunicorn-registry stdout | 2024-04-22 04:11:58,683 [284] [INFO] [gunicorn.access] 10.131.0.9 - whuquay [22/Apr/2024:04:11:58 +0000] "GET /v2/auth?account=whuquay&scope=repository%3Abuild_test%2Fpushno%3Apull%2Cpush&service=quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com HTTP/1.1" 200 1106 "-" "skopeo/1.14.2"
gunicorn-registry stdout | 2024-04-22 04:11:58,686 [284] [DEBUG] [data.userevent] Published user event docker-cli: {'action': 'push_start', 'namespace': 'build_test', 'repository': 'pushno'}
gunicorn-registry stdout | 2024-04-22 04:11:58,943 [284] [DEBUG] [app] Starting request: urn:request:6320a742-17a6-4e77-8f65-3c94584657ff (/v2/build_test/pushno/blobs/sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8) {'X-Forwarded-For': '123.123.45.4, 10.131.0.9'}
gunicorn-registry stdout | 2024-04-22 04:11:58,944 [284] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'digest': 'sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8', 'namespace_name': 'build_test', 'repo_name': 'pushno'}
gunicorn-registry stdout | 2024-04-22 04:11:58,944 [284] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IkRxU21rRHNucVFUNGtYOHo5OFZkMUsyTl9OUXJVaU0tTHJVeklXUS1oc2siLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoicXVheXJlZ2lzdHJ5LXF1YXktcXVheS1lbnRlcnByaXNlLmFwcHMud2h1NDE1YXoxNS5xZS5henVyZS5kZXZjbHVzdGVyLm9wZW5zaGlmdC5jb20iLCJuYmYiOjE3MTM3NTkxMTgsImlhdCI6MTcxMzc1OTExOCwiZXhwIjoxNzEzNzYyNzE4LCJzdWIiOiJ3aHVxdWF5IiwiYWNjZXNzIjpbeyJ0eXBlIjoicmVwb3NpdG9yeSIsIm5hbWUiOiJidWlsZF90ZXN0L3B1c2hubyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJhMTQ0MjU2Ni1hMmU0LTRmYmQtODZkNy1jZGJlNDQ4OTFiM2UiLCJraW5kIjoidXNlciIsInVzZXIiOiJ3aHVxdWF5IiwiY29tLmFwb3N0aWxsZS5yb290cyI6eyJidWlsZF90ZXN0L3B1c2hubyI6IiRkaXNhYmxlZCJ9LCJjb20uYXBvc3RpbGxlLnJvb3QiOiIkZGlzYWJsZWQifX0.rMSnZyravLQkNm9Uxq_FbKIOgLUoSNTZH97zgYvomLCbQ7OGR0WMFgEs-0VFoXypa4Ht5N8VUwZXrVIFonTV3TjyaCFLciFcsKWOxKjNjL9N8vU901Ry6xdaMf5GIANH6JhmZQgaaRTuadm8Z7D0H9eQ5uUVtNNyXe-iN7fj-kJfdLFDEeW0jh6rp-TkdeDdsOjFbd34cGuyA2mfut5f0euZ9tidhg9C94UKrBKvMTIbm_vRN2y4W7GtJhiANCiOHppRrEhqimwSaa1hujhRLFExfdNalQGPk9gI5ng73TU6XkLvhe1e6bixbcywvWCGQRiv4hQK79L1-dnEIvo8Ng
gunicorn-registry stdout | 2024-04-22 04:11:58,944 [284] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJhbGciOiJSUzI1NiIsImtpZCI6IkRxU21rRHNucVFUNGtYOHo5OFZkMUsyTl9OUXJVaU0tTHJVeklXUS1oc2siLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoicXVheXJlZ2lzdHJ5LXF1YXktcXVheS1lbnRlcnByaXNlLmFwcHMud2h1NDE1YXoxNS5xZS5henVyZS5kZXZjbHVzdGVyLm9wZW5zaGlmdC5jb20iLCJuYmYiOjE3MTM3NTkxMTgsImlhdCI6MTcxMzc1OTExOCwiZXhwIjoxNzEzNzYyNzE4LCJzdWIiOiJ3aHVxdWF5IiwiYWNjZXNzIjpbeyJ0eXBlIjoicmVwb3NpdG9yeSIsIm5hbWUiOiJidWlsZF90ZXN0L3B1c2hubyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJhMTQ0MjU2Ni1hMmU0LTRmYmQtODZkNy1jZGJlNDQ4OTFiM2UiLCJraW5kIjoidXNlciIsInVzZXIiOiJ3aHVxdWF5IiwiY29tLmFwb3N0aWxsZS5yb290cyI6eyJidWlsZF90ZXN0L3B1c2hubyI6IiRkaXNhYmxlZCJ9LCJjb20uYXBvc3RpbGxlLnJvb3QiOiIkZGlzYWJsZWQifX0.rMSnZyravLQkNm9Uxq_FbKIOgLUoSNTZH97zgYvomLCbQ7OGR0WMFgEs-0VFoXypa4Ht5N8VUwZXrVIFonTV3TjyaCFLciFcsKWOxKjNjL9N8vU901Ry6xdaMf5GIANH6JhmZQgaaRTuadm8Z7D0H9eQ5uUVtNNyXe-iN7fj-kJfdLFDEeW0jh6rp-TkdeDdsOjFbd34cGuyA2mfut5f0euZ9tidhg9C94UKrBKvMTIbm_vRN2y4W7GtJhiANCiOHppRrEhqimwSaa1hujhRLFExfdNalQGPk9gI5ng73TU6XkLvhe1e6bixbcywvWCGQRiv4hQK79L1-dnEIvo8Ng
gunicorn-registry stdout | 2024-04-22 04:11:58,945 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE ((((NOT ("t1"."approval_id" IS %s) AND (("t1"."expiration_date" > %s) OR ("t1"."expiration_date" IS %s))) AND ("t1"."service" = %s)) AND (NOT (("t1"."service" = %s) AND ("t1"."expiration_date" <= %s)) OR NOT ((("t1"."service" = %s) AND ("t1"."approval_id" IS %s)) AND ("t1"."created_date" <= %s)))) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s)))', [None, datetime.datetime(2024, 4, 22, 4, 11, 58, 944465), None, 'quay', 'quay', datetime.datetime(2024, 4, 22, 4, 11, 58, 944485), 'quay', None, datetime.datetime(2024, 4, 21, 4, 11, 58, 944504), datetime.datetime(2024, 4, 15, 4, 11, 58, 944514), None])
gunicorn-registry stdout | 2024-04-22 04:11:58,950 [284] [DEBUG] [auth.permissions] Identity loaded: <Identity id="whuquay" auth_type="signed_jwt" provides={_ResourceNeed(type='repository', namespace='build_test', name='pushno', role='write')}>
gunicorn-registry stdout | 2024-04-22 04:11:58,950 [284] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: whuquay
gunicorn-registry stdout | 2024-04-22 04:11:58,950 [284] [DEBUG] [auth.registry_jwt_auth] Identity changed to whuquay
gunicorn-registry stdout | 2024-04-22 04:11:58,950 [284] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'a1442566-a2e4-4fbd-86d7-cdbe44891b3e', 'kind': 'user', 'user': 'whuquay', 'com.apostille.roots': {'build_test/pushno': '$disabled'}, 'com.apostille.root': '$disabled'}
gunicorn-registry stdout | 2024-04-22 04:11:58,950 [284] [DEBUG] [endpoints.v2] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-registry stdout | 2024-04-22 04:11:58,951 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:11:58,953 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."organization_id", "t1"."creation_date", "t1"."upstream_registry", "t1"."upstream_registry_username", "t1"."upstream_registry_password", "t1"."expiration_s", "t1"."insecure" FROM "proxycacheconfig" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") WHERE (("t2"."username" = %s) AND ("t2"."organization" = %s)) LIMIT %s OFFSET %s', ['build_test', True, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:11:58,956 [284] [DEBUG] [endpoints.decorators] Skipping pull through proxy cache: <Model: ProxyCacheConfig> instance matching query does not exist:
gunicorn-registry stdout | SQL: SELECT "t1"."id", "t1"."organization_id", "t1"."creation_date", "t1"."upstream_registry", "t1"."upstream_registry_username", "t1"."upstream_registry_password", "t1"."expiration_s", "t1"."insecure" FROM "proxycacheconfig" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") WHERE (("t2"."username" = %s) AND ("t2"."organization" = %s)) LIMIT %s OFFSET %s
gunicorn-registry stdout | Params: ['build_test', True, 1, 0]
gunicorn-registry stdout | 2024-04-22 04:11:58,956 [284] [DEBUG] [data.cache.impl] Checking cache for key repo_blob__build_test_pushno_sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8_2
gunicorn-registry stdout | 2024-04-22 04:11:58,956 [284] [DEBUG] [data.cache.impl] Found no result in cache for key repo_blob__build_test_pushno_sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8_2; calling loader
gunicorn-registry stdout | 2024-04-22 04:11:58,957 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:11:58,959 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:11:58,961 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:11:58,964 [284] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "uploadedblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8', 1, 0])
gunicorn-registry stdout | 2024-04-22 04:11:58,967 [284] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "manifestblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8', 1, 0])
gunicorn-registry stdout | 2024-04-22 04:11:58,969 [284] [DEBUG] [data.cache.impl] Got loaded result for key repo_blob__build_test_pushno_sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8_2: None
gunicorn-registry stdout | 2024-04-22 04:11:58,969 [284] [DEBUG] [data.cache.impl] Not caching loaded result for key repo_blob__build_test_pushno_sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8_2: None
gunicorn-registry stdout | 2024-04-22 04:11:58,970 [284] [DEBUG] [endpoints.v2] sending response: b'{"errors":[{"code":"BLOB_UNKNOWN","detail":{},"message":"blob unknown to registry"}]}\n'
gunicorn-registry stdout | 2024-04-22 04:11:58,970 [284] [DEBUG] [app] Ending request: urn:request:6320a742-17a6-4e77-8f65-3c94584657ff (/v2/build_test/pushno/blobs/sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8) {'endpoint': 'v2.check_blob_exists', 'request_id': 'urn:request:6320a742-17a6-4e77-8f65-3c94584657ff', 'remote_addr': '10.131.0.9', 'http_method': 'HEAD', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/v2/build_test/pushno/blobs/sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8', 'path': '/v2/build_test/pushno/blobs/sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'skopeo/1.14.2'}
gunicorn-registry stdout | 2024-04-22 04:11:58,970 [284] [DEBUG] [data.database] Disconnecting from database.
gunicorn-registry stdout | 2024-04-22 04:11:58,970 [284] [DEBUG] [peewee.pool] Returning 140532887700160 to pool.
gunicorn-registry stdout | 2024-04-22 04:11:58,970 [284] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:11:58 +0000] "HEAD /v2/build_test/pushno/blobs/sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8 HTTP/1.1" 404 0 "-" "skopeo/1.14.2"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:11:58 +0000] "HEAD /v2/build_test/pushno/blobs/sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8 HTTP/1.1" 404 0 "-" "skopeo/1.14.2" (0.029 1712 0.029)
gunicorn-web stdout | 2024-04-22 04:12:00,217 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:12:00,220 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:12:00,226 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:12:00,242 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:12:00,246 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-registry stdout | 2024-04-22 04:12:00,380 [284] [DEBUG] [app] Starting request: urn:request:cf72d8cf-cef9-4a62-b237-cf77fc9e41de (/v2/build_test/pushno/blobs/sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8) {'X-Forwarded-For': '123.123.45.4, 10.131.0.9'}
gunicorn-registry stdout | 2024-04-22 04:12:00,380 [284] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'digest': 'sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8', 'namespace_name': 'build_test', 'repo_name': 'pushno'}
gunicorn-registry stdout | 2024-04-22 04:12:00,380 [284] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IkRxU21rRHNucVFUNGtYOHo5OFZkMUsyTl9OUXJVaU0tTHJVeklXUS1oc2siLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoicXVheXJlZ2lzdHJ5LXF1YXktcXVheS1lbnRlcnByaXNlLmFwcHMud2h1NDE1YXoxNS5xZS5henVyZS5kZXZjbHVzdGVyLm9wZW5zaGlmdC5jb20iLCJuYmYiOjE3MTM3NTkxMTgsImlhdCI6MTcxMzc1OTExOCwiZXhwIjoxNzEzNzYyNzE4LCJzdWIiOiJ3aHVxdWF5IiwiYWNjZXNzIjpbeyJ0eXBlIjoicmVwb3NpdG9yeSIsIm5hbWUiOiJidWlsZF90ZXN0L3B1c2hubyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJhMTQ0MjU2Ni1hMmU0LTRmYmQtODZkNy1jZGJlNDQ4OTFiM2UiLCJraW5kIjoidXNlciIsInVzZXIiOiJ3aHVxdWF5IiwiY29tLmFwb3N0aWxsZS5yb290cyI6eyJidWlsZF90ZXN0L3B1c2hubyI6IiRkaXNhYmxlZCJ9LCJjb20uYXBvc3RpbGxlLnJvb3QiOiIkZGlzYWJsZWQifX0.rMSnZyravLQkNm9Uxq_FbKIOgLUoSNTZH97zgYvomLCbQ7OGR0WMFgEs-0VFoXypa4Ht5N8VUwZXrVIFonTV3TjyaCFLciFcsKWOxKjNjL9N8vU901Ry6xdaMf5GIANH6JhmZQgaaRTuadm8Z7D0H9eQ5uUVtNNyXe-iN7fj-kJfdLFDEeW0jh6rp-TkdeDdsOjFbd34cGuyA2mfut5f0euZ9tidhg9C94UKrBKvMTIbm_vRN2y4W7GtJhiANCiOHppRrEhqimwSaa1hujhRLFExfdNalQGPk9gI5ng73TU6XkLvhe1e6bixbcywvWCGQRiv4hQK79L1-dnEIvo8Ng
gunicorn-registry stdout | 2024-04-22 04:12:00,380 [284] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJhbGciOiJSUzI1NiIsImtpZCI6IkRxU21rRHNucVFUNGtYOHo5OFZkMUsyTl9OUXJVaU0tTHJVeklXUS1oc2siLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoicXVheXJlZ2lzdHJ5LXF1YXktcXVheS1lbnRlcnByaXNlLmFwcHMud2h1NDE1YXoxNS5xZS5henVyZS5kZXZjbHVzdGVyLm9wZW5zaGlmdC5jb20iLCJuYmYiOjE3MTM3NTkxMTgsImlhdCI6MTcxMzc1OTExOCwiZXhwIjoxNzEzNzYyNzE4LCJzdWIiOiJ3aHVxdWF5IiwiYWNjZXNzIjpbeyJ0eXBlIjoicmVwb3NpdG9yeSIsIm5hbWUiOiJidWlsZF90ZXN0L3B1c2hubyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJhMTQ0MjU2Ni1hMmU0LTRmYmQtODZkNy1jZGJlNDQ4OTFiM2UiLCJraW5kIjoidXNlciIsInVzZXIiOiJ3aHVxdWF5IiwiY29tLmFwb3N0aWxsZS5yb290cyI6eyJidWlsZF90ZXN0L3B1c2hubyI6IiRkaXNhYmxlZCJ9LCJjb20uYXBvc3RpbGxlLnJvb3QiOiIkZGlzYWJsZWQifX0.rMSnZyravLQkNm9Uxq_FbKIOgLUoSNTZH97zgYvomLCbQ7OGR0WMFgEs-0VFoXypa4Ht5N8VUwZXrVIFonTV3TjyaCFLciFcsKWOxKjNjL9N8vU901Ry6xdaMf5GIANH6JhmZQgaaRTuadm8Z7D0H9eQ5uUVtNNyXe-iN7fj-kJfdLFDEeW0jh6rp-TkdeDdsOjFbd34cGuyA2mfut5f0euZ9tidhg9C94UKrBKvMTIbm_vRN2y4W7GtJhiANCiOHppRrEhqimwSaa1hujhRLFExfdNalQGPk9gI5ng73TU6XkLvhe1e6bixbcywvWCGQRiv4hQK79L1-dnEIvo8Ng
gunicorn-registry stdout | 2024-04-22 04:12:00,381 [284] [DEBUG] [auth.permissions] Identity loaded: <Identity id="whuquay" auth_type="signed_jwt" provides={_ResourceNeed(type='repository', namespace='build_test', name='pushno', role='write')}>
gunicorn-registry stdout | 2024-04-22 04:12:00,381 [284] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: whuquay
gunicorn-registry stdout | 2024-04-22 04:12:00,381 [284] [DEBUG] [auth.registry_jwt_auth] Identity changed to whuquay
gunicorn-registry stdout | 2024-04-22 04:12:00,381 [284] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'a1442566-a2e4-4fbd-86d7-cdbe44891b3e', 'kind': 'user', 'user': 'whuquay', 'com.apostille.roots': {'build_test/pushno': '$disabled'}, 'com.apostille.root': '$disabled'}
gunicorn-registry stdout | 2024-04-22 04:12:00,381 [284] [DEBUG] [endpoints.v2] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-registry stdout | 2024-04-22 04:12:00,382 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:00,385 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."organization_id", "t1"."creation_date", "t1"."upstream_registry", "t1"."upstream_registry_username", "t1"."upstream_registry_password", "t1"."expiration_s", "t1"."insecure" FROM "proxycacheconfig" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") WHERE (("t2"."username" = %s) AND ("t2"."organization" = %s)) LIMIT %s OFFSET %s', ['build_test', True, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:00,388 [284] [DEBUG] [endpoints.decorators] Skipping pull through proxy cache: <Model: ProxyCacheConfig> instance matching query does not exist:
gunicorn-registry stdout | SQL: SELECT "t1"."id", "t1"."organization_id", "t1"."creation_date", "t1"."upstream_registry", "t1"."upstream_registry_username", "t1"."upstream_registry_password", "t1"."expiration_s", "t1"."insecure" FROM "proxycacheconfig" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") WHERE (("t2"."username" = %s) AND ("t2"."organization" = %s)) LIMIT %s OFFSET %s
gunicorn-registry stdout | Params: ['build_test', True, 1, 0]
gunicorn-registry stdout | 2024-04-22 04:12:00,388 [284] [DEBUG] [data.cache.impl] Checking cache for key repo_blob__build_test_pushno_sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8_2
gunicorn-registry stdout | 2024-04-22 04:12:00,388 [284] [DEBUG] [data.cache.impl] Found no result in cache for key repo_blob__build_test_pushno_sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8_2; calling loader
gunicorn-registry stdout | 2024-04-22 04:12:00,389 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:00,391 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:00,393 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:00,395 [284] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "uploadedblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8', 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:00,398 [284] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "manifestblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8', 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:00,400 [284] [DEBUG] [data.cache.impl] Got loaded result for key repo_blob__build_test_pushno_sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8_2: None
gunicorn-registry stdout | 2024-04-22 04:12:00,400 [284] [DEBUG] [data.cache.impl] Not caching loaded result for key repo_blob__build_test_pushno_sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8_2: None
gunicorn-registry stdout | 2024-04-22 04:12:00,400 [284] [DEBUG] [endpoints.v2] sending response: b'{"errors":[{"code":"BLOB_UNKNOWN","detail":{},"message":"blob unknown to registry"}]}\n'
gunicorn-registry stdout | 2024-04-22 04:12:00,400 [284] [DEBUG] [app] Ending request: urn:request:cf72d8cf-cef9-4a62-b237-cf77fc9e41de (/v2/build_test/pushno/blobs/sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8) {'endpoint': 'v2.check_blob_exists', 'request_id': 'urn:request:cf72d8cf-cef9-4a62-b237-cf77fc9e41de', 'remote_addr': '10.131.0.9', 'http_method': 'HEAD', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/v2/build_test/pushno/blobs/sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8', 'path': '/v2/build_test/pushno/blobs/sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'skopeo/1.14.2'}
gunicorn-registry stdout | 2024-04-22 04:12:00,400 [284] [DEBUG] [data.database] Disconnecting from database.
gunicorn-registry stdout | 2024-04-22 04:12:00,400 [284] [DEBUG] [peewee.pool] Returning 140532887700160 to pool.
gunicorn-registry stdout | 2024-04-22 04:12:00,401 [284] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:12:00 +0000] "HEAD /v2/build_test/pushno/blobs/sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8 HTTP/1.1" 404 0 "-" "skopeo/1.14.2"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:12:00 +0000] "HEAD /v2/build_test/pushno/blobs/sha256:2408cc74d12b6cd092bb8b516ba7d5e290f485d3eb9672efc00f0583730179e8 HTTP/1.1" 404 0 "-" "skopeo/1.14.2" (0.022 1712 0.022)
teamsyncworker stdout | 2024-04-22 04:12:00,525 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:12:00,651 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:12:00,653 [281] [DEBUG] [app] Starting request: urn:request:d700c542-e797-4fef-90b2-4baf760aa40b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:12:00,653 [279] [DEBUG] [app] Starting request: urn:request:9380c9ec-ae12-43c5-9849-25591cd52fe4 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:12:00,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:12:00,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:12:00,657 [288] [DEBUG] [app] Starting request: urn:request:22ae4383-8a02-4769-9d02-825065e7e962 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:12:00,657 [291] [DEBUG] [app] Starting request: urn:request:ed06f2d9-d017-4007-a5c0-96ceb4327b68 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:12:00,657 [291] [DEBUG] [app] Ending request: urn:request:ed06f2d9-d017-4007-a5c0-96ceb4327b68 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:ed06f2d9-d017-4007-a5c0-96ceb4327b68', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:12:00,657 [288] [DEBUG] [app] Ending request: urn:request:22ae4383-8a02-4769-9d02-825065e7e962 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:22ae4383-8a02-4769-9d02-825065e7e962', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:12:00,658 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:12:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:12:00,658 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:12:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:12:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:12:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-web stdout | 2024-04-22 04:12:00,658 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:12:00,658 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 04:12:00,658 [284] [DEBUG] [app] Starting request: urn:request:504b2c4e-206e-4a21-a4ef-77a907481499 (/v2/build_test/pushno/blobs/uploads/) {'X-Forwarded-For': '123.123.45.4, 10.131.0.9'}
gunicorn-registry stdout | 2024-04-22 04:12:00,658 [284] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'namespace_name': 'build_test', 'repo_name': 'pushno'}
gunicorn-registry stdout | 2024-04-22 04:12:00,658 [284] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IkRxU21rRHNucVFUNGtYOHo5OFZkMUsyTl9OUXJVaU0tTHJVeklXUS1oc2siLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoicXVheXJlZ2lzdHJ5LXF1YXktcXVheS1lbnRlcnByaXNlLmFwcHMud2h1NDE1YXoxNS5xZS5henVyZS5kZXZjbHVzdGVyLm9wZW5zaGlmdC5jb20iLCJuYmYiOjE3MTM3NTkxMTgsImlhdCI6MTcxMzc1OTExOCwiZXhwIjoxNzEzNzYyNzE4LCJzdWIiOiJ3aHVxdWF5IiwiYWNjZXNzIjpbeyJ0eXBlIjoicmVwb3NpdG9yeSIsIm5hbWUiOiJidWlsZF90ZXN0L3B1c2hubyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJhMTQ0MjU2Ni1hMmU0LTRmYmQtODZkNy1jZGJlNDQ4OTFiM2UiLCJraW5kIjoidXNlciIsInVzZXIiOiJ3aHVxdWF5IiwiY29tLmFwb3N0aWxsZS5yb290cyI6eyJidWlsZF90ZXN0L3B1c2hubyI6IiRkaXNhYmxlZCJ9LCJjb20uYXBvc3RpbGxlLnJvb3QiOiIkZGlzYWJsZWQifX0.rMSnZyravLQkNm9Uxq_FbKIOgLUoSNTZH97zgYvomLCbQ7OGR0WMFgEs-0VFoXypa4Ht5N8VUwZXrVIFonTV3TjyaCFLciFcsKWOxKjNjL9N8vU901Ry6xdaMf5GIANH6JhmZQgaaRTuadm8Z7D0H9eQ5uUVtNNyXe-iN7fj-kJfdLFDEeW0jh6rp-TkdeDdsOjFbd34cGuyA2mfut5f0euZ9tidhg9C94UKrBKvMTIbm_vRN2y4W7GtJhiANCiOHppRrEhqimwSaa1hujhRLFExfdNalQGPk9gI5ng73TU6XkLvhe1e6bixbcywvWCGQRiv4hQK79L1-dnEIvo8Ng
gunicorn-registry stdout | 2024-04-22 04:12:00,658 [284] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJhbGciOiJSUzI1NiIsImtpZCI6IkRxU21rRHNucVFUNGtYOHo5OFZkMUsyTl9OUXJVaU0tTHJVeklXUS1oc2siLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoicXVheXJlZ2lzdHJ5LXF1YXktcXVheS1lbnRlcnByaXNlLmFwcHMud2h1NDE1YXoxNS5xZS5henVyZS5kZXZjbHVzdGVyLm9wZW5zaGlmdC5jb20iLCJuYmYiOjE3MTM3NTkxMTgsImlhdCI6MTcxMzc1OTExOCwiZXhwIjoxNzEzNzYyNzE4LCJzdWIiOiJ3aHVxdWF5IiwiYWNjZXNzIjpbeyJ0eXBlIjoicmVwb3NpdG9yeSIsIm5hbWUiOiJidWlsZF90ZXN0L3B1c2hubyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJhMTQ0MjU2Ni1hMmU0LTRmYmQtODZkNy1jZGJlNDQ4OTFiM2UiLCJraW5kIjoidXNlciIsInVzZXIiOiJ3aHVxdWF5IiwiY29tLmFwb3N0aWxsZS5yb290cyI6eyJidWlsZF90ZXN0L3B1c2hubyI6IiRkaXNhYmxlZCJ9LCJjb20uYXBvc3RpbGxlLnJvb3QiOiIkZGlzYWJsZWQifX0.rMSnZyravLQkNm9Uxq_FbKIOgLUoSNTZH97zgYvomLCbQ7OGR0WMFgEs-0VFoXypa4Ht5N8VUwZXrVIFonTV3TjyaCFLciFcsKWOxKjNjL9N8vU901Ry6xdaMf5GIANH6JhmZQgaaRTuadm8Z7D0H9eQ5uUVtNNyXe-iN7fj-kJfdLFDEeW0jh6rp-TkdeDdsOjFbd34cGuyA2mfut5f0euZ9tidhg9C94UKrBKvMTIbm_vRN2y4W7GtJhiANCiOHppRrEhqimwSaa1hujhRLFExfdNalQGPk9gI5ng73TU6XkLvhe1e6bixbcywvWCGQRiv4hQK79L1-dnEIvo8Ng
gunicorn-registry stdout | 2024-04-22 04:12:00,659 [284] [DEBUG] [auth.permissions] Identity loaded: <Identity id="whuquay" auth_type="signed_jwt" provides={_ResourceNeed(type='repository', namespace='build_test', name='pushno', role='write')}>
gunicorn-registry stdout | 2024-04-22 04:12:00,659 [284] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: whuquay
gunicorn-registry stdout | 2024-04-22 04:12:00,659 [284] [DEBUG] [auth.registry_jwt_auth] Identity changed to whuquay
gunicorn-registry stdout | 2024-04-22 04:12:00,659 [284] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'a1442566-a2e4-4fbd-86d7-cdbe44891b3e', 'kind': 'user', 'user': 'whuquay', 'com.apostille.roots': {'build_test/pushno': '$disabled'}, 'com.apostille.root': '$disabled'}
gunicorn-registry stdout | 2024-04-22 04:12:00,660 [284] [DEBUG] [endpoints.v2] Checking permission <class 'auth.permissions.ModifyRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:12:00,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:12:00,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:12:00,660 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:12:00,661 [282] [DEBUG] [app] Starting request: urn:request:1988d553-8c5d-4cb2-98ad-dcc4ce67a13a (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:12:00,661 [278] [DEBUG] [app] Starting request: urn:request:321dd07e-2daf-4161-8fbf-23ecf890121c (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:12:00,661 [282] [DEBUG] [app] Ending request: urn:request:1988d553-8c5d-4cb2-98ad-dcc4ce67a13a (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1988d553-8c5d-4cb2-98ad-dcc4ce67a13a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:12:00,661 [278] [DEBUG] [app] Ending request: urn:request:321dd07e-2daf-4161-8fbf-23ecf890121c (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:321dd07e-2daf-4161-8fbf-23ecf890121c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:12:00,662 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:12:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:12:00,662 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:12:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:12:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:12:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:12:00,662 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:12:00,662 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:12:00,662 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:12:00,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-registry stdout | 2024-04-22 04:12:00,663 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:00,665 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:00,668 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['build_test', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:12:00,668 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:12:00,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-registry stdout | 2024-04-22 04:12:00,670 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."size_bytes", "t1"."backfill_start_ms", "t1"."backfill_complete" FROM "quotanamespacesize" AS "t1" WHERE ("t1"."namespace_user_id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:00,673 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['build_test', False, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:00,675 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['build_test'])
gunicorn-web stdout | 2024-04-22 04:12:00,676 [281] [DEBUG] [app] Ending request: urn:request:d700c542-e797-4fef-90b2-4baf760aa40b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:d700c542-e797-4fef-90b2-4baf760aa40b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:12:00,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:12:00,676 [279] [DEBUG] [app] Ending request: urn:request:9380c9ec-ae12-43c5-9849-25591cd52fe4 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:9380c9ec-ae12-43c5-9849-25591cd52fe4', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:12:00,676 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:12:00,676 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:12:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:12:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:12:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.025)
gunicorn-web stdout | 2024-04-22 04:12:00,677 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:12:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-registry stdout | 2024-04-22 04:12:00,677 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:00,679 [284] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "imagestoragelocation" AS "t1"', [])
gunicorn-registry stdout | 2024-04-22 04:12:00,682 [284] [DEBUG] [peewee] ('INSERT INTO "blobupload" ("repository_id", "uuid", "byte_count", "sha_state", "location_id", "storage_metadata", "chunk_count", "created") VALUES (%s, %s, %s, %s, %s, %s, %s, %s) RETURNING "blobupload"."id"', [1, '21d746f0-ec3a-4869-92ea-3cf4dcfc9066', 0, 'gASVqwAAAAAAAACMBnJlaGFzaJSMBnNoYTI1NpSTlCmBlH2UKIwEbmFtZZRoAYwHbWRfZGF0YZRDeGfmCWqFrme7cvNuPDr1T6V/Ug5RjGgFm6vZgx8ZzeBbAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACAAAAAAAAAAAAAAAJR1Yi4=', 9, '{"blocks": [], "content-type": null}', 0, datetime.datetime(2024, 4, 22, 4, 12, 0, 681574)])
gunicorn-registry stdout | 2024-04-22 04:12:00,695 [284] [DEBUG] [app] Ending request: urn:request:504b2c4e-206e-4a21-a4ef-77a907481499 (/v2/build_test/pushno/blobs/uploads/) {'endpoint': 'v2.start_blob_upload', 'request_id': 'urn:request:504b2c4e-206e-4a21-a4ef-77a907481499', 'remote_addr': '10.131.0.9', 'http_method': 'POST', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/v2/build_test/pushno/blobs/uploads/', 'path': '/v2/build_test/pushno/blobs/uploads/', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'skopeo/1.14.2'}
gunicorn-registry stdout | 2024-04-22 04:12:00,695 [284] [DEBUG] [data.database] Disconnecting from database.
gunicorn-registry stdout | 2024-04-22 04:12:00,695 [284] [DEBUG] [peewee.pool] Returning 140532887700160 to pool.
gunicorn-registry stdout | 2024-04-22 04:12:00,696 [284] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:12:00 +0000] "POST /v2/build_test/pushno/blobs/uploads/ HTTP/1.1" 202 0 "-" "skopeo/1.14.2"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:12:00 +0000] "POST /v2/build_test/pushno/blobs/uploads/ HTTP/1.1" 202 0 "-" "skopeo/1.14.2" (0.039 1691 0.039)
gunicorn-registry stdout | 2024-04-22 04:12:00,956 [289] [DEBUG] [app] Starting request: urn:request:294acc99-e581-40aa-914b-4ce04b0ccbd9 (/v2/build_test/pushno/blobs/uploads/21d746f0-ec3a-4869-92ea-3cf4dcfc9066) {'X-Forwarded-For': '123.123.45.4, 10.131.0.9'}
gunicorn-registry stdout | 2024-04-22 04:12:00,956 [289] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'upload_uuid': '21d746f0-ec3a-4869-92ea-3cf4dcfc9066', 'namespace_name': 'build_test', 'repo_name': 'pushno'}
gunicorn-registry stdout | 2024-04-22 04:12:00,956 [289] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IkRxU21rRHNucVFUNGtYOHo5OFZkMUsyTl9OUXJVaU0tTHJVeklXUS1oc2siLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoicXVheXJlZ2lzdHJ5LXF1YXktcXVheS1lbnRlcnByaXNlLmFwcHMud2h1NDE1YXoxNS5xZS5henVyZS5kZXZjbHVzdGVyLm9wZW5zaGlmdC5jb20iLCJuYmYiOjE3MTM3NTkxMTgsImlhdCI6MTcxMzc1OTExOCwiZXhwIjoxNzEzNzYyNzE4LCJzdWIiOiJ3aHVxdWF5IiwiYWNjZXNzIjpbeyJ0eXBlIjoicmVwb3NpdG9yeSIsIm5hbWUiOiJidWlsZF90ZXN0L3B1c2hubyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJhMTQ0MjU2Ni1hMmU0LTRmYmQtODZkNy1jZGJlNDQ4OTFiM2UiLCJraW5kIjoidXNlciIsInVzZXIiOiJ3aHVxdWF5IiwiY29tLmFwb3N0aWxsZS5yb290cyI6eyJidWlsZF90ZXN0L3B1c2hubyI6IiRkaXNhYmxlZCJ9LCJjb20uYXBvc3RpbGxlLnJvb3QiOiIkZGlzYWJsZWQifX0.rMSnZyravLQkNm9Uxq_FbKIOgLUoSNTZH97zgYvomLCbQ7OGR0WMFgEs-0VFoXypa4Ht5N8VUwZXrVIFonTV3TjyaCFLciFcsKWOxKjNjL9N8vU901Ry6xdaMf5GIANH6JhmZQgaaRTuadm8Z7D0H9eQ5uUVtNNyXe-iN7fj-kJfdLFDEeW0jh6rp-TkdeDdsOjFbd34cGuyA2mfut5f0euZ9tidhg9C94UKrBKvMTIbm_vRN2y4W7GtJhiANCiOHppRrEhqimwSaa1hujhRLFExfdNalQGPk9gI5ng73TU6XkLvhe1e6bixbcywvWCGQRiv4hQK79L1-dnEIvo8Ng
gunicorn-registry stdout | 2024-04-22 04:12:00,956 [289] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJhbGciOiJSUzI1NiIsImtpZCI6IkRxU21rRHNucVFUNGtYOHo5OFZkMUsyTl9OUXJVaU0tTHJVeklXUS1oc2siLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoicXVheXJlZ2lzdHJ5LXF1YXktcXVheS1lbnRlcnByaXNlLmFwcHMud2h1NDE1YXoxNS5xZS5henVyZS5kZXZjbHVzdGVyLm9wZW5zaGlmdC5jb20iLCJuYmYiOjE3MTM3NTkxMTgsImlhdCI6MTcxMzc1OTExOCwiZXhwIjoxNzEzNzYyNzE4LCJzdWIiOiJ3aHVxdWF5IiwiYWNjZXNzIjpbeyJ0eXBlIjoicmVwb3NpdG9yeSIsIm5hbWUiOiJidWlsZF90ZXN0L3B1c2hubyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJhMTQ0MjU2Ni1hMmU0LTRmYmQtODZkNy1jZGJlNDQ4OTFiM2UiLCJraW5kIjoidXNlciIsInVzZXIiOiJ3aHVxdWF5IiwiY29tLmFwb3N0aWxsZS5yb290cyI6eyJidWlsZF90ZXN0L3B1c2hubyI6IiRkaXNhYmxlZCJ9LCJjb20uYXBvc3RpbGxlLnJvb3QiOiIkZGlzYWJsZWQifX0.rMSnZyravLQkNm9Uxq_FbKIOgLUoSNTZH97zgYvomLCbQ7OGR0WMFgEs-0VFoXypa4Ht5N8VUwZXrVIFonTV3TjyaCFLciFcsKWOxKjNjL9N8vU901Ry6xdaMf5GIANH6JhmZQgaaRTuadm8Z7D0H9eQ5uUVtNNyXe-iN7fj-kJfdLFDEeW0jh6rp-TkdeDdsOjFbd34cGuyA2mfut5f0euZ9tidhg9C94UKrBKvMTIbm_vRN2y4W7GtJhiANCiOHppRrEhqimwSaa1hujhRLFExfdNalQGPk9gI5ng73TU6XkLvhe1e6bixbcywvWCGQRiv4hQK79L1-dnEIvo8Ng
gunicorn-registry stdout | 2024-04-22 04:12:00,958 [289] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE ((((NOT ("t1"."approval_id" IS %s) AND (("t1"."expiration_date" > %s) OR ("t1"."expiration_date" IS %s))) AND ("t1"."service" = %s)) AND (NOT (("t1"."service" = %s) AND ("t1"."expiration_date" <= %s)) OR NOT ((("t1"."service" = %s) AND ("t1"."approval_id" IS %s)) AND ("t1"."created_date" <= %s)))) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s)))', [None, datetime.datetime(2024, 4, 22, 4, 12, 0, 957111), None, 'quay', 'quay', datetime.datetime(2024, 4, 22, 4, 12, 0, 957132), 'quay', None, datetime.datetime(2024, 4, 21, 4, 12, 0, 957146), datetime.datetime(2024, 4, 15, 4, 12, 0, 957155), None])
gunicorn-registry stdout | 2024-04-22 04:12:00,958 [289] [DEBUG] [peewee.pool] No connection available in pool.
gunicorn-registry stdout | 2024-04-22 04:12:00,965 [289] [DEBUG] [peewee.pool] Created new connection 140532887700160.
gunicorn-registry stdout | 2024-04-22 04:12:00,973 [289] [DEBUG] [auth.permissions] Identity loaded: <Identity id="whuquay" auth_type="signed_jwt" provides={_ResourceNeed(type='repository', namespace='build_test', name='pushno', role='write')}>
gunicorn-registry stdout | 2024-04-22 04:12:00,973 [289] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: whuquay
gunicorn-registry stdout | 2024-04-22 04:12:00,973 [289] [DEBUG] [auth.registry_jwt_auth] Identity changed to whuquay
gunicorn-registry stdout | 2024-04-22 04:12:00,973 [289] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'a1442566-a2e4-4fbd-86d7-cdbe44891b3e', 'kind': 'user', 'user': 'whuquay', 'com.apostille.roots': {'build_test/pushno': '$disabled'}, 'com.apostille.root': '$disabled'}
gunicorn-registry stdout | 2024-04-22 04:12:00,973 [289] [DEBUG] [endpoints.v2] Checking permission <class 'auth.permissions.ModifyRepositoryPermission'> for repo: build_test/pushno
gunicorn-registry stdout | 2024-04-22 04:12:00,974 [289] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:00,977 [289] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:00,980 [289] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:00,982 [289] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1"', [])
gunicorn-registry stdout | 2024-04-22 04:12:00,984 [289] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['public', 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:00,986 [289] [DEBUG] [peewee] ('SELECT Sum("t1"."byte_count") AS "size_bytes" FROM "blobupload" AS "t1" WHERE ("t1"."repository_id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:00,989 [289] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['build_test', False, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:00,991 [289] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."size_bytes", "t1"."backfill_start_ms", "t1"."backfill_complete" FROM "quotanamespacesize" AS "t1" WHERE ("t1"."namespace_user_id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:00,994 [289] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['build_test', False, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:00,996 [289] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['build_test'])
gunicorn-registry stdout | 2024-04-22 04:12:00,998 [289] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['21d746f0-ec3a-4869-92ea-3cf4dcfc9066', 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:01,001 [289] [DEBUG] [data.database] Disconnecting from database.
gunicorn-registry stdout | 2024-04-22 04:12:01,001 [289] [DEBUG] [peewee.pool] Returning 140532887700160 to pool.
quotatotalworker stdout | 2024-04-22 04:12:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:12:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:16.054492+00:00 (in 14.999503 seconds)
quotatotalworker stdout | 2024-04-22 04:12:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:12:16 UTC)" (scheduled at 2024-04-22 04:12:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:12:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:12:01,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:12:01,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:12:16 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:12:01,508 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:12:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:12:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:16.552337+00:00 (in 13.995628 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:12:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:13:02 UTC)" (scheduled at 2024-04-22 04:12:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:12:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:12:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:13:02 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:12:02,966 [289] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://whusc1.blob.core.windows.net/whusc1container/quaydata/uploads/21d746f0-ec3a-4869-92ea-3cf4dcfc9066?blockid=REDACTED&comp=REDACTED'
gunicorn-registry stdout | Request method: 'PUT'
gunicorn-registry stdout | Request headers:
gunicorn-registry stdout |     'Content-Type': 'application/octet-stream'
gunicorn-registry stdout |     'Content-Length': '2798889'
gunicorn-registry stdout |     'x-ms-version': 'REDACTED'
gunicorn-registry stdout |     'x-ms-date': 'REDACTED'
gunicorn-registry stdout |     'x-ms-client-request-id': '790d2ad2-005e-11ef-966e-0a580a83001f'
gunicorn-registry stdout |     'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.9.18 (Linux-5.14.0-284.62.1.el9_2.x86_64-x86_64-with-glibc2.28)'
gunicorn-registry stdout |     'Content-MD5': 'REDACTED'
gunicorn-registry stdout |     'Authorization': 'REDACTED'
gunicorn-registry stdout | A body is sent with the request
gunicorn-registry stdout | 2024-04-22 04:12:02,969 [289] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): whusc1.blob.core.windows.net:443
notificationworker stdout | 2024-04-22 04:12:03,015 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-registry stdout | 2024-04-22 04:12:03,078 [289] [DEBUG] [urllib3.connectionpool] https://whusc1.blob.core.windows.net:443 "PUT /whusc1container/quaydata/uploads/21d746f0-ec3a-4869-92ea-3cf4dcfc9066?blockid=MDAwMDA%3D&comp=block HTTP/1.1" 201 0
gunicorn-registry stdout | 2024-04-22 04:12:03,079 [289] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 201
gunicorn-registry stdout | Response headers:
gunicorn-registry stdout |     'Content-Length': '0'
gunicorn-registry stdout |     'Content-MD5': 'REDACTED'
gunicorn-registry stdout |     'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0'
gunicorn-registry stdout |     'x-ms-request-id': '395a3c5e-501e-00d8-426b-946b66000000'
gunicorn-registry stdout |     'x-ms-client-request-id': '790d2ad2-005e-11ef-966e-0a580a83001f'
gunicorn-registry stdout |     'x-ms-version': 'REDACTED'
gunicorn-registry stdout |     'x-ms-request-server-encrypted': 'REDACTED'
gunicorn-registry stdout |     'Date': 'Mon, 22 Apr 2024 04:12:02 GMT'
gunicorn-registry stdout | 2024-04-22 04:12:03,080 [289] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['21d746f0-ec3a-4869-92ea-3cf4dcfc9066', 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:03,083 [289] [DEBUG] [peewee] ('UPDATE "blobupload" SET "repository_id" = %s, "uuid" = %s, "byte_count" = %s, "sha_state" = %s, "location_id" = %s, "storage_metadata" = %s, "chunk_count" = %s, "uncompressed_byte_count" = %s, "created" = %s, "piece_sha_state" = %s, "piece_hashes" = %s WHERE ("blobupload"."id" = %s)', [1, '21d746f0-ec3a-4869-92ea-3cf4dcfc9066', 2798889, 'gASVsgAAAAAAAACMBnJlaGFzaJSMBnNoYTI1NpSTlCmBlH2UKIwEbmFtZZSMBnNoYTI1NpSMB21kX2RhdGGUQ3jpqeXO1/No27w5r2wN3PI3NLb5luCuv0Ctihdu+R4ha0ipVQEAAAAAa05r/ON+3znp+T90OPxBfO3/a01rWtOaTpb+/wAAAP//DdVvXQCsWAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACkAAAAgAAAAAAAAAAAAAACUdWIu', 9, '{"blocks": ["00000"], "content-type": "application/octet-stream"}', 1, 5811200, datetime.datetime(2024, 4, 22, 4, 12, 0, 681574), None, None, 1])
gunicorn-registry stdout | 2024-04-22 04:12:03,088 [289] [DEBUG] [app] Ending request: urn:request:294acc99-e581-40aa-914b-4ce04b0ccbd9 (/v2/build_test/pushno/blobs/uploads/21d746f0-ec3a-4869-92ea-3cf4dcfc9066) {'endpoint': 'v2.upload_chunk', 'request_id': 'urn:request:294acc99-e581-40aa-914b-4ce04b0ccbd9', 'remote_addr': '10.131.0.9', 'http_method': 'PATCH', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/v2/build_test/pushno/blobs/uploads/21d746f0-ec3a-4869-92ea-3cf4dcfc9066', 'path': '/v2/build_test/pushno/blobs/uploads/21d746f0-ec3a-4869-92ea-3cf4dcfc9066', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'skopeo/1.14.2'}
gunicorn-registry stdout | 2024-04-22 04:12:03,088 [289] [DEBUG] [data.database] Disconnecting from database.
gunicorn-registry stdout | 2024-04-22 04:12:03,088 [289] [DEBUG] [peewee.pool] Returning 140532887700160 to pool.
gunicorn-registry stdout | 2024-04-22 04:12:03,088 [289] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:12:03 +0000] "PATCH /v2/build_test/pushno/blobs/uploads/21d746f0-ec3a-4869-92ea-3cf4dcfc9066 HTTP/1.1" 202 0 "-" "skopeo/1.14.2"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:12:03 +0000] "PATCH /v2/build_test/pushno/blobs/uploads/21d746f0-ec3a-4869-92ea-3cf4dcfc9066 HTTP/1.1" 202 0 "-" "skopeo/1.14.2" (2.133 2800663 2.133)
gunicorn-web stdout | 2024-04-22 04:12:03,551 [282] [DEBUG] [app] Starting request: urn:request:225f87ef-cc37-4856-99cc-7ecabb239ad2 (/api/v1/user/notifications) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:12:03,552 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:12:03,552 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:12:03,552 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:12:03,561 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:12:03,561 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:12:03,561 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:12:03,561 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:12:03,561 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:12:03,561 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:12:03,561 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:12:03,561 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:12:03,563 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."dismissed" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."dismissed" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', [False, 1, False, 1, 'admin', 6])
gunicorn-web stdout | 2024-04-22 04:12:03,568 [282] [DEBUG] [app] Ending request: urn:request:225f87ef-cc37-4856-99cc-7ecabb239ad2 (/api/v1/user/notifications) {'endpoint': 'api.usernotificationlist', 'request_id': 'urn:request:225f87ef-cc37-4856-99cc-7ecabb239ad2', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/notifications', 'path': '/api/v1/user/notifications', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:12:03,568 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:12:03,568 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:12:03 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 43 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:12:03 +0000] "GET /api/v1/user/notifications HTTP/1.1" 200 43 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.018 1511 0.018)
notificationworker stdout | 2024-04-22 04:12:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:12:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:13.759375+00:00 (in 9.999436 seconds)
notificationworker stdout | 2024-04-22 04:12:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:12:13 UTC)" (scheduled at 2024-04-22 04:12:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:12:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:12:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 3, 760254), True, datetime.datetime(2024, 4, 22, 4, 12, 3, 760254), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:03,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:12:03,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:03,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:12:13 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:12:04,285 [278] [DEBUG] [app] Starting request: urn:request:98afbe1e-f49f-449e-aa7d-5695257051eb (/api/v1/user/apptoken) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:12:04,285 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:12:04,285 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:12:04,286 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:12:04,294 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:12:04,295 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:12:04,295 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:12:04,295 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:12:04,295 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:12:04,295 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:12:04,295 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:12:04,295 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:12:04,296 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."uuid", "t1"."title", "t1"."token_name", "t1"."token_secret", "t1"."created", "t1"."expiration", "t1"."last_accessed" FROM "appspecificauthtoken" AS "t1" WHERE ((("t1"."user_id" = %s) AND ("t1"."expiration" <= %s)) AND ("t1"."expiration" > %s))', [1, datetime.datetime(2024, 4, 24, 23, 24, 4, 295633), datetime.datetime(2024, 4, 22, 4, 12, 4, 295671)])
gunicorn-web stdout | 2024-04-22 04:12:04,298 [278] [DEBUG] [app] Ending request: urn:request:98afbe1e-f49f-449e-aa7d-5695257051eb (/api/v1/user/apptoken) {'endpoint': 'api.apptokens', 'request_id': 'urn:request:98afbe1e-f49f-449e-aa7d-5695257051eb', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/apptoken?expiring=true', 'path': '/api/v1/user/apptoken', 'parameters': {'expiring': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:12:04,298 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:12:04 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.1" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.015 1520 0.015)
gunicorn-web stdout | 2024-04-22 04:12:04,299 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:12:04 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
buildlogsarchiver stdout | 2024-04-22 04:12:04,441 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gunicorn-registry stdout | 2024-04-22 04:12:04,658 [292] [DEBUG] [app] Starting request: urn:request:b7331562-7d48-4b0f-88b6-c171307b65f9 (/v2/build_test/pushno/blobs/sha256:e66264b98777e12192600bf9b4d663655c98a090072e1bab49e233d7531d1294) {'X-Forwarded-For': '123.123.45.4, 10.131.0.9'}
gunicorn-registry stdout | 2024-04-22 04:12:04,658 [292] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'digest': 'sha256:e66264b98777e12192600bf9b4d663655c98a090072e1bab49e233d7531d1294', 'namespace_name': 'build_test', 'repo_name': 'pushno'}
gunicorn-registry stdout | 2024-04-22 04:12:04,658 [292] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IkRxU21rRHNucVFUNGtYOHo5OFZkMUsyTl9OUXJVaU0tTHJVeklXUS1oc2siLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoicXVheXJlZ2lzdHJ5LXF1YXktcXVheS1lbnRlcnByaXNlLmFwcHMud2h1NDE1YXoxNS5xZS5henVyZS5kZXZjbHVzdGVyLm9wZW5zaGlmdC5jb20iLCJuYmYiOjE3MTM3NTkxMTgsImlhdCI6MTcxMzc1OTExOCwiZXhwIjoxNzEzNzYyNzE4LCJzdWIiOiJ3aHVxdWF5IiwiYWNjZXNzIjpbeyJ0eXBlIjoicmVwb3NpdG9yeSIsIm5hbWUiOiJidWlsZF90ZXN0L3B1c2hubyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJhMTQ0MjU2Ni1hMmU0LTRmYmQtODZkNy1jZGJlNDQ4OTFiM2UiLCJraW5kIjoidXNlciIsInVzZXIiOiJ3aHVxdWF5IiwiY29tLmFwb3N0aWxsZS5yb290cyI6eyJidWlsZF90ZXN0L3B1c2hubyI6IiRkaXNhYmxlZCJ9LCJjb20uYXBvc3RpbGxlLnJvb3QiOiIkZGlzYWJsZWQifX0.rMSnZyravLQkNm9Uxq_FbKIOgLUoSNTZH97zgYvomLCbQ7OGR0WMFgEs-0VFoXypa4Ht5N8VUwZXrVIFonTV3TjyaCFLciFcsKWOxKjNjL9N8vU901Ry6xdaMf5GIANH6JhmZQgaaRTuadm8Z7D0H9eQ5uUVtNNyXe-iN7fj-kJfdLFDEeW0jh6rp-TkdeDdsOjFbd34cGuyA2mfut5f0euZ9tidhg9C94UKrBKvMTIbm_vRN2y4W7GtJhiANCiOHppRrEhqimwSaa1hujhRLFExfdNalQGPk9gI5ng73TU6XkLvhe1e6bixbcywvWCGQRiv4hQK79L1-dnEIvo8Ng
gunicorn-registry stdout | 2024-04-22 04:12:04,658 [292] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJhbGciOiJSUzI1NiIsImtpZCI6IkRxU21rRHNucVFUNGtYOHo5OFZkMUsyTl9OUXJVaU0tTHJVeklXUS1oc2siLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoicXVheXJlZ2lzdHJ5LXF1YXktcXVheS1lbnRlcnByaXNlLmFwcHMud2h1NDE1YXoxNS5xZS5henVyZS5kZXZjbHVzdGVyLm9wZW5zaGlmdC5jb20iLCJuYmYiOjE3MTM3NTkxMTgsImlhdCI6MTcxMzc1OTExOCwiZXhwIjoxNzEzNzYyNzE4LCJzdWIiOiJ3aHVxdWF5IiwiYWNjZXNzIjpbeyJ0eXBlIjoicmVwb3NpdG9yeSIsIm5hbWUiOiJidWlsZF90ZXN0L3B1c2hubyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJhMTQ0MjU2Ni1hMmU0LTRmYmQtODZkNy1jZGJlNDQ4OTFiM2UiLCJraW5kIjoidXNlciIsInVzZXIiOiJ3aHVxdWF5IiwiY29tLmFwb3N0aWxsZS5yb290cyI6eyJidWlsZF90ZXN0L3B1c2hubyI6IiRkaXNhYmxlZCJ9LCJjb20uYXBvc3RpbGxlLnJvb3QiOiIkZGlzYWJsZWQifX0.rMSnZyravLQkNm9Uxq_FbKIOgLUoSNTZH97zgYvomLCbQ7OGR0WMFgEs-0VFoXypa4Ht5N8VUwZXrVIFonTV3TjyaCFLciFcsKWOxKjNjL9N8vU901Ry6xdaMf5GIANH6JhmZQgaaRTuadm8Z7D0H9eQ5uUVtNNyXe-iN7fj-kJfdLFDEeW0jh6rp-TkdeDdsOjFbd34cGuyA2mfut5f0euZ9tidhg9C94UKrBKvMTIbm_vRN2y4W7GtJhiANCiOHppRrEhqimwSaa1hujhRLFExfdNalQGPk9gI5ng73TU6XkLvhe1e6bixbcywvWCGQRiv4hQK79L1-dnEIvo8Ng
gunicorn-registry stdout | 2024-04-22 04:12:04,660 [292] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE ((((NOT ("t1"."approval_id" IS %s) AND (("t1"."expiration_date" > %s) OR ("t1"."expiration_date" IS %s))) AND ("t1"."service" = %s)) AND (NOT (("t1"."service" = %s) AND ("t1"."expiration_date" <= %s)) OR NOT ((("t1"."service" = %s) AND ("t1"."approval_id" IS %s)) AND ("t1"."created_date" <= %s)))) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s)))', [None, datetime.datetime(2024, 4, 22, 4, 12, 4, 659359), None, 'quay', 'quay', datetime.datetime(2024, 4, 22, 4, 12, 4, 659381), 'quay', None, datetime.datetime(2024, 4, 21, 4, 12, 4, 659396), datetime.datetime(2024, 4, 15, 4, 12, 4, 659408), None])
gunicorn-registry stdout | 2024-04-22 04:12:04,660 [292] [DEBUG] [peewee.pool] No connection available in pool.
gunicorn-registry stdout | 2024-04-22 04:12:04,667 [292] [DEBUG] [peewee.pool] Created new connection 140532887503552.
gunicorn-registry stdout | 2024-04-22 04:12:04,674 [292] [DEBUG] [auth.permissions] Identity loaded: <Identity id="whuquay" auth_type="signed_jwt" provides={_ResourceNeed(type='repository', namespace='build_test', name='pushno', role='write')}>
gunicorn-registry stdout | 2024-04-22 04:12:04,674 [292] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: whuquay
gunicorn-registry stdout | 2024-04-22 04:12:04,674 [292] [DEBUG] [auth.registry_jwt_auth] Identity changed to whuquay
gunicorn-registry stdout | 2024-04-22 04:12:04,674 [292] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'a1442566-a2e4-4fbd-86d7-cdbe44891b3e', 'kind': 'user', 'user': 'whuquay', 'com.apostille.roots': {'build_test/pushno': '$disabled'}, 'com.apostille.root': '$disabled'}
gunicorn-registry stdout | 2024-04-22 04:12:04,675 [292] [DEBUG] [endpoints.v2] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-registry stdout | 2024-04-22 04:12:04,675 [292] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:04,678 [292] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."organization_id", "t1"."creation_date", "t1"."upstream_registry", "t1"."upstream_registry_username", "t1"."upstream_registry_password", "t1"."expiration_s", "t1"."insecure" FROM "proxycacheconfig" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") WHERE (("t2"."username" = %s) AND ("t2"."organization" = %s)) LIMIT %s OFFSET %s', ['build_test', True, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:04,681 [292] [DEBUG] [endpoints.decorators] Skipping pull through proxy cache: <Model: ProxyCacheConfig> instance matching query does not exist:
gunicorn-registry stdout | SQL: SELECT "t1"."id", "t1"."organization_id", "t1"."creation_date", "t1"."upstream_registry", "t1"."upstream_registry_username", "t1"."upstream_registry_password", "t1"."expiration_s", "t1"."insecure" FROM "proxycacheconfig" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") WHERE (("t2"."username" = %s) AND ("t2"."organization" = %s)) LIMIT %s OFFSET %s
gunicorn-registry stdout | Params: ['build_test', True, 1, 0]
gunicorn-registry stdout | 2024-04-22 04:12:04,681 [292] [DEBUG] [data.cache.impl] Checking cache for key repo_blob__build_test_pushno_sha256:e66264b98777e12192600bf9b4d663655c98a090072e1bab49e233d7531d1294_2
gunicorn-registry stdout | 2024-04-22 04:12:04,681 [292] [DEBUG] [data.cache.impl] Found no result in cache for key repo_blob__build_test_pushno_sha256:e66264b98777e12192600bf9b4d663655c98a090072e1bab49e233d7531d1294_2; calling loader
gunicorn-registry stdout | 2024-04-22 04:12:04,682 [292] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:04,685 [292] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:04,687 [292] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:04,690 [292] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1"', [])
gunicorn-registry stdout | 2024-04-22 04:12:04,692 [292] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['public', 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:04,694 [292] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "uploadedblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:e66264b98777e12192600bf9b4d663655c98a090072e1bab49e233d7531d1294', 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:04,697 [292] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "manifestblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:e66264b98777e12192600bf9b4d663655c98a090072e1bab49e233d7531d1294', 1, 0])
gcworker stdout | 2024-04-22 04:12:04,698 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
gunicorn-registry stdout | 2024-04-22 04:12:04,699 [292] [DEBUG] [data.cache.impl] Got loaded result for key repo_blob__build_test_pushno_sha256:e66264b98777e12192600bf9b4d663655c98a090072e1bab49e233d7531d1294_2: None
gunicorn-registry stdout | 2024-04-22 04:12:04,699 [292] [DEBUG] [data.cache.impl] Not caching loaded result for key repo_blob__build_test_pushno_sha256:e66264b98777e12192600bf9b4d663655c98a090072e1bab49e233d7531d1294_2: None
gunicorn-registry stdout | 2024-04-22 04:12:04,699 [292] [DEBUG] [endpoints.v2] sending response: b'{"errors":[{"code":"BLOB_UNKNOWN","detail":{},"message":"blob unknown to registry"}]}\n'
gunicorn-registry stdout | 2024-04-22 04:12:04,700 [292] [DEBUG] [app] Ending request: urn:request:b7331562-7d48-4b0f-88b6-c171307b65f9 (/v2/build_test/pushno/blobs/sha256:e66264b98777e12192600bf9b4d663655c98a090072e1bab49e233d7531d1294) {'endpoint': 'v2.check_blob_exists', 'request_id': 'urn:request:b7331562-7d48-4b0f-88b6-c171307b65f9', 'remote_addr': '10.131.0.9', 'http_method': 'HEAD', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/v2/build_test/pushno/blobs/sha256:e66264b98777e12192600bf9b4d663655c98a090072e1bab49e233d7531d1294', 'path': '/v2/build_test/pushno/blobs/sha256:e66264b98777e12192600bf9b4d663655c98a090072e1bab49e233d7531d1294', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'skopeo/1.14.2'}
gunicorn-registry stdout | 2024-04-22 04:12:04,700 [292] [DEBUG] [data.database] Disconnecting from database.
gunicorn-registry stdout | 2024-04-22 04:12:04,700 [292] [DEBUG] [peewee.pool] Returning 140532887503552 to pool.
gunicorn-registry stdout | 2024-04-22 04:12:04,700 [292] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:12:04 +0000] "HEAD /v2/build_test/pushno/blobs/sha256:e66264b98777e12192600bf9b4d663655c98a090072e1bab49e233d7531d1294 HTTP/1.1" 404 0 "-" "skopeo/1.14.2"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:12:04 +0000] "HEAD /v2/build_test/pushno/blobs/sha256:e66264b98777e12192600bf9b4d663655c98a090072e1bab49e233d7531d1294 HTTP/1.1" 404 0 "-" "skopeo/1.14.2" (0.044 1712 0.044)
gunicorn-secscan stdout | 2024-04-22 04:12:04,796 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:12:04,799 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:12:04,802 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
exportactionlogsworker stdout | 2024-04-22 04:12:04,913 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-registry stdout | 2024-04-22 04:12:04,981 [288] [DEBUG] [app] Starting request: urn:request:fd6df0ca-0fb5-47d5-bc47-a51caf55f479 (/v2/build_test/pushno/blobs/uploads/) {'X-Forwarded-For': '123.123.45.4, 10.131.0.9'}
gunicorn-registry stdout | 2024-04-22 04:12:04,981 [288] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'namespace_name': 'build_test', 'repo_name': 'pushno'}
gunicorn-registry stdout | 2024-04-22 04:12:04,981 [288] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IkRxU21rRHNucVFUNGtYOHo5OFZkMUsyTl9OUXJVaU0tTHJVeklXUS1oc2siLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoicXVheXJlZ2lzdHJ5LXF1YXktcXVheS1lbnRlcnByaXNlLmFwcHMud2h1NDE1YXoxNS5xZS5henVyZS5kZXZjbHVzdGVyLm9wZW5zaGlmdC5jb20iLCJuYmYiOjE3MTM3NTkxMTgsImlhdCI6MTcxMzc1OTExOCwiZXhwIjoxNzEzNzYyNzE4LCJzdWIiOiJ3aHVxdWF5IiwiYWNjZXNzIjpbeyJ0eXBlIjoicmVwb3NpdG9yeSIsIm5hbWUiOiJidWlsZF90ZXN0L3B1c2hubyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJhMTQ0MjU2Ni1hMmU0LTRmYmQtODZkNy1jZGJlNDQ4OTFiM2UiLCJraW5kIjoidXNlciIsInVzZXIiOiJ3aHVxdWF5IiwiY29tLmFwb3N0aWxsZS5yb290cyI6eyJidWlsZF90ZXN0L3B1c2hubyI6IiRkaXNhYmxlZCJ9LCJjb20uYXBvc3RpbGxlLnJvb3QiOiIkZGlzYWJsZWQifX0.rMSnZyravLQkNm9Uxq_FbKIOgLUoSNTZH97zgYvomLCbQ7OGR0WMFgEs-0VFoXypa4Ht5N8VUwZXrVIFonTV3TjyaCFLciFcsKWOxKjNjL9N8vU901Ry6xdaMf5GIANH6JhmZQgaaRTuadm8Z7D0H9eQ5uUVtNNyXe-iN7fj-kJfdLFDEeW0jh6rp-TkdeDdsOjFbd34cGuyA2mfut5f0euZ9tidhg9C94UKrBKvMTIbm_vRN2y4W7GtJhiANCiOHppRrEhqimwSaa1hujhRLFExfdNalQGPk9gI5ng73TU6XkLvhe1e6bixbcywvWCGQRiv4hQK79L1-dnEIvo8Ng
gunicorn-registry stdout | 2024-04-22 04:12:04,981 [288] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJhbGciOiJSUzI1NiIsImtpZCI6IkRxU21rRHNucVFUNGtYOHo5OFZkMUsyTl9OUXJVaU0tTHJVeklXUS1oc2siLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoicXVheXJlZ2lzdHJ5LXF1YXktcXVheS1lbnRlcnByaXNlLmFwcHMud2h1NDE1YXoxNS5xZS5henVyZS5kZXZjbHVzdGVyLm9wZW5zaGlmdC5jb20iLCJuYmYiOjE3MTM3NTkxMTgsImlhdCI6MTcxMzc1OTExOCwiZXhwIjoxNzEzNzYyNzE4LCJzdWIiOiJ3aHVxdWF5IiwiYWNjZXNzIjpbeyJ0eXBlIjoicmVwb3NpdG9yeSIsIm5hbWUiOiJidWlsZF90ZXN0L3B1c2hubyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJhMTQ0MjU2Ni1hMmU0LTRmYmQtODZkNy1jZGJlNDQ4OTFiM2UiLCJraW5kIjoidXNlciIsInVzZXIiOiJ3aHVxdWF5IiwiY29tLmFwb3N0aWxsZS5yb290cyI6eyJidWlsZF90ZXN0L3B1c2hubyI6IiRkaXNhYmxlZCJ9LCJjb20uYXBvc3RpbGxlLnJvb3QiOiIkZGlzYWJsZWQifX0.rMSnZyravLQkNm9Uxq_FbKIOgLUoSNTZH97zgYvomLCbQ7OGR0WMFgEs-0VFoXypa4Ht5N8VUwZXrVIFonTV3TjyaCFLciFcsKWOxKjNjL9N8vU901Ry6xdaMf5GIANH6JhmZQgaaRTuadm8Z7D0H9eQ5uUVtNNyXe-iN7fj-kJfdLFDEeW0jh6rp-TkdeDdsOjFbd34cGuyA2mfut5f0euZ9tidhg9C94UKrBKvMTIbm_vRN2y4W7GtJhiANCiOHppRrEhqimwSaa1hujhRLFExfdNalQGPk9gI5ng73TU6XkLvhe1e6bixbcywvWCGQRiv4hQK79L1-dnEIvo8Ng
gunicorn-registry stdout | 2024-04-22 04:12:04,983 [288] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE ((((NOT ("t1"."approval_id" IS %s) AND (("t1"."expiration_date" > %s) OR ("t1"."expiration_date" IS %s))) AND ("t1"."service" = %s)) AND (NOT (("t1"."service" = %s) AND ("t1"."expiration_date" <= %s)) OR NOT ((("t1"."service" = %s) AND ("t1"."approval_id" IS %s)) AND ("t1"."created_date" <= %s)))) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s)))', [None, datetime.datetime(2024, 4, 22, 4, 12, 4, 982212), None, 'quay', 'quay', datetime.datetime(2024, 4, 22, 4, 12, 4, 982233), 'quay', None, datetime.datetime(2024, 4, 21, 4, 12, 4, 982247), datetime.datetime(2024, 4, 15, 4, 12, 4, 982256), None])
gunicorn-registry stdout | 2024-04-22 04:12:04,983 [288] [DEBUG] [peewee.pool] No connection available in pool.
gunicorn-registry stdout | 2024-04-22 04:12:04,989 [288] [DEBUG] [peewee.pool] Created new connection 140532887696064.
gunicorn-registry stdout | 2024-04-22 04:12:04,997 [288] [DEBUG] [auth.permissions] Identity loaded: <Identity id="whuquay" auth_type="signed_jwt" provides={_ResourceNeed(type='repository', namespace='build_test', name='pushno', role='write')}>
gunicorn-registry stdout | 2024-04-22 04:12:04,997 [288] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: whuquay
gunicorn-registry stdout | 2024-04-22 04:12:04,997 [288] [DEBUG] [auth.registry_jwt_auth] Identity changed to whuquay
gunicorn-registry stdout | 2024-04-22 04:12:04,997 [288] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'a1442566-a2e4-4fbd-86d7-cdbe44891b3e', 'kind': 'user', 'user': 'whuquay', 'com.apostille.roots': {'build_test/pushno': '$disabled'}, 'com.apostille.root': '$disabled'}
gunicorn-registry stdout | 2024-04-22 04:12:04,998 [288] [DEBUG] [endpoints.v2] Checking permission <class 'auth.permissions.ModifyRepositoryPermission'> for repo: build_test/pushno
gunicorn-registry stdout | 2024-04-22 04:12:04,999 [288] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:05,002 [288] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:05,004 [288] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:05,007 [288] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1"', [])
gunicorn-registry stdout | 2024-04-22 04:12:05,009 [288] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['public', 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:05,011 [288] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['build_test', False, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:05,013 [288] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."size_bytes", "t1"."backfill_start_ms", "t1"."backfill_complete" FROM "quotanamespacesize" AS "t1" WHERE ("t1"."namespace_user_id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:05,016 [288] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['build_test', False, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:05,018 [288] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['build_test'])
gunicorn-registry stdout | 2024-04-22 04:12:05,021 [288] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:12:05,023 [288] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "imagestoragelocation" AS "t1"', [])
gunicorn-registry stdout | 2024-04-22 04:12:05,026 [288] [DEBUG] [peewee] ('INSERT INTO "blobupload" ("repository_id", "uuid", "byte_count", "sha_state", "location_id", "storage_metadata", "chunk_count", "created") VALUES (%s, %s, %s, %s, %s, %s, %s, %s) RETURNING "blobupload"."id"', [1, '55f422d1-cddc-42e4-9f13-76f06e2852ad', 0, 'gASVqwAAAAAAAACMBnJlaGFzaJSMBnNoYTI1NpSTlCmBlH2UKIwEbmFtZZRoAYwHbWRfZGF0YZRDeGfmCWqFrme7cvNuPDr1T6V/Ug5RjGgFm6vZgx8ZzeBbAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACAAAAAAAAAAAAAAAJR1Yi4=', 9, '{"blocks": [], "content-type": null}', 0, datetime.datetime(2024, 4, 22, 4, 12, 5, 25462)])
gunicorn-registry stdout | 2024-04-22 04:12:05,031 [288] [DEBUG] [app] Ending request: urn:request:fd6df0ca-0fb5-47d5-bc47-a51caf55f479 (/v2/build_test/pushno/blobs/uploads/) {'endpoint': 'v2.start_blob_upload', 'request_id': 'urn:request:fd6df0ca-0fb5-47d5-bc47-a51caf55f479', 'remote_addr': '10.131.0.9', 'http_method': 'POST', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/v2/build_test/pushno/blobs/uploads/', 'path': '/v2/build_test/pushno/blobs/uploads/', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'skopeo/1.14.2'}
gunicorn-registry stdout | 2024-04-22 04:12:05,031 [288] [DEBUG] [data.database] Disconnecting from database.
gunicorn-registry stdout | 2024-04-22 04:12:05,031 [288] [DEBUG] [peewee.pool] Returning 140532887696064 to pool.
gunicorn-registry stdout | 2024-04-22 04:12:05,031 [288] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:12:05 +0000] "POST /v2/build_test/pushno/blobs/uploads/ HTTP/1.1" 202 0 "-" "skopeo/1.14.2"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:12:05 +0000] "POST /v2/build_test/pushno/blobs/uploads/ HTTP/1.1" 202 0 "-" "skopeo/1.14.2" (0.051 1691 0.051)
securityworker stdout | 2024-04-22 04:12:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:12:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:26.873109+00:00 (in 21.000821 seconds)
securityworker stdout | 2024-04-22 04:12:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:12:35 UTC)" (scheduled at 2024-04-22 04:12:05.871852+00:00)
securityworker stdout | 2024-04-22 04:12:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:12:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:12:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:12:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:12:05,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:12:05,886 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:12:05,887 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:12:35 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:12:05,976 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
repositorygcworker stdout | 2024-04-22 04:12:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:12:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:13.555667+00:00 (in 7.002686 seconds)
repositorygcworker stdout | 2024-04-22 04:12:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:13:06 UTC)" (scheduled at 2024-04-22 04:12:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:12:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:12:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 6, 553376), True, datetime.datetime(2024, 4, 22, 4, 12, 6, 553376), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:12:06,563 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:12:06,563 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:12:06,563 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:13:06 UTC)" executed successfully
autopruneworker stdout | 2024-04-22 04:12:07,168 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:12:07,227 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:12:07,357 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:12:08,316 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:12:09,671 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:12:09,712 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:12:10,081 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:12:10,083 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:12:11,122 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:12:11,127 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:12:11,131 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:12:11,134 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:12:11,137 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:12:11,140 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:12:11,149 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:12:11,154 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:12:11,157 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
autopruneworker stdout | 2024-04-22 04:12:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:12:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:41.264267+00:00 (in 29.999462 seconds)
autopruneworker stdout | 2024-04-22 04:12:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:12:41 UTC)" (scheduled at 2024-04-22 04:12:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:12:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759071271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:12:11,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:12:11,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:12:11,275 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:12:41 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:12:11,440 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:12:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:12:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:13:06.552482+00:00 (in 52.996344 seconds)
repositorygcworker stdout | 2024-04-22 04:12:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:13:13 UTC)" (scheduled at 2024-04-22 04:12:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:12:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:12:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:13:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:12:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:12:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:19.762424+00:00 (in 6.002540 seconds)
notificationworker stdout | 2024-04-22 04:12:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:12:23 UTC)" (scheduled at 2024-04-22 04:12:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:12:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:12:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 13, 760271), True, datetime.datetime(2024, 4, 22, 4, 12, 13, 760271), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:13,770 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 12, 43, 760271), 1, '2e276a34-1157-4749-b94c-bf999449d35f', 1, 'cc8a91cd-7c67-40d4-b17f-e9dd39d2b8de'])
notificationworker stdout | 2024-04-22 04:12:13,774 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "be8728b1-b88c-4c96-82bc-47b149e585ad", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "updated_tags": ["push1"]}, "performer_data": {"entity_id": 1, "entity_name": "whuquay"}}
notificationworker stdout | 2024-04-22 04:12:13,775 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:13,776 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['be8728b1-b88c-4c96-82bc-47b149e585ad', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:13,785 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1"', [])
notificationworker stdout | 2024-04-22 04:12:13,788 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1"', [])
notificationworker stdout | 2024-04-22 04:12:13,790 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description" FROM "team" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") WHERE ((("t1"."name" = %s) AND ("t2"."organization" = %s)) AND ("t2"."username" = %s)) LIMIT %s', ['owners', True, 'build_test', 1])
notificationworker stdout | 2024-04-22 04:12:13,793 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" INNER JOIN "teammember" AS "t2" ON ("t2"."user_id" = "t1"."id") INNER JOIN "team" AS "t3" ON ("t2"."team_id" = "t3"."id") WHERE ("t3"."id" = %s)', [1])
notificationworker stdout | 2024-04-22 04:12:13,795 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['repo_push', 1, 0])
notificationworker stdout | 2024-04-22 04:12:13,798 [78] [DEBUG] [peewee] ('INSERT INTO "notification" ("uuid", "kind_id", "target_id", "metadata_json", "created", "dismissed", "lookup_path") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "notification"."id"', ['69ac9116-d7c9-4379-8e97-67d089263446', 10, 1, '{"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "updated_tags": ["push1"]}', datetime.datetime(2024, 4, 22, 4, 12, 13, 798149), False, None])
notificationworker stdout | 2024-04-22 04:12:13,803 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures" FROM "repositorynotification" AS "t1" WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['be8728b1-b88c-4c96-82bc-47b149e585ad', 1, 0])
notificationworker stdout | 2024-04-22 04:12:13,806 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
notificationworker stdout | 2024-04-22 04:12:13,808 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
notificationworker stdout | 2024-04-22 04:12:13,810 [78] [DEBUG] [peewee] ('UPDATE "repositorynotification" SET "number_of_failures" = %s WHERE ("repositorynotification"."id" = %s)', [0, 1])
notificationworker stdout | 2024-04-22 04:12:13,814 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [1])
notificationworker stdout | 2024-04-22 04:12:13,818 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 13, 818045), True, datetime.datetime(2024, 4, 22, 4, 12, 13, 818045), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:13,821 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:12:13,821 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:13,821 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:12:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:12:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:12:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:44.952062+00:00 (in 29.999542 seconds)
gcworker stdout | 2024-04-22 04:12:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:12:44 UTC)" (scheduled at 2024-04-22 04:12:14.952062+00:00)
gcworker stdout | 2024-04-22 04:12:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549534952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:12:14,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:12:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:12:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:12:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:12:15,653 [279] [DEBUG] [app] Starting request: urn:request:0103206a-8791-4e57-b35c-8dc71f609e1c (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:12:15,653 [278] [DEBUG] [app] Starting request: urn:request:1f1db46d-32c5-4cf6-8efa-1ea52444a465 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:12:15,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:12:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:12:15,656 [284] [DEBUG] [app] Starting request: urn:request:689793ee-dc39-4d10-8816-8ae1388cb235 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:12:15,656 [292] [DEBUG] [app] Starting request: urn:request:d01b2a76-0575-4ee3-a518-e1ecbf23dde4 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:12:15,656 [284] [DEBUG] [app] Ending request: urn:request:689793ee-dc39-4d10-8816-8ae1388cb235 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:689793ee-dc39-4d10-8816-8ae1388cb235', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:12:15,657 [292] [DEBUG] [app] Ending request: urn:request:d01b2a76-0575-4ee3-a518-e1ecbf23dde4 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:d01b2a76-0575-4ee3-a518-e1ecbf23dde4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:12:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:12:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:12:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:12:15,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:12:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:12:15,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:12:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:12:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:12:15,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:12:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:12:15,659 [282] [DEBUG] [app] Starting request: urn:request:7294346e-f53a-447d-8809-da5cf78073a4 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:12:15,660 [281] [DEBUG] [app] Starting request: urn:request:941fbc8e-9722-4a5f-905c-5bf7f373b63f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:12:15,660 [282] [DEBUG] [app] Ending request: urn:request:7294346e-f53a-447d-8809-da5cf78073a4 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:7294346e-f53a-447d-8809-da5cf78073a4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:12:15,660 [281] [DEBUG] [app] Ending request: urn:request:941fbc8e-9722-4a5f-905c-5bf7f373b63f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:941fbc8e-9722-4a5f-905c-5bf7f373b63f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:12:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:12:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:12:15,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:12:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:12:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:12:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:12:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:12:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:12:15,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:12:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:12:15,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:12:15,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:12:15,674 [279] [DEBUG] [app] Ending request: urn:request:0103206a-8791-4e57-b35c-8dc71f609e1c (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:0103206a-8791-4e57-b35c-8dc71f609e1c', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:12:15,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:12:15,674 [278] [DEBUG] [app] Ending request: urn:request:1f1db46d-32c5-4cf6-8efa-1ea52444a465 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:1f1db46d-32c5-4cf6-8efa-1ea52444a465', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:12:15,674 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:12:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:12:15,674 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:12:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:12:15,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:12:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:12:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotatotalworker stdout | 2024-04-22 04:12:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:12:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:31.054492+00:00 (in 14.999456 seconds)
quotatotalworker stdout | 2024-04-22 04:12:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:12:31 UTC)" (scheduled at 2024-04-22 04:12:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:12:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:12:16,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:12:16,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:12:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:12:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:12:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:21.555879+00:00 (in 5.002949 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:12:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:13:16 UTC)" (scheduled at 2024-04-22 04:12:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:12:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:12:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 16, 553337), True, datetime.datetime(2024, 4, 22, 4, 12, 16, 553337), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:12:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:12:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:12:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:13:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:12:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:12:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:47.052354+00:00 (in 29.999432 seconds)
buildlogsarchiver stdout | 2024-04-22 04:12:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:12:47 UTC)" (scheduled at 2024-04-22 04:12:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:12:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 12, 17, 53320), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:12:17,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:12:17,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:12:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:12:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:12:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:12:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:23.759375+00:00 (in 3.996419 seconds)
notificationworker stdout | 2024-04-22 04:12:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:13:19 UTC)" (scheduled at 2024-04-22 04:12:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:12:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:12:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:13:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:12:20,513 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:12:21,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:12:21,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:13:02.556208+00:00 (in 40.999808 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:12:21,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:17:21 UTC)" (scheduled at 2024-04-22 04:12:21.555879+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:12:21,557 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 12, 21, 556795), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 04:12:21,567 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 12, 21, 556795), True, datetime.datetime(2024, 4, 22, 4, 12, 21, 556795), 0, 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 04:12:21,569 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 12, 21, 556795), True, datetime.datetime(2024, 4, 22, 4, 12, 21, 556795), 0, 'secscanv4/%', False, datetime.datetime(2024, 4, 22, 4, 12, 21, 556795), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 04:12:21,571 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:12:21,572 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:17:21 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:12:21,878 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 04:12:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:12:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:38.058708+00:00 (in 15.999194 seconds)
namespacegcworker stdout | 2024-04-22 04:12:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:13:22 UTC)" (scheduled at 2024-04-22 04:12:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:12:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:12:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:13:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:12:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:12:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:33.759375+00:00 (in 9.999451 seconds)
notificationworker stdout | 2024-04-22 04:12:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:12:33 UTC)" (scheduled at 2024-04-22 04:12:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:12:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:12:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 23, 760231), True, datetime.datetime(2024, 4, 22, 4, 12, 23, 760231), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:23,770 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 12, 53, 760231), 1, '9811226e-43ad-417c-b330-82bbc9e5a265', 14, '6aadf64e-6baf-4709-bb35-9ba3d454ae11'])
notificationworker stdout | 2024-04-22 04:12:23,774 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "821e891b-da3f-4153-b053-c6689eea2a99", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "71141", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2022-37434", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:23,774 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:23,775 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['821e891b-da3f-4153-b053-c6689eea2a99', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:23,784 [78] [DEBUG] [peewee] ('UPDATE "repositorynotification" SET "number_of_failures" = ("repositorynotification"."number_of_failures" + %s) WHERE ("repositorynotification"."uuid" = %s)', [1, '821e891b-da3f-4153-b053-c6689eea2a99'])
notificationworker stdout | 2024-04-22 04:12:23,788 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:23,788 [78] [ERROR] [workers.worker] Operation raised exception
notificationworker stdout | Traceback (most recent call last):
notificationworker stdout |   File "/quay-registry/workers/worker.py", line 86, in _operation_func
notificationworker stdout |     return operation_func()
notificationworker stdout |   File "/quay-registry/workers/queueworker.py", line 134, in poll_queue
notificationworker stdout |     self.process_queue_item(job_details)
notificationworker stdout |   File "/quay-registry/workers/notificationworker/notificationworker.py", line 45, in process_queue_item
notificationworker stdout |     raise exc
notificationworker stdout |   File "/quay-registry/workers/notificationworker/notificationworker.py", line 41, in process_queue_item
notificationworker stdout |     method_handler.perform(notification, event_handler, job_details)
notificationworker stdout |   File "/quay-registry/notifications/notificationmethod.py", line 179, in perform
notificationworker stdout |     event_handler.get_summary(notification_data["event_data"], notification_data),
notificationworker stdout |   File "/quay-registry/notifications/notificationevent.py", line 250, in get_summary
notificationworker stdout |     len(event_data["tags"]),
notificationworker stdout | KeyError: 'tags'
notificationworker stdout | 2024-04-22 04:12:23,789 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:12:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:12:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:12:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:13:24.361582+00:00 (in 59.999467 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:12:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:13:24 UTC)" (scheduled at 2024-04-22 04:12:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:12:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:12:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:12:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:13:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:12:25,550 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:12:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:12:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:35.871852+00:00 (in 8.998231 seconds)
securityworker stdout | 2024-04-22 04:12:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:12:56 UTC)" (scheduled at 2024-04-22 04:12:26.873109+00:00)
securityworker stdout | 2024-04-22 04:12:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:12:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:12:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:12:26,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:12:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:12:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:12:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:12:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:12:26,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:12:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:12:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:12:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:12:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 7, 26, 880729), 1, 2])
securityworker stdout | 2024-04-22 04:12:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:12:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:12:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 7, 26, 880729), 1, 2])
securityworker stdout | 2024-04-22 04:12:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:12:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:12:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:12:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:12:26,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:12:26,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:12:26,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:12:26,901 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:12:26,901 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:12:26,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:12:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:12:27,323 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
gunicorn-web stdout | 2024-04-22 04:12:27,904 [278] [DEBUG] [app] Starting request: urn:request:0afc9971-6424-4eb2-9a71-4d12d8fb421e (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:12:27,905 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:12:27,905 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:12:27,905 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:12:27,914 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:12:27,914 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:12:27,914 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:12:27,915 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:12:27,915 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:12:27,915 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:12:27,915 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:12:27,915 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:12:27,917 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:12:27,923 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:12:27,924 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:12:27,929 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:12:27,933 [278] [DEBUG] [app] Ending request: urn:request:0afc9971-6424-4eb2-9a71-4d12d8fb421e (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:0afc9971-6424-4eb2-9a71-4d12d8fb421e', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:12:27,933 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:12:27,934 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:12:27 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:12:27 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1555 0.031)
quotatotalworker stdout | 2024-04-22 04:12:28,527 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:12:28,593 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:12:30,228 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:12:30,230 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:12:30,237 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:12:30,254 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:12:30,256 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:12:30,561 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 04:12:30,653 [282] [DEBUG] [app] Starting request: urn:request:39d3ad85-931b-4a5d-ba14-dbaa8427477e (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:12:30,653 [278] [DEBUG] [app] Starting request: urn:request:6da0b71e-728d-4db7-ada3-2821d2e8784c (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:12:30,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:12:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:12:30,656 [284] [DEBUG] [app] Starting request: urn:request:1df1b443-99bc-479f-a074-c53913d35336 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:12:30,656 [285] [DEBUG] [app] Starting request: urn:request:5010e0e0-6a7a-4783-933f-1cbf508beec9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:12:30,656 [284] [DEBUG] [app] Ending request: urn:request:1df1b443-99bc-479f-a074-c53913d35336 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:1df1b443-99bc-479f-a074-c53913d35336', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:12:30,657 [285] [DEBUG] [app] Ending request: urn:request:5010e0e0-6a7a-4783-933f-1cbf508beec9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5010e0e0-6a7a-4783-933f-1cbf508beec9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:12:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:12:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:12:30,657 [285] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:12:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:12:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:12:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:12:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:12:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:12:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:12:30,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:12:30,659 [282] [DEBUG] [app] Starting request: urn:request:82c69afb-5071-4ed9-9f5b-1c8a32c60413 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:12:30,659 [278] [DEBUG] [app] Starting request: urn:request:1fd747d0-4be2-4492-b6a0-2a87697d001d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:12:30,660 [282] [DEBUG] [app] Ending request: urn:request:82c69afb-5071-4ed9-9f5b-1c8a32c60413 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:82c69afb-5071-4ed9-9f5b-1c8a32c60413', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:12:30,660 [278] [DEBUG] [app] Ending request: urn:request:1fd747d0-4be2-4492-b6a0-2a87697d001d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1fd747d0-4be2-4492-b6a0-2a87697d001d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:12:30,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:12:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:12:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:12:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:12:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:12:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:12:30,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:12:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:12:30,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:12:30,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:12:30,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:12:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:12:30,674 [282] [DEBUG] [app] Ending request: urn:request:39d3ad85-931b-4a5d-ba14-dbaa8427477e (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:39d3ad85-931b-4a5d-ba14-dbaa8427477e', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:12:30,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:12:30,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:12:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:12:30,674 [278] [DEBUG] [app] Ending request: urn:request:6da0b71e-728d-4db7-ada3-2821d2e8784c (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:6da0b71e-728d-4db7-ada3-2821d2e8784c', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:12:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:12:30,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:12:30,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:12:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:12:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
chunkcleanupworker stdout | 2024-04-22 04:12:30,688 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotatotalworker stdout | 2024-04-22 04:12:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:12:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:46.054492+00:00 (in 14.999436 seconds)
quotatotalworker stdout | 2024-04-22 04:12:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:12:46 UTC)" (scheduled at 2024-04-22 04:12:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:12:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:12:31,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:12:31,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:12:46 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:12:31,537 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:12:33,051 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:12:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:12:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:43.759375+00:00 (in 9.999453 seconds)
notificationworker stdout | 2024-04-22 04:12:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:12:43 UTC)" (scheduled at 2024-04-22 04:12:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:12:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:12:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 33, 760341), True, datetime.datetime(2024, 4, 22, 4, 12, 33, 760341), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:33,771 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 3, 760341), 1, '28c62bf8-d46a-4573-80d7-0c7e44b0b3d9', 9, '9e7ec55c-861a-4443-b2d2-004728b5fddf'])
notificationworker stdout | 2024-04-22 04:12:33,781 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "f1b7c257-8b4f-4497-9b0d-ec5a64ad3ebc", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "64181", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2022-30065", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:33,781 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:33,782 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['f1b7c257-8b4f-4497-9b0d-ec5a64ad3ebc', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:33,793 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description" FROM "team" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") WHERE ((("t1"."name" = %s) AND ("t2"."organization" = %s)) AND ("t2"."username" = %s)) LIMIT %s', ['owners', True, 'build_test', 1])
notificationworker stdout | 2024-04-22 04:12:33,795 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" INNER JOIN "teammember" AS "t2" ON ("t2"."user_id" = "t1"."id") INNER JOIN "team" AS "t3" ON ("t2"."team_id" = "t3"."id") WHERE ("t3"."id" = %s)', [1])
notificationworker stdout | 2024-04-22 04:12:33,798 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['vulnerability_found', 1, 0])
notificationworker stdout | 2024-04-22 04:12:33,800 [78] [DEBUG] [peewee] ('INSERT INTO "notification" ("uuid", "kind_id", "target_id", "metadata_json", "created", "dismissed", "lookup_path") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "notification"."id"', ['aa0bb5fc-c91d-4e44-a400-df94410d25f5', 12, 1, '{"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "64181", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2022-30065", "priority": "", "has_fix": true}}', datetime.datetime(2024, 4, 22, 4, 12, 33, 800443), False, None])
notificationworker stdout | 2024-04-22 04:12:33,805 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures" FROM "repositorynotification" AS "t1" WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['f1b7c257-8b4f-4497-9b0d-ec5a64ad3ebc', 1, 0])
notificationworker stdout | 2024-04-22 04:12:33,807 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
notificationworker stdout | 2024-04-22 04:12:33,809 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
notificationworker stdout | 2024-04-22 04:12:33,811 [78] [DEBUG] [peewee] ('UPDATE "repositorynotification" SET "number_of_failures" = %s WHERE ("repositorynotification"."id" = %s)', [0, 5])
notificationworker stdout | 2024-04-22 04:12:33,815 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [9])
notificationworker stdout | 2024-04-22 04:12:33,819 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 33, 818602), True, datetime.datetime(2024, 4, 22, 4, 12, 33, 818602), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:33,821 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 3, 818602), 1, '9fe3ec85-6d76-488e-982d-e37fd275b06e', 50, '79e026ee-4431-4f26-98d4-9e0efe244797'])
notificationworker stdout | 2024-04-22 04:12:33,825 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "821e891b-da3f-4153-b053-c6689eea2a99", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68495", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2023-2650", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:33,825 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:33,826 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['821e891b-da3f-4153-b053-c6689eea2a99', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:33,836 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [50])
notificationworker stdout | 2024-04-22 04:12:33,841 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 33, 840469), True, datetime.datetime(2024, 4, 22, 4, 12, 33, 840469), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:33,843 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 3, 840469), 1, '5608cafe-eceb-4087-aa4e-bbd6a117f176', 26, 'dda7a0f0-0fda-41e2-bb04-497ba68b8d29'])
notificationworker stdout | 2024-04-22 04:12:33,849 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "821e891b-da3f-4153-b053-c6689eea2a99", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68523", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2022-2097", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:33,849 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:33,850 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['821e891b-da3f-4153-b053-c6689eea2a99', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:33,860 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [26])
notificationworker stdout | 2024-04-22 04:12:33,864 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 33, 863864), True, datetime.datetime(2024, 4, 22, 4, 12, 33, 863864), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:33,867 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 3, 863864), 1, '5bfeab3f-af03-497f-b57a-f4a19ad3e057', 48, '6743155f-9143-466d-8f4e-15371887d284'])
notificationworker stdout | 2024-04-22 04:12:33,870 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "27d600e3-69ac-4c25-9b0d-4999e865fe2c", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68450", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2023-3817", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:33,870 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:33,871 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['27d600e3-69ac-4c25-9b0d-4999e865fe2c', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:33,881 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['build_test', False, 1, 0])
notificationworker stdout | 2024-04-22 04:12:33,884 [78] [DEBUG] [peewee] ('UPDATE "repositorynotification" SET "number_of_failures" = ("repositorynotification"."number_of_failures" + %s) WHERE ("repositorynotification"."uuid" = %s)', [1, '27d600e3-69ac-4c25-9b0d-4999e865fe2c'])
notificationworker stdout | 2024-04-22 04:12:33,887 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:33,887 [78] [ERROR] [workers.worker] Operation raised exception
notificationworker stdout | Traceback (most recent call last):
notificationworker stdout |   File "/quay-registry/workers/worker.py", line 86, in _operation_func
notificationworker stdout |     return operation_func()
notificationworker stdout |   File "/quay-registry/workers/queueworker.py", line 134, in poll_queue
notificationworker stdout |     self.process_queue_item(job_details)
notificationworker stdout |   File "/quay-registry/workers/notificationworker/notificationworker.py", line 45, in process_queue_item
notificationworker stdout |     raise exc
notificationworker stdout |   File "/quay-registry/workers/notificationworker/notificationworker.py", line 41, in process_queue_item
notificationworker stdout |     method_handler.perform(notification, event_handler, job_details)
notificationworker stdout |   File "/quay-registry/notifications/notificationmethod.py", line 491, in perform
notificationworker stdout |     summary = event_handler.get_summary(notification_data["event_data"], notification_data)
notificationworker stdout |   File "/quay-registry/notifications/notificationevent.py", line 250, in get_summary
notificationworker stdout |     len(event_data["tags"]),
notificationworker stdout | KeyError: 'tags'
notificationworker stdout | 2024-04-22 04:12:33,887 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:12:43 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:12:34,458 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:12:34,735 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
gunicorn-secscan stdout | 2024-04-22 04:12:34,806 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:12:34,809 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:12:34,811 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
exportactionlogsworker stdout | 2024-04-22 04:12:34,924 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:12:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:12:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:56.873109+00:00 (in 21.000710 seconds)
securityworker stdout | 2024-04-22 04:12:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:13:05 UTC)" (scheduled at 2024-04-22 04:12:35.871852+00:00)
securityworker stdout | 2024-04-22 04:12:35,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:12:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:12:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:12:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:12:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:12:35,888 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:12:35,890 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:12:35,890 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:12:35,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 7, 35, 876312), 1, 2])
securityworker stdout | 2024-04-22 04:12:35,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:12:35,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:12:35,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 7, 35, 876312), 1, 2])
securityworker stdout | 2024-04-22 04:12:35,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:12:35,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:12:35,896 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:12:35,896 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:13:05 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:12:36,000 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:12:37,204 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:12:37,264 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:12:37,393 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
namespacegcworker stdout | 2024-04-22 04:12:38,058 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:12:38,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:43.057186+00:00 (in 4.997949 seconds)
namespacegcworker stdout | 2024-04-22 04:12:38,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:17:38 UTC)" (scheduled at 2024-04-22 04:12:38.058708+00:00)
namespacegcworker stdout | 2024-04-22 04:12:38,060 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 12, 38, 59485), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 04:12:38,071 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 12, 38, 59485), True, datetime.datetime(2024, 4, 22, 4, 12, 38, 59485), 0, 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 04:12:38,073 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 12, 38, 59485), True, datetime.datetime(2024, 4, 22, 4, 12, 38, 59485), 0, 'namespacegc/%', False, datetime.datetime(2024, 4, 22, 4, 12, 38, 59485), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 04:12:38,076 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:12:38,076 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:17:38 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 04:12:38,345 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
exportactionlogsworker stdout | 2024-04-22 04:12:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:12:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:41.564959+00:00 (in 1.997413 seconds)
exportactionlogsworker stdout | 2024-04-22 04:12:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:13:39 UTC)" (scheduled at 2024-04-22 04:12:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:12:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:12:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:13:39 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:12:39,707 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:12:39,748 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 04:12:40,110 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:12:40,112 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
gunicorn-registry stdout | 2024-04-22 04:12:41,134 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:12:41,139 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:12:41,141 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:12:41,144 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:12:41,147 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:12:41,151 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:12:41,158 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:12:41,161 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:12:41,165 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
autopruneworker stdout | 2024-04-22 04:12:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:12:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:13:11.264267+00:00 (in 29.999502 seconds)
autopruneworker stdout | 2024-04-22 04:12:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:13:11 UTC)" (scheduled at 2024-04-22 04:12:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:12:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759101271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:12:41,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:12:41,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:12:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:13:11 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:12:41,467 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
exportactionlogsworker stdout | 2024-04-22 04:12:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:12:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:13:39.566970+00:00 (in 58.001469 seconds)
exportactionlogsworker stdout | 2024-04-22 04:12:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:13:41 UTC)" (scheduled at 2024-04-22 04:12:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:12:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:12:41,567 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 41, 565775), True, datetime.datetime(2024, 4, 22, 4, 12, 41, 565775), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:12:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:12:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:12:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:13:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:12:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:12:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:13:22.058978+00:00 (in 39.001331 seconds)
namespacegcworker stdout | 2024-04-22 04:12:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:13:43 UTC)" (scheduled at 2024-04-22 04:12:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:12:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:12:43,059 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 43, 58128), True, datetime.datetime(2024, 4, 22, 4, 12, 43, 58128), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:12:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:12:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:12:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:13:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:12:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:12:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:12:53.759375+00:00 (in 9.999474 seconds)
notificationworker stdout | 2024-04-22 04:12:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:12:53 UTC)" (scheduled at 2024-04-22 04:12:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:12:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:12:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 43, 760200), True, datetime.datetime(2024, 4, 22, 4, 12, 43, 760200), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:43,783 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 13, 760200), 1, 'cfa5cdfe-8edd-4f0f-87ce-899e7add87a7', 28, 'b8974dac-89a9-42c6-b673-783954b5eb5b'])
notificationworker stdout | 2024-04-22 04:12:43,787 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "27d600e3-69ac-4c25-9b0d-4999e865fe2c", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68523", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2022-2097", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:43,787 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:43,788 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['27d600e3-69ac-4c25-9b0d-4999e865fe2c', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:43,797 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [28])
notificationworker stdout | 2024-04-22 04:12:43,801 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 43, 801366), True, datetime.datetime(2024, 4, 22, 4, 12, 43, 801366), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:43,804 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 13, 801366), 1, '599d0aff-2f0f-43bd-bc5c-bc8a77c3b438', 21, '332bdd8a-5f1f-4966-8704-ee571eb7babd'])
notificationworker stdout | 2024-04-22 04:12:43,808 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "f1b7c257-8b4f-4497-9b0d-ec5a64ad3ebc", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68526", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2023-0465", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:43,808 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:43,809 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['f1b7c257-8b4f-4497-9b0d-ec5a64ad3ebc', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:43,818 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description" FROM "team" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") WHERE ((("t1"."name" = %s) AND ("t2"."organization" = %s)) AND ("t2"."username" = %s)) LIMIT %s', ['owners', True, 'build_test', 1])
notificationworker stdout | 2024-04-22 04:12:43,821 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" INNER JOIN "teammember" AS "t2" ON ("t2"."user_id" = "t1"."id") INNER JOIN "team" AS "t3" ON ("t2"."team_id" = "t3"."id") WHERE ("t3"."id" = %s)', [1])
notificationworker stdout | 2024-04-22 04:12:43,824 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['vulnerability_found', 1, 0])
notificationworker stdout | 2024-04-22 04:12:43,826 [78] [DEBUG] [peewee] ('INSERT INTO "notification" ("uuid", "kind_id", "target_id", "metadata_json", "created", "dismissed", "lookup_path") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "notification"."id"', ['dca3f36b-0220-4de0-a30f-09f07183a2c5', 12, 1, '{"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68526", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2023-0465", "priority": "", "has_fix": true}}', datetime.datetime(2024, 4, 22, 4, 12, 43, 825925), False, None])
notificationworker stdout | 2024-04-22 04:12:43,830 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures" FROM "repositorynotification" AS "t1" WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['f1b7c257-8b4f-4497-9b0d-ec5a64ad3ebc', 1, 0])
notificationworker stdout | 2024-04-22 04:12:43,832 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
notificationworker stdout | 2024-04-22 04:12:43,834 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
notificationworker stdout | 2024-04-22 04:12:43,836 [78] [DEBUG] [peewee] ('UPDATE "repositorynotification" SET "number_of_failures" = %s WHERE ("repositorynotification"."id" = %s)', [0, 5])
notificationworker stdout | 2024-04-22 04:12:43,840 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [21])
notificationworker stdout | 2024-04-22 04:12:43,844 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 43, 844251), True, datetime.datetime(2024, 4, 22, 4, 12, 43, 844251), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:43,847 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 13, 844251), 1, '106c8603-0ecb-4642-8d08-68236226397a', 30, 'bd5a6145-491a-46ca-9fd2-9d0ebd113c84'])
notificationworker stdout | 2024-04-22 04:12:43,851 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "821e891b-da3f-4153-b053-c6689eea2a99", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68520", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2023-5678", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:43,851 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:43,852 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['821e891b-da3f-4153-b053-c6689eea2a99', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:43,862 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [30])
notificationworker stdout | 2024-04-22 04:12:43,866 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 43, 865691), True, datetime.datetime(2024, 4, 22, 4, 12, 43, 865691), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:43,868 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 13, 865691), 1, '4007ebdd-14c6-4e15-b436-c4fa3d310870', 44, 'bb4da2d1-73a0-463d-a736-56b8a4d218a2'])
notificationworker stdout | 2024-04-22 04:12:43,885 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "27d600e3-69ac-4c25-9b0d-4999e865fe2c", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68467", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2022-4304", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:43,885 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:43,886 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['27d600e3-69ac-4c25-9b0d-4999e865fe2c', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:43,896 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [44])
notificationworker stdout | 2024-04-22 04:12:43,901 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 43, 900703), True, datetime.datetime(2024, 4, 22, 4, 12, 43, 900703), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:43,903 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 13, 900703), 1, '7e415ab4-b7fc-4586-bfa5-38c5eec7ba39', 47, '3f93229b-d518-485b-b52a-504f377b2333'])
notificationworker stdout | 2024-04-22 04:12:43,908 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "55d1704d-84c4-48e0-a0be-df13625280c4", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68450", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2023-3817", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:43,908 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:43,909 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['55d1704d-84c4-48e0-a0be-df13625280c4', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:43,920 [78] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): webhook.site:443
notificationworker stdout | 2024-04-22 04:12:44,349 [78] [DEBUG] [urllib3.connectionpool] https://webhook.site:443 "POST /ffd85e96-d5d9-4a80-a40b-342ae3308119 HTTP/1.1" 200 None
notificationworker stdout | 2024-04-22 04:12:44,351 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures" FROM "repositorynotification" AS "t1" WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['55d1704d-84c4-48e0-a0be-df13625280c4', 1, 0])
notificationworker stdout | 2024-04-22 04:12:44,354 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
notificationworker stdout | 2024-04-22 04:12:44,357 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
notificationworker stdout | 2024-04-22 04:12:44,359 [78] [DEBUG] [peewee] ('UPDATE "repositorynotification" SET "number_of_failures" = %s WHERE ("repositorynotification"."id" = %s)', [0, 7])
notificationworker stdout | 2024-04-22 04:12:44,364 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [47])
notificationworker stdout | 2024-04-22 04:12:44,369 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 44, 367882), True, datetime.datetime(2024, 4, 22, 4, 12, 44, 367882), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:44,372 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 14, 367882), 1, 'f9fea062-1a46-4edf-8f14-eed75e8bac12', 54, 'af5cd2fa-8e3a-4af1-8359-c7da2c646413'])
notificationworker stdout | 2024-04-22 04:12:44,375 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "821e891b-da3f-4153-b053-c6689eea2a99", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68476", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2023-0286", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:44,375 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:44,376 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['821e891b-da3f-4153-b053-c6689eea2a99', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:44,386 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [54])
notificationworker stdout | 2024-04-22 04:12:44,390 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 44, 389986), True, datetime.datetime(2024, 4, 22, 4, 12, 44, 389986), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:44,393 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 14, 389986), 1, '28826857-36f8-4767-bf2c-03eb45edaed8', 33, '46fd7093-ba25-4249-b82e-61bbde6222d6'])
notificationworker stdout | 2024-04-22 04:12:44,397 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "f1b7c257-8b4f-4497-9b0d-ec5a64ad3ebc", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68473", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2023-0215", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:44,397 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:44,398 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['f1b7c257-8b4f-4497-9b0d-ec5a64ad3ebc', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:44,407 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description" FROM "team" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") WHERE ((("t1"."name" = %s) AND ("t2"."organization" = %s)) AND ("t2"."username" = %s)) LIMIT %s', ['owners', True, 'build_test', 1])
notificationworker stdout | 2024-04-22 04:12:44,410 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" INNER JOIN "teammember" AS "t2" ON ("t2"."user_id" = "t1"."id") INNER JOIN "team" AS "t3" ON ("t2"."team_id" = "t3"."id") WHERE ("t3"."id" = %s)', [1])
notificationworker stdout | 2024-04-22 04:12:44,412 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['vulnerability_found', 1, 0])
notificationworker stdout | 2024-04-22 04:12:44,414 [78] [DEBUG] [peewee] ('INSERT INTO "notification" ("uuid", "kind_id", "target_id", "metadata_json", "created", "dismissed", "lookup_path") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "notification"."id"', ['68c3f40b-0fc5-4dfe-8d18-065c7a600aae', 12, 1, '{"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68473", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2023-0215", "priority": "", "has_fix": true}}', datetime.datetime(2024, 4, 22, 4, 12, 44, 414711), False, None])
notificationworker stdout | 2024-04-22 04:12:44,419 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures" FROM "repositorynotification" AS "t1" WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['f1b7c257-8b4f-4497-9b0d-ec5a64ad3ebc', 1, 0])
notificationworker stdout | 2024-04-22 04:12:44,421 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
notificationworker stdout | 2024-04-22 04:12:44,423 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
notificationworker stdout | 2024-04-22 04:12:44,425 [78] [DEBUG] [peewee] ('UPDATE "repositorynotification" SET "number_of_failures" = %s WHERE ("repositorynotification"."id" = %s)', [0, 5])
notificationworker stdout | 2024-04-22 04:12:44,428 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [33])
notificationworker stdout | 2024-04-22 04:12:44,433 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 44, 432507), True, datetime.datetime(2024, 4, 22, 4, 12, 44, 432507), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:44,435 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 14, 432507), 1, '580402d9-ab10-4290-9cc3-5552398cba0a', 18, '12eb8cb2-bebc-4752-be63-59658601be76'])
notificationworker stdout | 2024-04-22 04:12:44,439 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "821e891b-da3f-4153-b053-c6689eea2a99", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68448", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2023-0464", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:44,439 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:44,440 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['821e891b-da3f-4153-b053-c6689eea2a99', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:44,450 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [18])
notificationworker stdout | 2024-04-22 04:12:44,463 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 44, 463123), True, datetime.datetime(2024, 4, 22, 4, 12, 44, 463123), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:44,466 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 14, 463123), 1, 'e560e2c9-0a83-4aaf-a848-ade1ca70949d', 12, '8b83456c-b9d3-4f60-a0ca-dff87af5a907'])
notificationworker stdout | 2024-04-22 04:12:44,470 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "27d600e3-69ac-4c25-9b0d-4999e865fe2c", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "64181", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2022-30065", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:44,470 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:44,471 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['27d600e3-69ac-4c25-9b0d-4999e865fe2c', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:44,481 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [12])
notificationworker stdout | 2024-04-22 04:12:44,485 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 44, 485230), True, datetime.datetime(2024, 4, 22, 4, 12, 44, 485230), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:44,488 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 14, 485230), 1, 'ba9fdc6b-6f7c-421c-8763-ddca3a894183', 36, '79b1e1df-3e59-4d5e-94ef-4e113137f0b0'])
notificationworker stdout | 2024-04-22 04:12:44,492 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "27d600e3-69ac-4c25-9b0d-4999e865fe2c", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68473", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2023-0215", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:44,492 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:44,493 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['27d600e3-69ac-4c25-9b0d-4999e865fe2c', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:44,503 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [36])
notificationworker stdout | 2024-04-22 04:12:44,507 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 44, 506851), True, datetime.datetime(2024, 4, 22, 4, 12, 44, 506851), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:44,510 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 14, 506851), 1, '06316a92-02a2-4590-b4c8-e67bb1edd4b5', 16, 'cfbf6802-47bf-43d7-aa67-82e80fd899c3'])
notificationworker stdout | 2024-04-22 04:12:44,514 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "27d600e3-69ac-4c25-9b0d-4999e865fe2c", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "71141", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2022-37434", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:44,514 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:44,515 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['27d600e3-69ac-4c25-9b0d-4999e865fe2c', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:44,525 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [16])
notificationworker stdout | 2024-04-22 04:12:44,529 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 44, 529133), True, datetime.datetime(2024, 4, 22, 4, 12, 44, 529133), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:44,532 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 14, 529133), 1, 'a80facee-5c5c-44d3-897c-80b98ff6e6bc', 19, '3d832c4b-4e46-4df0-9b6e-c33d0a5355b9'])
notificationworker stdout | 2024-04-22 04:12:44,535 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "55d1704d-84c4-48e0-a0be-df13625280c4", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68448", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2023-0464", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:44,535 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:44,537 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['55d1704d-84c4-48e0-a0be-df13625280c4', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:44,547 [78] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): webhook.site:443
gcworker stdout | 2024-04-22 04:12:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:12:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:13:14.952062+00:00 (in 29.999527 seconds)
gcworker stdout | 2024-04-22 04:12:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:13:14 UTC)" (scheduled at 2024-04-22 04:12:44.952062+00:00)
gcworker stdout | 2024-04-22 04:12:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549564952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:12:44,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:12:44,964 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:12:44,964 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:13:14 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:12:44,988 [78] [DEBUG] [urllib3.connectionpool] https://webhook.site:443 "POST /ffd85e96-d5d9-4a80-a40b-342ae3308119 HTTP/1.1" 200 None
notificationworker stdout | 2024-04-22 04:12:44,989 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures" FROM "repositorynotification" AS "t1" WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['55d1704d-84c4-48e0-a0be-df13625280c4', 1, 0])
notificationworker stdout | 2024-04-22 04:12:44,992 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
notificationworker stdout | 2024-04-22 04:12:44,994 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
notificationworker stdout | 2024-04-22 04:12:44,996 [78] [DEBUG] [peewee] ('UPDATE "repositorynotification" SET "number_of_failures" = %s WHERE ("repositorynotification"."id" = %s)', [0, 7])
notificationworker stdout | 2024-04-22 04:12:45,002 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [19])
notificationworker stdout | 2024-04-22 04:12:45,007 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 45, 6675), True, datetime.datetime(2024, 4, 22, 4, 12, 45, 6675), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:45,010 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 15, 6675), 1, '5aedf8e9-baed-4c5e-bf9c-6badcb9c086a', 49, 'fc0b324b-e199-4d14-804c-2888dd1be7a5'])
notificationworker stdout | 2024-04-22 04:12:45,013 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "f1b7c257-8b4f-4497-9b0d-ec5a64ad3ebc", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68495", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2023-2650", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:45,014 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:45,015 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['f1b7c257-8b4f-4497-9b0d-ec5a64ad3ebc', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:45,025 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description" FROM "team" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") WHERE ((("t1"."name" = %s) AND ("t2"."organization" = %s)) AND ("t2"."username" = %s)) LIMIT %s', ['owners', True, 'build_test', 1])
notificationworker stdout | 2024-04-22 04:12:45,028 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" INNER JOIN "teammember" AS "t2" ON ("t2"."user_id" = "t1"."id") INNER JOIN "team" AS "t3" ON ("t2"."team_id" = "t3"."id") WHERE ("t3"."id" = %s)', [1])
notificationworker stdout | 2024-04-22 04:12:45,030 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['vulnerability_found', 1, 0])
notificationworker stdout | 2024-04-22 04:12:45,032 [78] [DEBUG] [peewee] ('INSERT INTO "notification" ("uuid", "kind_id", "target_id", "metadata_json", "created", "dismissed", "lookup_path") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "notification"."id"', ['13f2ba0b-9766-4e80-be02-36e0d0f26db4', 12, 1, '{"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68495", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2023-2650", "priority": "", "has_fix": true}}', datetime.datetime(2024, 4, 22, 4, 12, 45, 32480), False, None])
notificationworker stdout | 2024-04-22 04:12:45,037 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures" FROM "repositorynotification" AS "t1" WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['f1b7c257-8b4f-4497-9b0d-ec5a64ad3ebc', 1, 0])
notificationworker stdout | 2024-04-22 04:12:45,039 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
notificationworker stdout | 2024-04-22 04:12:45,041 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
notificationworker stdout | 2024-04-22 04:12:45,043 [78] [DEBUG] [peewee] ('UPDATE "repositorynotification" SET "number_of_failures" = %s WHERE ("repositorynotification"."id" = %s)', [0, 5])
notificationworker stdout | 2024-04-22 04:12:45,047 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [49])
notificationworker stdout | 2024-04-22 04:12:45,051 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 45, 50627), True, datetime.datetime(2024, 4, 22, 4, 12, 45, 50627), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:45,053 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 15, 50627), 1, '7e98bfac-524f-49b5-84cf-d6d2ff94e3e7', 46, '68e9d205-cb30-4a88-8623-6af1ade7ab6d'])
notificationworker stdout | 2024-04-22 04:12:45,057 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "821e891b-da3f-4153-b053-c6689eea2a99", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68450", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2023-3817", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:45,057 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:45,058 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['821e891b-da3f-4153-b053-c6689eea2a99', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:45,068 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [46])
notificationworker stdout | 2024-04-22 04:12:45,072 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 45, 71931), True, datetime.datetime(2024, 4, 22, 4, 12, 45, 71931), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:45,075 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 15, 71931), 1, 'ef737ed9-4d8f-4bac-b579-fd9956574901', 52, '98336699-3b29-4b8c-8e3e-8cfeaef88d9e'])
notificationworker stdout | 2024-04-22 04:12:45,078 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "27d600e3-69ac-4c25-9b0d-4999e865fe2c", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68495", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2023-2650", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:45,079 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:45,079 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['27d600e3-69ac-4c25-9b0d-4999e865fe2c', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:45,089 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [52])
notificationworker stdout | 2024-04-22 04:12:45,094 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 45, 93475), True, datetime.datetime(2024, 4, 22, 4, 12, 45, 93475), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:45,096 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 15, 93475), 1, '03f3ddd7-5fc6-458f-a202-ec0f90ffa7e8', 23, '05595694-8de4-4f7b-b742-bf137f47411d'])
notificationworker stdout | 2024-04-22 04:12:45,100 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "55d1704d-84c4-48e0-a0be-df13625280c4", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68526", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2023-0465", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:45,100 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:45,101 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['55d1704d-84c4-48e0-a0be-df13625280c4', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:45,111 [78] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): webhook.site:443
notificationworker stdout | 2024-04-22 04:12:45,558 [78] [DEBUG] [urllib3.connectionpool] https://webhook.site:443 "POST /ffd85e96-d5d9-4a80-a40b-342ae3308119 HTTP/1.1" 200 None
notificationworker stdout | 2024-04-22 04:12:45,559 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures" FROM "repositorynotification" AS "t1" WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['55d1704d-84c4-48e0-a0be-df13625280c4', 1, 0])
notificationworker stdout | 2024-04-22 04:12:45,562 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
notificationworker stdout | 2024-04-22 04:12:45,565 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
notificationworker stdout | 2024-04-22 04:12:45,567 [78] [DEBUG] [peewee] ('UPDATE "repositorynotification" SET "number_of_failures" = %s WHERE ("repositorynotification"."id" = %s)', [0, 7])
notificationworker stdout | 2024-04-22 04:12:45,571 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [23])
notificationworker stdout | 2024-04-22 04:12:45,575 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 45, 574769), True, datetime.datetime(2024, 4, 22, 4, 12, 45, 574769), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:45,578 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 15, 574769), 1, '32462042-0647-4735-b411-9b457ab5315b', 10, '4d88e942-2d61-4152-91b9-6c74559bd777'])
notificationworker stdout | 2024-04-22 04:12:45,582 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "821e891b-da3f-4153-b053-c6689eea2a99", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "64181", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2022-30065", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:45,582 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:45,583 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['821e891b-da3f-4153-b053-c6689eea2a99', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:45,593 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [10])
notificationworker stdout | 2024-04-22 04:12:45,602 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 45, 601767), True, datetime.datetime(2024, 4, 22, 4, 12, 45, 601767), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:45,604 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 15, 601767), 1, 'e8ab15ec-ae46-4f29-beeb-8568b3c9ef95', 27, '1a1affb0-5f5d-4bde-9640-a35fa2240b6e'])
notificationworker stdout | 2024-04-22 04:12:45,608 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "55d1704d-84c4-48e0-a0be-df13625280c4", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68523", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2022-2097", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:45,608 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:45,609 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['55d1704d-84c4-48e0-a0be-df13625280c4', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:45,620 [78] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): webhook.site:443
gunicorn-web stdout | 2024-04-22 04:12:45,653 [282] [DEBUG] [app] Starting request: urn:request:39164518-0390-49b5-96f7-26e27c3c42f3 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:12:45,653 [281] [DEBUG] [app] Starting request: urn:request:ff4d8d37-c2c0-4766-acdf-f9235731a999 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:12:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:12:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:12:45,656 [284] [DEBUG] [app] Starting request: urn:request:89b44776-bf19-4937-b72d-613505592db9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:12:45,656 [289] [DEBUG] [app] Starting request: urn:request:bbc68563-8fda-48a0-a0c9-fcb8ba60b56f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:12:45,656 [284] [DEBUG] [app] Ending request: urn:request:89b44776-bf19-4937-b72d-613505592db9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:89b44776-bf19-4937-b72d-613505592db9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:12:45,656 [289] [DEBUG] [app] Ending request: urn:request:bbc68563-8fda-48a0-a0c9-fcb8ba60b56f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:bbc68563-8fda-48a0-a0c9-fcb8ba60b56f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:12:45,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:12:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:12:45,656 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:12:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:12:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:12:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:12:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:12:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:12:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:12:45,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:12:45,659 [278] [DEBUG] [app] Starting request: urn:request:827dc70f-e365-406a-99a4-8abd2bf681c0 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:12:45,660 [278] [DEBUG] [app] Ending request: urn:request:827dc70f-e365-406a-99a4-8abd2bf681c0 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:827dc70f-e365-406a-99a4-8abd2bf681c0', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:12:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:12:45,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:12:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:12:45,660 [279] [DEBUG] [app] Starting request: urn:request:ca60e170-d3df-4e3b-a6ea-66f4d229c029 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:12:45,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:12:45,660 [279] [DEBUG] [app] Ending request: urn:request:ca60e170-d3df-4e3b-a6ea-66f4d229c029 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:ca60e170-d3df-4e3b-a6ea-66f4d229c029', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:12:45,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:12:45,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:12:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:12:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:12:45,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:12:45,662 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:12:45,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:12:45,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:12:45,674 [282] [DEBUG] [app] Ending request: urn:request:39164518-0390-49b5-96f7-26e27c3c42f3 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:39164518-0390-49b5-96f7-26e27c3c42f3', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:12:45,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:12:45,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:12:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:12:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:12:45,675 [281] [DEBUG] [app] Ending request: urn:request:ff4d8d37-c2c0-4766-acdf-f9235731a999 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:ff4d8d37-c2c0-4766-acdf-f9235731a999', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:12:45,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:12:45,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:12:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:12:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
notificationworker stdout | 2024-04-22 04:12:46,011 [78] [DEBUG] [urllib3.connectionpool] https://webhook.site:443 "POST /ffd85e96-d5d9-4a80-a40b-342ae3308119 HTTP/1.1" 200 None
notificationworker stdout | 2024-04-22 04:12:46,012 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures" FROM "repositorynotification" AS "t1" WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['55d1704d-84c4-48e0-a0be-df13625280c4', 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,015 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,017 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,020 [78] [DEBUG] [peewee] ('UPDATE "repositorynotification" SET "number_of_failures" = %s WHERE ("repositorynotification"."id" = %s)', [0, 7])
notificationworker stdout | 2024-04-22 04:12:46,024 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [27])
notificationworker stdout | 2024-04-22 04:12:46,028 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 46, 27685), True, datetime.datetime(2024, 4, 22, 4, 12, 46, 27685), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,031 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 16, 27685), 1, '573e87f9-9b43-4f88-aa8f-6f36b3e99281', 37, '697fc1b2-c9a2-4221-9533-a869a4693444'])
notificationworker stdout | 2024-04-22 04:12:46,035 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "f1b7c257-8b4f-4497-9b0d-ec5a64ad3ebc", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68470", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2022-4450", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:46,035 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:46,036 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['f1b7c257-8b4f-4497-9b0d-ec5a64ad3ebc', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,047 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description" FROM "team" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") WHERE ((("t1"."name" = %s) AND ("t2"."organization" = %s)) AND ("t2"."username" = %s)) LIMIT %s', ['owners', True, 'build_test', 1])
notificationworker stdout | 2024-04-22 04:12:46,050 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" INNER JOIN "teammember" AS "t2" ON ("t2"."user_id" = "t1"."id") INNER JOIN "team" AS "t3" ON ("t2"."team_id" = "t3"."id") WHERE ("t3"."id" = %s)', [1])
notificationworker stdout | 2024-04-22 04:12:46,052 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['vulnerability_found', 1, 0])
quotatotalworker stdout | 2024-04-22 04:12:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:12:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:13:01.054492+00:00 (in 14.999494 seconds)
notificationworker stdout | 2024-04-22 04:12:46,055 [78] [DEBUG] [peewee] ('INSERT INTO "notification" ("uuid", "kind_id", "target_id", "metadata_json", "created", "dismissed", "lookup_path") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "notification"."id"', ['0986eed1-1eca-42ee-8e23-6ba3ae4d60ad', 12, 1, '{"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68470", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2022-4450", "priority": "", "has_fix": true}}', datetime.datetime(2024, 4, 22, 4, 12, 46, 54910), False, None])
quotatotalworker stdout | 2024-04-22 04:12:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:13:01 UTC)" (scheduled at 2024-04-22 04:12:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:12:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
notificationworker stdout | 2024-04-22 04:12:46,059 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures" FROM "repositorynotification" AS "t1" WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['f1b7c257-8b4f-4497-9b0d-ec5a64ad3ebc', 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,062 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,064 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
quotatotalworker stdout | 2024-04-22 04:12:46,064 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:12:46,064 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:13:01 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:12:46,066 [78] [DEBUG] [peewee] ('UPDATE "repositorynotification" SET "number_of_failures" = %s WHERE ("repositorynotification"."id" = %s)', [0, 5])
notificationworker stdout | 2024-04-22 04:12:46,070 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [37])
notificationworker stdout | 2024-04-22 04:12:46,074 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 46, 74128), True, datetime.datetime(2024, 4, 22, 4, 12, 46, 74128), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,077 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 16, 74128), 1, 'b3468b24-d5e0-43ae-ab33-d6a0b44710de', 22, '2742810f-acd3-4ea8-92a7-438cb491dd7a'])
notificationworker stdout | 2024-04-22 04:12:46,081 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "821e891b-da3f-4153-b053-c6689eea2a99", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68526", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2023-0465", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:46,081 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:46,082 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['821e891b-da3f-4153-b053-c6689eea2a99', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,092 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [22])
notificationworker stdout | 2024-04-22 04:12:46,096 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 46, 95810), True, datetime.datetime(2024, 4, 22, 4, 12, 46, 95810), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,099 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 16, 95810), 1, 'a7db323c-e596-4ba6-bc69-cdb433deb4ed', 53, 'dce5c4f0-c75c-4b11-af6b-9c5f83b69dbd'])
notificationworker stdout | 2024-04-22 04:12:46,102 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "f1b7c257-8b4f-4497-9b0d-ec5a64ad3ebc", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68476", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2023-0286", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:46,103 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:46,104 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['f1b7c257-8b4f-4497-9b0d-ec5a64ad3ebc', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,114 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description" FROM "team" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") WHERE ((("t1"."name" = %s) AND ("t2"."organization" = %s)) AND ("t2"."username" = %s)) LIMIT %s', ['owners', True, 'build_test', 1])
notificationworker stdout | 2024-04-22 04:12:46,116 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" INNER JOIN "teammember" AS "t2" ON ("t2"."user_id" = "t1"."id") INNER JOIN "team" AS "t3" ON ("t2"."team_id" = "t3"."id") WHERE ("t3"."id" = %s)', [1])
notificationworker stdout | 2024-04-22 04:12:46,119 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['vulnerability_found', 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,121 [78] [DEBUG] [peewee] ('INSERT INTO "notification" ("uuid", "kind_id", "target_id", "metadata_json", "created", "dismissed", "lookup_path") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "notification"."id"', ['e4cf6d18-570a-4982-bf09-4e2c50127249', 12, 1, '{"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68476", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2023-0286", "priority": "", "has_fix": true}}', datetime.datetime(2024, 4, 22, 4, 12, 46, 121167), False, None])
notificationworker stdout | 2024-04-22 04:12:46,125 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures" FROM "repositorynotification" AS "t1" WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['f1b7c257-8b4f-4497-9b0d-ec5a64ad3ebc', 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,127 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,129 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,131 [78] [DEBUG] [peewee] ('UPDATE "repositorynotification" SET "number_of_failures" = %s WHERE ("repositorynotification"."id" = %s)', [0, 5])
notificationworker stdout | 2024-04-22 04:12:46,135 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [53])
notificationworker stdout | 2024-04-22 04:12:46,140 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 46, 139411), True, datetime.datetime(2024, 4, 22, 4, 12, 46, 139411), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,142 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 16, 139411), 1, '55e9406b-8ac8-4fb9-96d3-9a847dfb2f6c', 56, '9a0650a8-9c2d-4bfd-89d5-c116450c45a5'])
notificationworker stdout | 2024-04-22 04:12:46,146 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "27d600e3-69ac-4c25-9b0d-4999e865fe2c", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68476", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2023-0286", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:46,146 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:46,147 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['27d600e3-69ac-4c25-9b0d-4999e865fe2c', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,160 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [56])
notificationworker stdout | 2024-04-22 04:12:46,164 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 46, 163796), True, datetime.datetime(2024, 4, 22, 4, 12, 46, 163796), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,167 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 16, 163796), 1, '71467caf-dc2f-4edb-98f2-1ca754a9973b', 20, '4f57c86c-ae3e-468c-9f4b-79967b6abc16'])
notificationworker stdout | 2024-04-22 04:12:46,170 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "27d600e3-69ac-4c25-9b0d-4999e865fe2c", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68448", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2023-0464", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:46,170 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:46,172 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['27d600e3-69ac-4c25-9b0d-4999e865fe2c', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,181 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [20])
notificationworker stdout | 2024-04-22 04:12:46,186 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 46, 185681), True, datetime.datetime(2024, 4, 22, 4, 12, 46, 185681), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,189 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 16, 185681), 1, '485082e5-d31b-41c5-9305-4f9880c5198d', 17, 'ae6c54d3-db1b-4746-a8ab-be2cc60f0fb0'])
notificationworker stdout | 2024-04-22 04:12:46,192 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "f1b7c257-8b4f-4497-9b0d-ec5a64ad3ebc", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68448", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2023-0464", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:46,192 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:46,194 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['f1b7c257-8b4f-4497-9b0d-ec5a64ad3ebc', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,203 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description" FROM "team" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") WHERE ((("t1"."name" = %s) AND ("t2"."organization" = %s)) AND ("t2"."username" = %s)) LIMIT %s', ['owners', True, 'build_test', 1])
notificationworker stdout | 2024-04-22 04:12:46,206 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" INNER JOIN "teammember" AS "t2" ON ("t2"."user_id" = "t1"."id") INNER JOIN "team" AS "t3" ON ("t2"."team_id" = "t3"."id") WHERE ("t3"."id" = %s)', [1])
notificationworker stdout | 2024-04-22 04:12:46,209 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['vulnerability_found', 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,211 [78] [DEBUG] [peewee] ('INSERT INTO "notification" ("uuid", "kind_id", "target_id", "metadata_json", "created", "dismissed", "lookup_path") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "notification"."id"', ['f06c857f-3646-47b5-a72d-a0dd7104c8e8', 12, 1, '{"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68448", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2023-0464", "priority": "", "has_fix": true}}', datetime.datetime(2024, 4, 22, 4, 12, 46, 210969), False, None])
notificationworker stdout | 2024-04-22 04:12:46,216 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures" FROM "repositorynotification" AS "t1" WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['f1b7c257-8b4f-4497-9b0d-ec5a64ad3ebc', 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,219 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,221 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,223 [78] [DEBUG] [peewee] ('UPDATE "repositorynotification" SET "number_of_failures" = %s WHERE ("repositorynotification"."id" = %s)', [0, 5])
notificationworker stdout | 2024-04-22 04:12:46,228 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [17])
notificationworker stdout | 2024-04-22 04:12:46,233 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 46, 233030), True, datetime.datetime(2024, 4, 22, 4, 12, 46, 233030), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,236 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 16, 233030), 1, '84e1906f-d5ce-4213-b332-8f30b9b124ec', 40, '55d5027d-a013-40a4-9b4b-5d218212e87b'])
notificationworker stdout | 2024-04-22 04:12:46,240 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "27d600e3-69ac-4c25-9b0d-4999e865fe2c", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68470", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2022-4450", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:46,240 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:46,241 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['27d600e3-69ac-4c25-9b0d-4999e865fe2c', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,252 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [40])
notificationworker stdout | 2024-04-22 04:12:46,257 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 46, 256357), True, datetime.datetime(2024, 4, 22, 4, 12, 46, 256357), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,260 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 16, 256357), 1, '8c520eba-3048-4073-b126-04628c24c992', 13, '0a8eebfd-8f64-459c-a2c9-751aa0e7c066'])
notificationworker stdout | 2024-04-22 04:12:46,263 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "f1b7c257-8b4f-4497-9b0d-ec5a64ad3ebc", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "71141", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2022-37434", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:46,263 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:46,265 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['f1b7c257-8b4f-4497-9b0d-ec5a64ad3ebc', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,283 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description" FROM "team" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") WHERE ((("t1"."name" = %s) AND ("t2"."organization" = %s)) AND ("t2"."username" = %s)) LIMIT %s', ['owners', True, 'build_test', 1])
notificationworker stdout | 2024-04-22 04:12:46,286 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" INNER JOIN "teammember" AS "t2" ON ("t2"."user_id" = "t1"."id") INNER JOIN "team" AS "t3" ON ("t2"."team_id" = "t3"."id") WHERE ("t3"."id" = %s)', [1])
notificationworker stdout | 2024-04-22 04:12:46,289 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['vulnerability_found', 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,291 [78] [DEBUG] [peewee] ('INSERT INTO "notification" ("uuid", "kind_id", "target_id", "metadata_json", "created", "dismissed", "lookup_path") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "notification"."id"', ['2eb11cc7-ca69-4e22-a528-7035ebc969af', 12, 1, '{"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "71141", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2022-37434", "priority": "", "has_fix": true}}', datetime.datetime(2024, 4, 22, 4, 12, 46, 291056), False, None])
notificationworker stdout | 2024-04-22 04:12:46,296 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures" FROM "repositorynotification" AS "t1" WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['f1b7c257-8b4f-4497-9b0d-ec5a64ad3ebc', 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,298 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,300 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,302 [78] [DEBUG] [peewee] ('UPDATE "repositorynotification" SET "number_of_failures" = %s WHERE ("repositorynotification"."id" = %s)', [0, 5])
notificationworker stdout | 2024-04-22 04:12:46,308 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [13])
notificationworker stdout | 2024-04-22 04:12:46,315 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 46, 315124), True, datetime.datetime(2024, 4, 22, 4, 12, 46, 315124), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,318 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 16, 315124), 1, 'b8bb47e7-9ae7-4418-823b-61bc567a1bcf', 6, 'ec7a1972-4c97-426c-b4ba-88ad25827301'])
notificationworker stdout | 2024-04-22 04:12:46,324 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "821e891b-da3f-4153-b053-c6689eea2a99", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68517", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2023-3446", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:46,324 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:46,326 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['821e891b-da3f-4153-b053-c6689eea2a99', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,335 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [6])
notificationworker stdout | 2024-04-22 04:12:46,341 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 46, 340358), True, datetime.datetime(2024, 4, 22, 4, 12, 46, 340358), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,343 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 16, 340358), 1, 'ec040c05-db10-4170-82e3-63c5aff543db', 51, '59f4fa58-346a-49d7-9fc9-a4a020da2536'])
notificationworker stdout | 2024-04-22 04:12:46,348 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "55d1704d-84c4-48e0-a0be-df13625280c4", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68495", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2023-2650", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:46,348 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:46,349 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['55d1704d-84c4-48e0-a0be-df13625280c4', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,360 [78] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): webhook.site:443
notificationworker stdout | 2024-04-22 04:12:46,776 [78] [DEBUG] [urllib3.connectionpool] https://webhook.site:443 "POST /ffd85e96-d5d9-4a80-a40b-342ae3308119 HTTP/1.1" 200 None
notificationworker stdout | 2024-04-22 04:12:46,778 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures" FROM "repositorynotification" AS "t1" WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['55d1704d-84c4-48e0-a0be-df13625280c4', 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,781 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,783 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,785 [78] [DEBUG] [peewee] ('UPDATE "repositorynotification" SET "number_of_failures" = %s WHERE ("repositorynotification"."id" = %s)', [0, 7])
notificationworker stdout | 2024-04-22 04:12:46,789 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [51])
notificationworker stdout | 2024-04-22 04:12:46,794 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 46, 793609), True, datetime.datetime(2024, 4, 22, 4, 12, 46, 793609), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,797 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 16, 793609), 1, 'a971cd15-b3ac-444e-8229-8011cd8b85da', 8, '274cf96a-a2a8-4fe6-a3a8-672d359c4bbc'])
notificationworker stdout | 2024-04-22 04:12:46,800 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "27d600e3-69ac-4c25-9b0d-4999e865fe2c", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68517", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2023-3446", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:46,800 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:46,801 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['27d600e3-69ac-4c25-9b0d-4999e865fe2c', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,811 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [8])
notificationworker stdout | 2024-04-22 04:12:46,815 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 46, 815313), True, datetime.datetime(2024, 4, 22, 4, 12, 46, 815313), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,818 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 16, 815313), 1, '7aa210e2-c3f0-4c19-9299-12aa390ec3a7', 41, '1b481ec4-92b1-4dc5-9f2e-e37e83e2230b'])
notificationworker stdout | 2024-04-22 04:12:46,822 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "f1b7c257-8b4f-4497-9b0d-ec5a64ad3ebc", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68467", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2022-4304", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:46,822 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:46,823 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['f1b7c257-8b4f-4497-9b0d-ec5a64ad3ebc', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,836 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description" FROM "team" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") WHERE ((("t1"."name" = %s) AND ("t2"."organization" = %s)) AND ("t2"."username" = %s)) LIMIT %s', ['owners', True, 'build_test', 1])
notificationworker stdout | 2024-04-22 04:12:46,839 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" INNER JOIN "teammember" AS "t2" ON ("t2"."user_id" = "t1"."id") INNER JOIN "team" AS "t3" ON ("t2"."team_id" = "t3"."id") WHERE ("t3"."id" = %s)', [1])
notificationworker stdout | 2024-04-22 04:12:46,841 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['vulnerability_found', 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,843 [78] [DEBUG] [peewee] ('INSERT INTO "notification" ("uuid", "kind_id", "target_id", "metadata_json", "created", "dismissed", "lookup_path") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "notification"."id"', ['b9d5d775-3afe-4509-ae1a-0b6c840bded0', 12, 1, '{"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68467", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2022-4304", "priority": "", "has_fix": true}}', datetime.datetime(2024, 4, 22, 4, 12, 46, 843580), False, None])
notificationworker stdout | 2024-04-22 04:12:46,848 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures" FROM "repositorynotification" AS "t1" WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['f1b7c257-8b4f-4497-9b0d-ec5a64ad3ebc', 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,850 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,852 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,854 [78] [DEBUG] [peewee] ('UPDATE "repositorynotification" SET "number_of_failures" = %s WHERE ("repositorynotification"."id" = %s)', [0, 5])
notificationworker stdout | 2024-04-22 04:12:46,858 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [41])
notificationworker stdout | 2024-04-22 04:12:46,862 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 46, 861990), True, datetime.datetime(2024, 4, 22, 4, 12, 46, 861990), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,865 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 16, 861990), 1, 'fa78e673-0389-46b8-b751-c196705c3a77', 39, 'a02fbe20-be27-41df-9da1-d8565d7b210a'])
notificationworker stdout | 2024-04-22 04:12:46,868 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "55d1704d-84c4-48e0-a0be-df13625280c4", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68470", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2022-4450", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:46,868 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:46,869 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['55d1704d-84c4-48e0-a0be-df13625280c4', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:46,880 [78] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): webhook.site:443
buildlogsarchiver stdout | 2024-04-22 04:12:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:12:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:13:17.052354+00:00 (in 29.999548 seconds)
buildlogsarchiver stdout | 2024-04-22 04:12:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:13:17 UTC)" (scheduled at 2024-04-22 04:12:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:12:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 12, 47, 53187), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:12:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:12:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:12:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:13:17 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:12:47,270 [78] [DEBUG] [urllib3.connectionpool] https://webhook.site:443 "POST /ffd85e96-d5d9-4a80-a40b-342ae3308119 HTTP/1.1" 200 None
notificationworker stdout | 2024-04-22 04:12:47,272 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures" FROM "repositorynotification" AS "t1" WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['55d1704d-84c4-48e0-a0be-df13625280c4', 1, 0])
notificationworker stdout | 2024-04-22 04:12:47,274 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
notificationworker stdout | 2024-04-22 04:12:47,277 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
notificationworker stdout | 2024-04-22 04:12:47,279 [78] [DEBUG] [peewee] ('UPDATE "repositorynotification" SET "number_of_failures" = %s WHERE ("repositorynotification"."id" = %s)', [0, 7])
notificationworker stdout | 2024-04-22 04:12:47,286 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [39])
notificationworker stdout | 2024-04-22 04:12:47,298 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 47, 298088), True, datetime.datetime(2024, 4, 22, 4, 12, 47, 298088), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:47,301 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 17, 298088), 1, '8976f3eb-774c-4197-9ed3-22e0132f2310', 42, '3f9c911f-215e-4f16-94f0-4b81b12d0931'])
notificationworker stdout | 2024-04-22 04:12:47,306 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "821e891b-da3f-4153-b053-c6689eea2a99", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68467", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2022-4304", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:47,306 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:47,307 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['821e891b-da3f-4153-b053-c6689eea2a99', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:47,316 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [42])
notificationworker stdout | 2024-04-22 04:12:47,321 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 47, 320437), True, datetime.datetime(2024, 4, 22, 4, 12, 47, 320437), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:47,324 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:12:47,324 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:47,324 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:12:53 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:12:50,523 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:12:51,914 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:12:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:12:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:13:03.759375+00:00 (in 9.999461 seconds)
notificationworker stdout | 2024-04-22 04:12:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:13:03 UTC)" (scheduled at 2024-04-22 04:12:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:12:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:12:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 53, 760249), True, datetime.datetime(2024, 4, 22, 4, 12, 53, 760249), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:53,770 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 23, 760249), 1, '340fe134-b74f-4c8c-bb8b-ec2b7c0d7e28', 38, '2d52ab15-90d5-4fae-92d7-778a1ef07d47'])
notificationworker stdout | 2024-04-22 04:12:53,776 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "821e891b-da3f-4153-b053-c6689eea2a99", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68470", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2022-4450", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:53,776 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:53,777 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['821e891b-da3f-4153-b053-c6689eea2a99', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:53,787 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [38])
notificationworker stdout | 2024-04-22 04:12:53,792 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 53, 791772), True, datetime.datetime(2024, 4, 22, 4, 12, 53, 791772), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:53,795 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 23, 791772), 1, 'd6554504-0bfd-48bb-ae0a-d0e47136f8a5', 14, '9811226e-43ad-417c-b330-82bbc9e5a265'])
notificationworker stdout | 2024-04-22 04:12:53,798 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "821e891b-da3f-4153-b053-c6689eea2a99", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "71141", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2022-37434", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:12:53,799 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:53,800 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['821e891b-da3f-4153-b053-c6689eea2a99', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:12:53,810 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [14])
notificationworker stdout | 2024-04-22 04:12:53,815 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 12, 53, 814454), True, datetime.datetime(2024, 4, 22, 4, 12, 53, 814454), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:12:53,817 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:12:53,817 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:12:53,818 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:13:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:12:55,568 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:12:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:12:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:13:05.871852+00:00 (in 8.998208 seconds)
securityworker stdout | 2024-04-22 04:12:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:13:26 UTC)" (scheduled at 2024-04-22 04:12:56.873109+00:00)
securityworker stdout | 2024-04-22 04:12:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:12:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:12:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:12:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:12:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:12:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:12:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:12:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:12:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:12:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:12:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:12:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:12:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 7, 56, 881049), 1, 2])
securityworker stdout | 2024-04-22 04:12:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:12:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:12:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 7, 56, 881049), 1, 2])
securityworker stdout | 2024-04-22 04:12:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:12:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:12:56,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:12:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:12:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:12:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:12:56,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:12:56,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:12:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:12:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:13:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:12:57,357 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:12:58,559 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:12:58,609 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:12:59,163 [279] [DEBUG] [app] Starting request: urn:request:f498cc66-3cb7-45d9-a3f4-cffd230e6e95 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:12:59,163 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:12:59,163 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:12:59,163 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:12:59,173 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:12:59,173 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:12:59,173 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:12:59,173 [279] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:12:59,173 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:12:59,173 [279] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:12:59,174 [279] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:12:59,174 [279] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:12:59,176 [279] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:12:59,182 [279] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:12:59,183 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:12:59,187 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:12:59,191 [279] [DEBUG] [app] Ending request: urn:request:f498cc66-3cb7-45d9-a3f4-cffd230e6e95 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:f498cc66-3cb7-45d9-a3f4-cffd230e6e95', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:12:59,191 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:12:59,192 [279] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:12:59 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:12:59 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1536 0.031)
gunicorn-web stdout | 2024-04-22 04:13:00,238 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:13:00,243 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:13:00,247 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:13:00,265 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:13:00,269 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:13:00,568 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 04:13:00,653 [282] [DEBUG] [app] Starting request: urn:request:8e250ad3-c028-4ad1-834f-99807315ddcd (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:13:00,653 [278] [DEBUG] [app] Starting request: urn:request:7bdedfd5-9f6c-484d-9bb4-8bbd125119f9 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:13:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:13:00,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:13:00,656 [289] [DEBUG] [app] Starting request: urn:request:481d2a62-8fee-48fd-80b7-2e9759cf48cb (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:13:00,656 [284] [DEBUG] [app] Starting request: urn:request:12603b04-a6b6-41ad-8ebd-7131818543b7 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:13:00,656 [289] [DEBUG] [app] Ending request: urn:request:481d2a62-8fee-48fd-80b7-2e9759cf48cb (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:481d2a62-8fee-48fd-80b7-2e9759cf48cb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:13:00,656 [284] [DEBUG] [app] Ending request: urn:request:12603b04-a6b6-41ad-8ebd-7131818543b7 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:12603b04-a6b6-41ad-8ebd-7131818543b7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:13:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:13:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:13:00,657 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:13:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:13:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:13:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:13:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:13:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:13:00,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:13:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:13:00,659 [278] [DEBUG] [app] Starting request: urn:request:61730897-dc73-4343-be30-22178199b9ac (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:13:00,659 [278] [DEBUG] [app] Ending request: urn:request:61730897-dc73-4343-be30-22178199b9ac (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:61730897-dc73-4343-be30-22178199b9ac', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:13:00,660 [279] [DEBUG] [app] Starting request: urn:request:e8022f08-d3f6-48bf-b1d9-b508ec986a52 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:13:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:13:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:13:00,660 [279] [DEBUG] [app] Ending request: urn:request:e8022f08-d3f6-48bf-b1d9-b508ec986a52 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e8022f08-d3f6-48bf-b1d9-b508ec986a52', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:13:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:13:00,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:13:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:13:00,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:13:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:13:00,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:13:00,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:13:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:13:00,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:13:00,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:13:00,674 [278] [DEBUG] [app] Ending request: urn:request:7bdedfd5-9f6c-484d-9bb4-8bbd125119f9 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:7bdedfd5-9f6c-484d-9bb4-8bbd125119f9', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:13:00,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:13:00,674 [282] [DEBUG] [app] Ending request: urn:request:8e250ad3-c028-4ad1-834f-99807315ddcd (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:8e250ad3-c028-4ad1-834f-99807315ddcd', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:13:00,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:13:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:13:00,674 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:13:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:13:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:13:00,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:13:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
chunkcleanupworker stdout | 2024-04-22 04:13:00,724 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotatotalworker stdout | 2024-04-22 04:13:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:13:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:13:16.054492+00:00 (in 14.999496 seconds)
quotatotalworker stdout | 2024-04-22 04:13:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:13:16 UTC)" (scheduled at 2024-04-22 04:13:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:13:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:13:01,064 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:13:01,064 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:13:16 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:13:01,552 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:13:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:13:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:13:16.552337+00:00 (in 13.995622 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:13:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:14:02 UTC)" (scheduled at 2024-04-22 04:13:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:13:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:13:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:14:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:13:03,088 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:13:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:13:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:13:13.759375+00:00 (in 9.999415 seconds)
notificationworker stdout | 2024-04-22 04:13:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:13:13 UTC)" (scheduled at 2024-04-22 04:13:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:13:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:13:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 13, 3, 760290), True, datetime.datetime(2024, 4, 22, 4, 13, 3, 760290), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:13:03,771 [78] [DEBUG] [peewee] ('UPDATE "queueitem" SET "available" = %s, "processing_expires" = %s, "retries_remaining" = ("queueitem"."retries_remaining" - %s), "state_id" = %s WHERE (("queueitem"."id" = %s) AND ("queueitem"."state_id" = %s))', [False, datetime.datetime(2024, 4, 22, 4, 13, 33, 760290), 1, 'e7fbce5c-bc85-4168-88ee-ded5a25e29f2', 34, 'ef1c99e8-bc67-487c-b5df-54b4170a2971'])
notificationworker stdout | 2024-04-22 04:13:03,775 [78] [DEBUG] [workers.queueworker] Queue gave us some work: {"notification_uuid": "821e891b-da3f-4153-b053-c6689eea2a99", "event_data": {"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68473", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2023-0215", "priority": "", "has_fix": true}}, "performer_data": {}}
notificationworker stdout | 2024-04-22 04:13:03,776 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:13:03,777 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."number_of_failures" < %s)) LIMIT %s OFFSET %s', ['821e891b-da3f-4153-b053-c6689eea2a99', 3, 1, 0])
notificationworker stdout | 2024-04-22 04:13:03,787 [78] [DEBUG] [peewee] ('DELETE FROM "queueitem" WHERE ("queueitem"."id" = %s)', [34])
notificationworker stdout | 2024-04-22 04:13:03,792 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 13, 3, 791551), True, datetime.datetime(2024, 4, 22, 4, 13, 3, 791551), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:13:03,795 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:13:03,795 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:13:03,795 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:13:13 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:13:04,495 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:13:04,748 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
gunicorn-secscan stdout | 2024-04-22 04:13:04,813 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:13:04,817 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:13:04,820 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
exportactionlogsworker stdout | 2024-04-22 04:13:04,957 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:13:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:13:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:13:26.873109+00:00 (in 21.000731 seconds)
securityworker stdout | 2024-04-22 04:13:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:13:35 UTC)" (scheduled at 2024-04-22 04:13:05.871852+00:00)
securityworker stdout | 2024-04-22 04:13:05,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:13:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:13:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:13:05,877 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:13:05,885 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:13:05,886 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:13:35 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:13:06,037 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
repositorygcworker stdout | 2024-04-22 04:13:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:13:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:13:13.555667+00:00 (in 7.002747 seconds)
repositorygcworker stdout | 2024-04-22 04:13:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:14:06 UTC)" (scheduled at 2024-04-22 04:13:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:13:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:13:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 13, 6, 553262), True, datetime.datetime(2024, 4, 22, 4, 13, 6, 553262), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:13:06,563 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:13:06,563 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:13:06,563 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:14:06 UTC)" executed successfully
autopruneworker stdout | 2024-04-22 04:13:07,233 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:13:07,287 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:13:07,430 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:13:08,378 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:13:09,744 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:13:09,785 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:13:10,143 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:13:10,145 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:13:11,144 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:13:11,151 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:13:11,154 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:13:11,156 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:13:11,159 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:13:11,161 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:13:11,166 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:13:11,171 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:13:11,174 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
autopruneworker stdout | 2024-04-22 04:13:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:13:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:13:41.264267+00:00 (in 29.999423 seconds)
autopruneworker stdout | 2024-04-22 04:13:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:13:41 UTC)" (scheduled at 2024-04-22 04:13:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:13:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759131271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:13:11,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:13:11,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:13:11,275 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:13:41 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:13:11,503 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:13:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:13:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:14:06.552482+00:00 (in 52.996338 seconds)
repositorygcworker stdout | 2024-04-22 04:13:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:14:13 UTC)" (scheduled at 2024-04-22 04:13:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:13:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:13:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:14:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:13:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:13:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:13:19.762160+00:00 (in 6.002247 seconds)
notificationworker stdout | 2024-04-22 04:13:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:13:23 UTC)" (scheduled at 2024-04-22 04:13:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:13:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:13:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 13, 13, 760180), True, datetime.datetime(2024, 4, 22, 4, 13, 13, 760180), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:13:13,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:13:13,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:13:13,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:13:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:13:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:13:14,953 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:13:44.952062+00:00 (in 29.998947 seconds)
gcworker stdout | 2024-04-22 04:13:14,953 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:13:44 UTC)" (scheduled at 2024-04-22 04:13:14.952062+00:00)
gcworker stdout | 2024-04-22 04:13:14,954 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549594953, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:13:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:13:14,966 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:13:14,966 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:13:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:13:15,653 [282] [DEBUG] [app] Starting request: urn:request:50b6dbd8-7ae4-46ba-a32a-2c8951b114e7 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:13:15,653 [281] [DEBUG] [app] Starting request: urn:request:4a639f76-1bb5-4136-a7eb-44003af18acc (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:13:15,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:13:15,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:13:15,656 [290] [DEBUG] [app] Starting request: urn:request:edefd56a-49bb-452b-8176-209723662adf (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:13:15,656 [289] [DEBUG] [app] Starting request: urn:request:b4b8323a-bf7a-4af7-8feb-63e97fab7b6c (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:13:15,656 [290] [DEBUG] [app] Ending request: urn:request:edefd56a-49bb-452b-8176-209723662adf (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:edefd56a-49bb-452b-8176-209723662adf', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:13:15,656 [289] [DEBUG] [app] Ending request: urn:request:b4b8323a-bf7a-4af7-8feb-63e97fab7b6c (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b4b8323a-bf7a-4af7-8feb-63e97fab7b6c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:13:15,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:13:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:13:15,657 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:13:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:13:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:13:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:13:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:13:15,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:13:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:13:15,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:13:15,659 [282] [DEBUG] [app] Starting request: urn:request:e9fa5e74-4b67-4c14-98e8-8266c189ad8d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:13:15,659 [281] [DEBUG] [app] Starting request: urn:request:b4930331-11e7-4522-a9d9-b20a8e067f6e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:13:15,659 [282] [DEBUG] [app] Ending request: urn:request:e9fa5e74-4b67-4c14-98e8-8266c189ad8d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e9fa5e74-4b67-4c14-98e8-8266c189ad8d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:13:15,659 [281] [DEBUG] [app] Ending request: urn:request:b4930331-11e7-4522-a9d9-b20a8e067f6e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b4930331-11e7-4522-a9d9-b20a8e067f6e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:13:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:13:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:13:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:13:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:13:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:13:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:13:15,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:13:15,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:13:15,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:13:15,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:13:15,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:13:15,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:13:15,673 [282] [DEBUG] [app] Ending request: urn:request:50b6dbd8-7ae4-46ba-a32a-2c8951b114e7 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:50b6dbd8-7ae4-46ba-a32a-2c8951b114e7', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:13:15,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:13:15,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:13:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:13:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:13:15,674 [281] [DEBUG] [app] Ending request: urn:request:4a639f76-1bb5-4136-a7eb-44003af18acc (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:4a639f76-1bb5-4136-a7eb-44003af18acc', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:13:15,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:13:15,674 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:13:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:13:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
quotatotalworker stdout | 2024-04-22 04:13:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:13:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:13:31.054492+00:00 (in 14.999487 seconds)
quotatotalworker stdout | 2024-04-22 04:13:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:13:31 UTC)" (scheduled at 2024-04-22 04:13:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:13:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:13:16,064 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:13:16,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:13:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:13:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:13:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:14:02.556208+00:00 (in 46.003321 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:13:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:14:16 UTC)" (scheduled at 2024-04-22 04:13:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:13:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:13:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 13, 16, 553282), True, datetime.datetime(2024, 4, 22, 4, 13, 16, 553282), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:13:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:13:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:13:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:14:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:13:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:13:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:13:47.052354+00:00 (in 29.999489 seconds)
buildlogsarchiver stdout | 2024-04-22 04:13:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:13:47 UTC)" (scheduled at 2024-04-22 04:13:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:13:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 13, 17, 53233), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:13:17,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:13:17,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:13:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:13:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:13:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:13:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:13:23.759375+00:00 (in 3.996650 seconds)
notificationworker stdout | 2024-04-22 04:13:19,762 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:18:19 UTC)" (scheduled at 2024-04-22 04:13:19.762160+00:00)
notificationworker stdout | 2024-04-22 04:13:19,763 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 13, 19, 763147), 'notification/%'])
notificationworker stdout | 2024-04-22 04:13:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:14:19 UTC)" (scheduled at 2024-04-22 04:13:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:13:19,764 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:13:19,764 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:14:19 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:13:19,773 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 13, 19, 763147), True, datetime.datetime(2024, 4, 22, 4, 13, 19, 763147), 0, 'notification/%'])
notificationworker stdout | 2024-04-22 04:13:19,776 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 13, 19, 763147), True, datetime.datetime(2024, 4, 22, 4, 13, 19, 763147), 0, 'notification/%', False, datetime.datetime(2024, 4, 22, 4, 13, 19, 763147), 'notification/%'])
notificationworker stdout | 2024-04-22 04:13:19,778 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:13:19,779 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:18:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:13:20,560 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:13:21,951 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 04:13:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:13:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:13:43.057186+00:00 (in 20.997748 seconds)
namespacegcworker stdout | 2024-04-22 04:13:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:14:22 UTC)" (scheduled at 2024-04-22 04:13:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:13:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:13:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:14:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:13:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:13:23,760 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:13:33.759375+00:00 (in 9.999387 seconds)
notificationworker stdout | 2024-04-22 04:13:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:13:33 UTC)" (scheduled at 2024-04-22 04:13:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:13:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:13:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 13, 23, 760333), True, datetime.datetime(2024, 4, 22, 4, 13, 23, 760333), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:13:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:13:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:13:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:13:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:13:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:13:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:14:24.361582+00:00 (in 59.999454 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:13:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:14:24 UTC)" (scheduled at 2024-04-22 04:13:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:13:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:13:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:13:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:14:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:13:25,585 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:13:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:13:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:13:35.871852+00:00 (in 8.998265 seconds)
securityworker stdout | 2024-04-22 04:13:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:13:56 UTC)" (scheduled at 2024-04-22 04:13:26.873109+00:00)
securityworker stdout | 2024-04-22 04:13:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:13:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:13:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:13:26,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:13:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:13:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:13:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:13:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:13:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:13:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:13:26,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:13:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:13:26,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 8, 26, 880820), 1, 2])
securityworker stdout | 2024-04-22 04:13:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:13:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:13:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 8, 26, 880820), 1, 2])
securityworker stdout | 2024-04-22 04:13:26,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:13:26,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:13:26,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:13:26,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:13:26,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:13:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:13:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:13:26,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:13:26,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:13:26,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:13:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:13:27,391 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:13:28,568 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:13:28,632 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:13:29,549 [281] [DEBUG] [app] Starting request: urn:request:a42da1fc-0467-43be-8b0c-66b1af3b7390 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:13:29,549 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:13:29,549 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:13:29,550 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:13:29,559 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:13:29,559 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:13:29,559 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:13:29,560 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:13:29,560 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:13:29,560 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:13:29,560 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:13:29,560 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:13:29,562 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:13:29,568 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:13:29,569 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:13:29,573 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:13:29,577 [281] [DEBUG] [app] Ending request: urn:request:a42da1fc-0467-43be-8b0c-66b1af3b7390 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:a42da1fc-0467-43be-8b0c-66b1af3b7390', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:13:29,577 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:13:29 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1555 0.030)
gunicorn-web stdout | 2024-04-22 04:13:29,578 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:13:29 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:13:30,246 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:13:30,251 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:13:30,259 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:13:30,279 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:13:30,282 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:13:30,604 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 04:13:30,653 [281] [DEBUG] [app] Starting request: urn:request:cfb82d6f-8ad0-4a3c-8c59-26e4ca8e1f4b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:13:30,653 [278] [DEBUG] [app] Starting request: urn:request:82bb78e7-3bae-452d-9a44-e24d3618704a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:13:30,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:13:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:13:30,656 [288] [DEBUG] [app] Starting request: urn:request:2f022945-17d2-43fd-8738-054813b7a81e (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:13:30,656 [284] [DEBUG] [app] Starting request: urn:request:8b6c2668-5b58-47b2-a31e-0fc7fbe108c1 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:13:30,656 [288] [DEBUG] [app] Ending request: urn:request:2f022945-17d2-43fd-8738-054813b7a81e (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:2f022945-17d2-43fd-8738-054813b7a81e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:13:30,656 [284] [DEBUG] [app] Ending request: urn:request:8b6c2668-5b58-47b2-a31e-0fc7fbe108c1 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:8b6c2668-5b58-47b2-a31e-0fc7fbe108c1', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:13:30,656 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:13:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:13:30,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:13:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:13:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:13:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:13:30,656 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:13:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:13:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:13:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:13:30,659 [281] [DEBUG] [app] Starting request: urn:request:fc8e685f-9d90-462e-abd3-7a08501e67dd (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:13:30,659 [281] [DEBUG] [app] Ending request: urn:request:fc8e685f-9d90-462e-abd3-7a08501e67dd (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:fc8e685f-9d90-462e-abd3-7a08501e67dd', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:13:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:13:30,659 [279] [DEBUG] [app] Starting request: urn:request:f7a09dff-e898-4fca-a5e7-eee7a1a7f132 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:13:30,659 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:13:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:13:30,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:13:30,660 [279] [DEBUG] [app] Ending request: urn:request:f7a09dff-e898-4fca-a5e7-eee7a1a7f132 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:f7a09dff-e898-4fca-a5e7-eee7a1a7f132', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:13:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:13:30,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:13:30,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:13:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:13:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:13:30,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:13:30,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:13:30,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:13:30,673 [281] [DEBUG] [app] Ending request: urn:request:cfb82d6f-8ad0-4a3c-8c59-26e4ca8e1f4b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:cfb82d6f-8ad0-4a3c-8c59-26e4ca8e1f4b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:13:30,673 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:13:30,674 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:13:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:13:30,674 [278] [DEBUG] [app] Ending request: urn:request:82bb78e7-3bae-452d-9a44-e24d3618704a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:82bb78e7-3bae-452d-9a44-e24d3618704a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:13:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.021 118 0.022)
gunicorn-web stdout | 2024-04-22 04:13:30,674 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:13:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:13:30,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:13:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
chunkcleanupworker stdout | 2024-04-22 04:13:30,757 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotatotalworker stdout | 2024-04-22 04:13:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:13:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:13:46.054492+00:00 (in 14.999484 seconds)
quotatotalworker stdout | 2024-04-22 04:13:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:13:46 UTC)" (scheduled at 2024-04-22 04:13:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:13:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:13:31,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:13:31,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:13:46 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:13:31,589 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:13:33,124 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:13:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:13:33,760 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:13:43.759375+00:00 (in 9.999379 seconds)
notificationworker stdout | 2024-04-22 04:13:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:13:43 UTC)" (scheduled at 2024-04-22 04:13:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:13:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:13:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 13, 33, 760317), True, datetime.datetime(2024, 4, 22, 4, 13, 33, 760317), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:13:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:13:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:13:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:13:43 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:13:34,527 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:13:34,785 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
gunicorn-secscan stdout | 2024-04-22 04:13:34,820 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:13:34,825 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:13:34,829 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
exportactionlogsworker stdout | 2024-04-22 04:13:34,976 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:13:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:13:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:13:56.873109+00:00 (in 21.000768 seconds)
securityworker stdout | 2024-04-22 04:13:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:14:05 UTC)" (scheduled at 2024-04-22 04:13:35.871852+00:00)
securityworker stdout | 2024-04-22 04:13:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:13:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:13:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:13:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:13:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:13:35,887 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:13:35,890 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:13:35,890 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:13:35,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 8, 35, 876410), 1, 2])
securityworker stdout | 2024-04-22 04:13:35,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:13:35,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:13:35,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 8, 35, 876410), 1, 2])
securityworker stdout | 2024-04-22 04:13:35,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:13:35,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:13:35,895 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:13:35,895 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:14:05 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:13:36,068 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:13:37,265 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:13:37,323 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:13:37,466 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:13:38,414 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
exportactionlogsworker stdout | 2024-04-22 04:13:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:13:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:13:41.564959+00:00 (in 1.997440 seconds)
exportactionlogsworker stdout | 2024-04-22 04:13:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:14:39 UTC)" (scheduled at 2024-04-22 04:13:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:13:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:13:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:14:39 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:13:39,774 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:13:39,796 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 04:13:40,161 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:13:40,177 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
gunicorn-registry stdout | 2024-04-22 04:13:41,154 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:13:41,164 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:13:41,167 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:13:41,169 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:13:41,172 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:13:41,175 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:13:41,179 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:13:41,182 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:13:41,185 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 04:13:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:13:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:14:11.264267+00:00 (in 29.999444 seconds)
autopruneworker stdout | 2024-04-22 04:13:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:14:11 UTC)" (scheduled at 2024-04-22 04:13:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:13:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759161271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:13:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:13:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:13:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:14:11 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:13:41,539 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
exportactionlogsworker stdout | 2024-04-22 04:13:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:13:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:14:39.566970+00:00 (in 58.001530 seconds)
exportactionlogsworker stdout | 2024-04-22 04:13:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:14:41 UTC)" (scheduled at 2024-04-22 04:13:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:13:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:13:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 13, 41, 565716), True, datetime.datetime(2024, 4, 22, 4, 13, 41, 565716), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:13:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:13:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:13:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:14:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:13:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:13:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:14:22.058978+00:00 (in 39.001324 seconds)
namespacegcworker stdout | 2024-04-22 04:13:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:14:43 UTC)" (scheduled at 2024-04-22 04:13:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:13:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:13:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 13, 43, 57957), True, datetime.datetime(2024, 4, 22, 4, 13, 43, 57957), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:13:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:13:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:13:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:14:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:13:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:13:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:13:53.759375+00:00 (in 9.999518 seconds)
notificationworker stdout | 2024-04-22 04:13:43,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:13:53 UTC)" (scheduled at 2024-04-22 04:13:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:13:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:13:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 13, 43, 760109), True, datetime.datetime(2024, 4, 22, 4, 13, 43, 760109), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:13:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:13:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:13:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:13:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:13:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:13:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:14:14.952062+00:00 (in 29.999527 seconds)
gcworker stdout | 2024-04-22 04:13:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:14:14 UTC)" (scheduled at 2024-04-22 04:13:44.952062+00:00)
gcworker stdout | 2024-04-22 04:13:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549624952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:13:44,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:13:44,964 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:13:44,964 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:14:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:13:45,652 [279] [DEBUG] [app] Starting request: urn:request:c58c602a-86f6-459f-ba78-412caec98026 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:13:45,652 [282] [DEBUG] [app] Starting request: urn:request:40e25a90-026d-4457-a0b3-811d0d39fa48 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:13:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:13:45,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:13:45,656 [284] [DEBUG] [app] Starting request: urn:request:ca127d76-b717-449c-a642-ae401fa9b946 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:13:45,656 [288] [DEBUG] [app] Starting request: urn:request:ca204b1f-bb05-4381-b622-690048b16fc3 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:13:45,656 [288] [DEBUG] [app] Ending request: urn:request:ca204b1f-bb05-4381-b622-690048b16fc3 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:ca204b1f-bb05-4381-b622-690048b16fc3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:13:45,656 [284] [DEBUG] [app] Ending request: urn:request:ca127d76-b717-449c-a642-ae401fa9b946 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:ca127d76-b717-449c-a642-ae401fa9b946', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:13:45,656 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:13:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:13:45,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:13:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:13:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:13:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:13:45,656 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:13:45,656 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:13:45,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:13:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:13:45,659 [282] [DEBUG] [app] Starting request: urn:request:22b352a0-f2e7-4021-8b46-28c58f9cc629 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:13:45,659 [282] [DEBUG] [app] Ending request: urn:request:22b352a0-f2e7-4021-8b46-28c58f9cc629 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:22b352a0-f2e7-4021-8b46-28c58f9cc629', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:13:45,659 [278] [DEBUG] [app] Starting request: urn:request:ba8d41b1-7e35-4b87-9d19-abfe8b8705b6 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:13:45,659 [278] [DEBUG] [app] Ending request: urn:request:ba8d41b1-7e35-4b87-9d19-abfe8b8705b6 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:ba8d41b1-7e35-4b87-9d19-abfe8b8705b6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:13:45,659 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:13:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:13:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:13:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:13:45,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:13:45,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:13:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:13:45,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:13:45,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:13:45,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:13:45,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:13:45,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:13:45,673 [282] [DEBUG] [app] Ending request: urn:request:40e25a90-026d-4457-a0b3-811d0d39fa48 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:40e25a90-026d-4457-a0b3-811d0d39fa48', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:13:45,673 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:13:45,673 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:13:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:13:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.021 118 0.021)
gunicorn-web stdout | 2024-04-22 04:13:45,674 [279] [DEBUG] [app] Ending request: urn:request:c58c602a-86f6-459f-ba78-412caec98026 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:c58c602a-86f6-459f-ba78-412caec98026', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:13:45,674 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:13:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:13:45,674 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:13:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:13:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:13:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:14:01.054492+00:00 (in 14.999468 seconds)
quotatotalworker stdout | 2024-04-22 04:13:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:14:01 UTC)" (scheduled at 2024-04-22 04:13:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:13:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:13:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:13:46,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:14:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:13:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:13:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:14:17.052354+00:00 (in 29.999473 seconds)
buildlogsarchiver stdout | 2024-04-22 04:13:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:14:17 UTC)" (scheduled at 2024-04-22 04:13:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:13:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 13, 47, 53263), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:13:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:13:47,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:13:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:14:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:13:50,596 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:13:51,974 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:13:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:13:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:14:03.759375+00:00 (in 9.999459 seconds)
notificationworker stdout | 2024-04-22 04:13:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:14:03 UTC)" (scheduled at 2024-04-22 04:13:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:13:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:13:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 13, 53, 760234), True, datetime.datetime(2024, 4, 22, 4, 13, 53, 760234), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:13:53,774 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:13:53,774 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:13:53,774 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:14:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:13:55,615 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:13:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:13:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:14:05.871852+00:00 (in 8.998246 seconds)
securityworker stdout | 2024-04-22 04:13:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:14:26 UTC)" (scheduled at 2024-04-22 04:13:56.873109+00:00)
securityworker stdout | 2024-04-22 04:13:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:13:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:13:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:13:56,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:13:56,876 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:13:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:13:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:13:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:13:56,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:13:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:13:56,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:13:56,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:13:56,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 8, 56, 880481), 1, 2])
securityworker stdout | 2024-04-22 04:13:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:13:56,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:13:56,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 8, 56, 880481), 1, 2])
securityworker stdout | 2024-04-22 04:13:56,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:13:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:13:56,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:13:56,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:13:56,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:13:56,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:13:56,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:13:56,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:13:56,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:13:56,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:14:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:13:57,406 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:13:58,604 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:13:58,640 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:14:00,253 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:14:00,260 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:14:00,270 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:14:00,292 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:14:00,294 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
teamsyncworker stdout | 2024-04-22 04:14:00,641 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
gunicorn-web stdout | 2024-04-22 04:14:00,653 [279] [DEBUG] [app] Starting request: urn:request:9c814b71-aca2-41d6-a7ff-140a18ceaa16 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:14:00,653 [282] [DEBUG] [app] Starting request: urn:request:b07ef7ac-17af-4c05-9ee8-ca7aeb17a8cc (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:14:00,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:14:00,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:14:00,657 [284] [DEBUG] [app] Starting request: urn:request:4fb91acd-4d4f-4a2d-8c64-eabb75ff0080 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:14:00,657 [291] [DEBUG] [app] Starting request: urn:request:70d812f9-3d00-4a99-bd44-fb45a6a9d9d1 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:14:00,657 [284] [DEBUG] [app] Ending request: urn:request:4fb91acd-4d4f-4a2d-8c64-eabb75ff0080 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:4fb91acd-4d4f-4a2d-8c64-eabb75ff0080', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:14:00,657 [291] [DEBUG] [app] Ending request: urn:request:70d812f9-3d00-4a99-bd44-fb45a6a9d9d1 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:70d812f9-3d00-4a99-bd44-fb45a6a9d9d1', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:14:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:14:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:14:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:14:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:14:00,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:14:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:14:00,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:14:00,658 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:14:00,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:14:00,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:14:00,660 [279] [DEBUG] [app] Starting request: urn:request:82645b12-504b-44c7-81c4-25dc784d67f8 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:14:00,660 [279] [DEBUG] [app] Ending request: urn:request:82645b12-504b-44c7-81c4-25dc784d67f8 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:82645b12-504b-44c7-81c4-25dc784d67f8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:14:00,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:14:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:14:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:14:00,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:14:00,661 [278] [DEBUG] [app] Starting request: urn:request:58a6afe9-4db5-4a99-af7d-3cbf448f6a3b (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:14:00,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:14:00,661 [278] [DEBUG] [app] Ending request: urn:request:58a6afe9-4db5-4a99-af7d-3cbf448f6a3b (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:58a6afe9-4db5-4a99-af7d-3cbf448f6a3b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:14:00,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:14:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:14:00,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:14:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:14:00,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:14:00,669 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:14:00,669 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:14:00,676 [279] [DEBUG] [app] Ending request: urn:request:9c814b71-aca2-41d6-a7ff-140a18ceaa16 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:9c814b71-aca2-41d6-a7ff-140a18ceaa16', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:14:00,676 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:14:00,676 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:14:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:14:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 04:14:00,677 [282] [DEBUG] [app] Ending request: urn:request:b07ef7ac-17af-4c05-9ee8-ca7aeb17a8cc (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b07ef7ac-17af-4c05-9ee8-ca7aeb17a8cc', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:14:00,677 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:14:00,677 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:14:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:14:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
chunkcleanupworker stdout | 2024-04-22 04:14:00,794 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:14:00,825 [279] [DEBUG] [app] Starting request: urn:request:344f81ab-928b-4e95-8b11-a61dc3f2ae82 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:14:00,825 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:14:00,825 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:14:00,826 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:14:00,835 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:14:00,835 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:14:00,835 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:14:00,835 [279] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:14:00,835 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:14:00,835 [279] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:14:00,835 [279] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:14:00,835 [279] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:14:00,837 [279] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:14:00,843 [279] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:14:00,844 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:14:00,849 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:14:00,853 [279] [DEBUG] [app] Ending request: urn:request:344f81ab-928b-4e95-8b11-a61dc3f2ae82 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:344f81ab-928b-4e95-8b11-a61dc3f2ae82', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:14:00,853 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:14:00,854 [279] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:14:00 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:14:00 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.029 1536 0.029)
quotatotalworker stdout | 2024-04-22 04:14:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:14:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:14:16.054492+00:00 (in 14.999464 seconds)
quotatotalworker stdout | 2024-04-22 04:14:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:14:16 UTC)" (scheduled at 2024-04-22 04:14:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:14:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:14:01,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:14:01,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:14:16 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:14:01,626 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:14:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:14:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:14:16.552337+00:00 (in 13.995612 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:14:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:15:02 UTC)" (scheduled at 2024-04-22 04:14:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:14:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:14:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:15:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:14:03,150 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:14:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:14:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:14:13.759375+00:00 (in 9.999435 seconds)
notificationworker stdout | 2024-04-22 04:14:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:14:13 UTC)" (scheduled at 2024-04-22 04:14:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:14:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:14:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 14, 3, 760288), True, datetime.datetime(2024, 4, 22, 4, 14, 3, 760288), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:14:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:14:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:14:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:14:13 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:14:04,563 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:14:04,810 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
gunicorn-secscan stdout | 2024-04-22 04:14:04,828 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:14:04,833 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:14:04,836 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
exportactionlogsworker stdout | 2024-04-22 04:14:04,997 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:14:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:14:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:14:26.873109+00:00 (in 21.000722 seconds)
securityworker stdout | 2024-04-22 04:14:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:14:35 UTC)" (scheduled at 2024-04-22 04:14:05.871852+00:00)
securityworker stdout | 2024-04-22 04:14:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:14:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:14:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:14:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:14:05,885 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:14:05,885 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:14:35 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:14:06,084 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
repositorygcworker stdout | 2024-04-22 04:14:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:14:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:14:13.555667+00:00 (in 7.002644 seconds)
repositorygcworker stdout | 2024-04-22 04:14:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:15:06 UTC)" (scheduled at 2024-04-22 04:14:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:14:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:14:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 14, 6, 553382), True, datetime.datetime(2024, 4, 22, 4, 14, 6, 553382), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:14:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:14:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:14:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:15:06 UTC)" executed successfully
autopruneworker stdout | 2024-04-22 04:14:07,302 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:14:07,334 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:14:07,502 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:14:08,441 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:14:09,787 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:14:09,833 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:14:10,186 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:14:10,188 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:14:11,164 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:14:11,175 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:14:11,178 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:14:11,182 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:14:11,185 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:14:11,188 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:14:11,190 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:14:11,194 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:14:11,198 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
autopruneworker stdout | 2024-04-22 04:14:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:14:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:14:41.264267+00:00 (in 29.999507 seconds)
autopruneworker stdout | 2024-04-22 04:14:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:14:41 UTC)" (scheduled at 2024-04-22 04:14:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:14:11,271 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759191271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:14:11,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:14:11,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:14:11,275 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:14:41 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:14:11,560 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:14:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:14:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:15:06.552482+00:00 (in 52.996362 seconds)
repositorygcworker stdout | 2024-04-22 04:14:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:15:13 UTC)" (scheduled at 2024-04-22 04:14:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:14:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:14:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:15:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:14:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:14:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:14:19.762424+00:00 (in 6.002536 seconds)
notificationworker stdout | 2024-04-22 04:14:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:14:23 UTC)" (scheduled at 2024-04-22 04:14:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:14:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:14:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 14, 13, 760256), True, datetime.datetime(2024, 4, 22, 4, 14, 13, 760256), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:14:13,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:14:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:14:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:14:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:14:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:14:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:14:44.952062+00:00 (in 29.999500 seconds)
gcworker stdout | 2024-04-22 04:14:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:14:44 UTC)" (scheduled at 2024-04-22 04:14:14.952062+00:00)
gcworker stdout | 2024-04-22 04:14:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549654952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:14:14,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:14:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:14:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:14:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:14:15,653 [282] [DEBUG] [app] Starting request: urn:request:5f047aa3-8b15-4949-86f2-dd84c2882ac8 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:14:15,653 [278] [DEBUG] [app] Starting request: urn:request:f0322b8f-1ef2-42d6-8914-24117688d6b4 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:14:15,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:14:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:14:15,656 [284] [DEBUG] [app] Starting request: urn:request:46403b5c-6307-46cc-a9c8-37104c987163 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:14:15,656 [291] [DEBUG] [app] Starting request: urn:request:6e80ba98-e8d2-45a2-9d61-da90b1dab1f6 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:14:15,656 [284] [DEBUG] [app] Ending request: urn:request:46403b5c-6307-46cc-a9c8-37104c987163 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:46403b5c-6307-46cc-a9c8-37104c987163', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:14:15,657 [291] [DEBUG] [app] Ending request: urn:request:6e80ba98-e8d2-45a2-9d61-da90b1dab1f6 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:6e80ba98-e8d2-45a2-9d61-da90b1dab1f6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:14:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:14:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:14:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:14:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:14:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:14:15,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:14:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:14:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:14:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:14:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:14:15,659 [281] [DEBUG] [app] Starting request: urn:request:3d572f24-0fe9-4911-8210-299b309ef5be (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:14:15,660 [279] [DEBUG] [app] Starting request: urn:request:54b5d904-b6d1-4fbd-9979-c870f8fb94db (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:14:15,660 [281] [DEBUG] [app] Ending request: urn:request:3d572f24-0fe9-4911-8210-299b309ef5be (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3d572f24-0fe9-4911-8210-299b309ef5be', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:14:15,660 [279] [DEBUG] [app] Ending request: urn:request:54b5d904-b6d1-4fbd-9979-c870f8fb94db (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:54b5d904-b6d1-4fbd-9979-c870f8fb94db', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:14:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:14:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:14:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:14:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:14:15,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:14:15,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:14:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:14:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:14:15,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:14:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:14:15,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:14:15,669 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:14:15,674 [282] [DEBUG] [app] Ending request: urn:request:5f047aa3-8b15-4949-86f2-dd84c2882ac8 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:5f047aa3-8b15-4949-86f2-dd84c2882ac8', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:14:15,674 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:14:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:14:15,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:14:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:14:15,676 [278] [DEBUG] [app] Ending request: urn:request:f0322b8f-1ef2-42d6-8914-24117688d6b4 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f0322b8f-1ef2-42d6-8914-24117688d6b4', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:14:15,676 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:14:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
gunicorn-web stdout | 2024-04-22 04:14:15,677 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:14:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:14:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:14:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:14:31.054492+00:00 (in 14.999478 seconds)
quotatotalworker stdout | 2024-04-22 04:14:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:14:31 UTC)" (scheduled at 2024-04-22 04:14:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:14:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:14:16,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:14:16,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:14:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:14:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:14:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:15:02.556208+00:00 (in 46.003275 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:14:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:15:16 UTC)" (scheduled at 2024-04-22 04:14:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:14:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:14:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 14, 16, 553349), True, datetime.datetime(2024, 4, 22, 4, 14, 16, 553349), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:14:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:14:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:14:16,565 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:15:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:14:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:14:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:14:47.052354+00:00 (in 29.999469 seconds)
buildlogsarchiver stdout | 2024-04-22 04:14:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:14:47 UTC)" (scheduled at 2024-04-22 04:14:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:14:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 14, 17, 53214), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:14:17,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:14:17,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:14:17,063 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:14:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:14:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:14:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:14:23.759375+00:00 (in 3.996418 seconds)
notificationworker stdout | 2024-04-22 04:14:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:15:19 UTC)" (scheduled at 2024-04-22 04:14:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:14:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:14:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:15:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:14:20,633 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:14:21,985 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 04:14:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:14:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:14:43.057186+00:00 (in 20.997697 seconds)
namespacegcworker stdout | 2024-04-22 04:14:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:15:22 UTC)" (scheduled at 2024-04-22 04:14:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:14:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:14:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:15:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:14:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:14:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:14:33.759375+00:00 (in 9.999461 seconds)
notificationworker stdout | 2024-04-22 04:14:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:14:33 UTC)" (scheduled at 2024-04-22 04:14:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:14:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:14:23,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 14, 23, 760190), True, datetime.datetime(2024, 4, 22, 4, 14, 23, 760190), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:14:23,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:14:23,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:14:23,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:14:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:14:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:14:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:15:24.361582+00:00 (in 59.999453 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:14:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:15:24 UTC)" (scheduled at 2024-04-22 04:14:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:14:24,363 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:14:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:14:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:15:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:14:25,652 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:14:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:14:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:14:35.871852+00:00 (in 8.998277 seconds)
securityworker stdout | 2024-04-22 04:14:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:14:56 UTC)" (scheduled at 2024-04-22 04:14:26.873109+00:00)
securityworker stdout | 2024-04-22 04:14:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:14:26,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:14:26,875 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:14:26,875 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:14:26,875 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:14:26,875 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:14:26,876 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:14:26,878 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:14:26,879 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:14:26,888 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:14:26,891 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:14:26,891 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:14:26,892 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 9, 26, 879380), 1, 2])
securityworker stdout | 2024-04-22 04:14:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:14:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:14:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 9, 26, 879380), 1, 2])
securityworker stdout | 2024-04-22 04:14:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:14:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:14:26,897 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:14:26,897 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:14:26,897 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:14:26,897 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:14:26,897 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:14:26,898 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:14:26,898 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:14:26,898 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:14:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:14:27,441 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:14:28,641 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:14:28,673 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:14:30,262 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:14:30,269 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:14:30,279 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:14:30,303 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:14:30,306 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:14:30,653 [278] [DEBUG] [app] Starting request: urn:request:2480e144-3150-422f-874b-b731bccd687f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:14:30,653 [282] [DEBUG] [app] Starting request: urn:request:f9d94d59-b41e-48d9-b2d7-8b13b823591a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:14:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:14:30,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:14:30,656 [292] [DEBUG] [app] Starting request: urn:request:b41a59a0-5c12-4870-be33-2808406e91f2 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:14:30,656 [289] [DEBUG] [app] Starting request: urn:request:d8d538d2-2598-461b-8f80-506a42fc81fe (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:14:30,657 [289] [DEBUG] [app] Ending request: urn:request:d8d538d2-2598-461b-8f80-506a42fc81fe (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:d8d538d2-2598-461b-8f80-506a42fc81fe', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:14:30,657 [292] [DEBUG] [app] Ending request: urn:request:b41a59a0-5c12-4870-be33-2808406e91f2 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b41a59a0-5c12-4870-be33-2808406e91f2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:14:30,657 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:14:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:14:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:14:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:14:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:14:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:14:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:14:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:14:30,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:14:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:14:30,659 [282] [DEBUG] [app] Starting request: urn:request:4178daf7-dee1-4653-8f49-94f83d1995e0 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:14:30,660 [281] [DEBUG] [app] Starting request: urn:request:fe23f71e-62c5-421e-8670-dbe817ef5201 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:14:30,660 [282] [DEBUG] [app] Ending request: urn:request:4178daf7-dee1-4653-8f49-94f83d1995e0 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:4178daf7-dee1-4653-8f49-94f83d1995e0', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:14:30,660 [281] [DEBUG] [app] Ending request: urn:request:fe23f71e-62c5-421e-8670-dbe817ef5201 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:fe23f71e-62c5-421e-8670-dbe817ef5201', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:14:30,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:14:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:14:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:14:30,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:14:30,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:14:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:14:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:14:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:14:30,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:14:30,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:14:30,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:14:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:14:30,674 [282] [DEBUG] [app] Ending request: urn:request:f9d94d59-b41e-48d9-b2d7-8b13b823591a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f9d94d59-b41e-48d9-b2d7-8b13b823591a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:14:30,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:14:30,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:14:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:14:30,674 [278] [DEBUG] [app] Ending request: urn:request:2480e144-3150-422f-874b-b731bccd687f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2480e144-3150-422f-874b-b731bccd687f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:14:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:14:30,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:14:30,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:14:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:14:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
teamsyncworker stdout | 2024-04-22 04:14:30,678 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:14:30,831 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotatotalworker stdout | 2024-04-22 04:14:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:14:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:14:46.054492+00:00 (in 14.999494 seconds)
quotatotalworker stdout | 2024-04-22 04:14:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:14:46 UTC)" (scheduled at 2024-04-22 04:14:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:14:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:14:31,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:14:31,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:14:46 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:14:31,211 [282] [DEBUG] [app] Starting request: urn:request:2c49dc19-058a-471d-9c26-2842dad35b4a (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:14:31,211 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:14:31,211 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:14:31,212 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:14:31,220 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:14:31,220 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:14:31,221 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:14:31,221 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:14:31,221 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:14:31,221 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:14:31,221 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:14:31,221 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:14:31,223 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:14:31,229 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:14:31,230 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:14:31,234 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:14:31,238 [282] [DEBUG] [app] Ending request: urn:request:2c49dc19-058a-471d-9c26-2842dad35b4a (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:2c49dc19-058a-471d-9c26-2842dad35b4a', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:14:31,238 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:14:31,239 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:14:31 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:14:31 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1555 0.030)
quotaregistrysizeworker stdout | 2024-04-22 04:14:31,663 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:14:33,173 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:14:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:14:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:14:43.759375+00:00 (in 9.999484 seconds)
notificationworker stdout | 2024-04-22 04:14:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:14:43 UTC)" (scheduled at 2024-04-22 04:14:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:14:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:14:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 14, 33, 760280), True, datetime.datetime(2024, 4, 22, 4, 14, 33, 760280), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:14:33,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:14:33,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:14:33,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:14:43 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:14:34,600 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:14:34,821 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
gunicorn-secscan stdout | 2024-04-22 04:14:34,837 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:14:34,840 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:14:34,843 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
exportactionlogsworker stdout | 2024-04-22 04:14:35,025 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:14:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:14:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:14:56.873109+00:00 (in 21.000772 seconds)
securityworker stdout | 2024-04-22 04:14:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:15:05 UTC)" (scheduled at 2024-04-22 04:14:35.871852+00:00)
securityworker stdout | 2024-04-22 04:14:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:14:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:14:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:14:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:14:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:14:35,887 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:14:35,890 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:14:35,890 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:14:35,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 9, 35, 876138), 1, 2])
securityworker stdout | 2024-04-22 04:14:35,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:14:35,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:14:35,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 9, 35, 876138), 1, 2])
securityworker stdout | 2024-04-22 04:14:35,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:14:35,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:14:35,895 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:14:35,895 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:15:05 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:14:36,120 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:14:37,338 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:14:37,341 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:14:37,536 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:14:38,449 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
exportactionlogsworker stdout | 2024-04-22 04:14:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:14:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:14:41.564959+00:00 (in 1.997426 seconds)
exportactionlogsworker stdout | 2024-04-22 04:14:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:15:39 UTC)" (scheduled at 2024-04-22 04:14:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:14:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:14:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:15:39 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:14:39,817 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:14:39,848 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:14:40,222 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:14:40,224 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:14:41,173 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:14:41,186 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:14:41,189 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:14:41,193 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:14:41,196 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:14:41,199 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:14:41,201 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:14:41,204 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:14:41,209 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
autopruneworker stdout | 2024-04-22 04:14:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:14:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:15:11.264267+00:00 (in 29.999469 seconds)
autopruneworker stdout | 2024-04-22 04:14:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:15:11 UTC)" (scheduled at 2024-04-22 04:14:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:14:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759221271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:14:41,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:14:41,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:14:41,275 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:15:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:14:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:14:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:15:39.566970+00:00 (in 58.001482 seconds)
exportactionlogsworker stdout | 2024-04-22 04:14:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:15:41 UTC)" (scheduled at 2024-04-22 04:14:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:14:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:14:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 14, 41, 565751), True, datetime.datetime(2024, 4, 22, 4, 14, 41, 565751), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:14:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:14:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:14:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:15:41 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:14:41,578 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
namespacegcworker stdout | 2024-04-22 04:14:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:14:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:15:22.058978+00:00 (in 39.001284 seconds)
namespacegcworker stdout | 2024-04-22 04:14:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:15:43 UTC)" (scheduled at 2024-04-22 04:14:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:14:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:14:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 14, 43, 57980), True, datetime.datetime(2024, 4, 22, 4, 14, 43, 57980), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:14:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:14:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:14:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:15:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:14:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:14:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:14:53.759375+00:00 (in 9.999530 seconds)
notificationworker stdout | 2024-04-22 04:14:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:14:53 UTC)" (scheduled at 2024-04-22 04:14:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:14:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:14:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 14, 43, 760157), True, datetime.datetime(2024, 4, 22, 4, 14, 43, 760157), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:14:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:14:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:14:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:14:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:14:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:14:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:15:14.952062+00:00 (in 29.999504 seconds)
gcworker stdout | 2024-04-22 04:14:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:15:14 UTC)" (scheduled at 2024-04-22 04:14:44.952062+00:00)
gcworker stdout | 2024-04-22 04:14:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549684952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:14:44,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:14:44,964 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:14:44,964 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:15:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:14:45,653 [278] [DEBUG] [app] Starting request: urn:request:49e0d773-ef08-4906-b0a4-d0e24e914d24 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:14:45,653 [282] [DEBUG] [app] Starting request: urn:request:c88e9ed5-7546-4761-9e2f-4f11623d612e (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:14:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:14:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:14:45,656 [291] [DEBUG] [app] Starting request: urn:request:1001676f-7235-444b-b2d0-640bd70a9e9b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:14:45,656 [292] [DEBUG] [app] Starting request: urn:request:0748c512-ece3-45b5-8a98-76fc2d05b3b9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:14:45,656 [291] [DEBUG] [app] Ending request: urn:request:1001676f-7235-444b-b2d0-640bd70a9e9b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:1001676f-7235-444b-b2d0-640bd70a9e9b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:14:45,656 [292] [DEBUG] [app] Ending request: urn:request:0748c512-ece3-45b5-8a98-76fc2d05b3b9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:0748c512-ece3-45b5-8a98-76fc2d05b3b9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:14:45,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:14:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:14:45,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:14:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:14:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:14:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-web stdout | 2024-04-22 04:14:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:14:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:14:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:14:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:14:45,659 [282] [DEBUG] [app] Starting request: urn:request:7ca8ef20-6e5a-4fcc-801f-ddd06b999537 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:14:45,659 [282] [DEBUG] [app] Ending request: urn:request:7ca8ef20-6e5a-4fcc-801f-ddd06b999537 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:7ca8ef20-6e5a-4fcc-801f-ddd06b999537', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:14:45,659 [279] [DEBUG] [app] Starting request: urn:request:1cfa505b-1665-441c-a33b-2b7bd675bebe (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:14:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:14:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:14:45,660 [279] [DEBUG] [app] Ending request: urn:request:1cfa505b-1665-441c-a33b-2b7bd675bebe (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1cfa505b-1665-441c-a33b-2b7bd675bebe', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:14:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:14:45,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:14:45,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:14:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:14:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:14:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:14:45,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:14:45,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:14:45,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:14:45,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:14:45,674 [282] [DEBUG] [app] Ending request: urn:request:c88e9ed5-7546-4761-9e2f-4f11623d612e (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:c88e9ed5-7546-4761-9e2f-4f11623d612e', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:14:45,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:14:45,674 [278] [DEBUG] [app] Ending request: urn:request:49e0d773-ef08-4906-b0a4-d0e24e914d24 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:49e0d773-ef08-4906-b0a4-d0e24e914d24', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:14:45,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:14:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:14:45,674 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:14:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:14:45,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:14:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:14:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
quotatotalworker stdout | 2024-04-22 04:14:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:14:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:15:01.054492+00:00 (in 14.999480 seconds)
quotatotalworker stdout | 2024-04-22 04:14:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:15:01 UTC)" (scheduled at 2024-04-22 04:14:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:14:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:14:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:14:46,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:15:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:14:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:14:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:15:17.052354+00:00 (in 29.999447 seconds)
buildlogsarchiver stdout | 2024-04-22 04:14:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:15:17 UTC)" (scheduled at 2024-04-22 04:14:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:14:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 14, 47, 53266), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:14:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:14:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:14:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:15:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:14:50,669 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:14:52,022 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:14:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:14:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:15:03.759375+00:00 (in 9.999441 seconds)
notificationworker stdout | 2024-04-22 04:14:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:15:03 UTC)" (scheduled at 2024-04-22 04:14:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:14:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:14:53,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 14, 53, 760231), True, datetime.datetime(2024, 4, 22, 4, 14, 53, 760231), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:14:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:14:53,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:14:53,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:15:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:14:55,672 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:14:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:14:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:15:05.871852+00:00 (in 8.998260 seconds)
securityworker stdout | 2024-04-22 04:14:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:15:26 UTC)" (scheduled at 2024-04-22 04:14:56.873109+00:00)
securityworker stdout | 2024-04-22 04:14:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:14:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:14:56,875 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:14:56,875 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:14:56,875 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:14:56,875 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:14:56,876 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:14:56,878 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:14:56,879 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:14:56,889 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:14:56,891 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:14:56,891 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:14:56,892 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 9, 56, 879374), 1, 2])
securityworker stdout | 2024-04-22 04:14:56,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:14:56,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:14:56,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 9, 56, 879374), 1, 2])
securityworker stdout | 2024-04-22 04:14:56,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:14:56,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:14:56,897 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:14:56,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:14:56,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:14:56,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:14:56,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:14:56,898 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:14:56,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:14:56,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:15:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:14:57,454 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:14:58,676 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:14:58,710 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:15:00,269 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:15:00,278 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:15:00,289 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:15:00,316 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:15:00,319 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:15:00,653 [282] [DEBUG] [app] Starting request: urn:request:14ddfbc3-b5ab-47c8-b47a-b2fe1b438b5b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:15:00,653 [281] [DEBUG] [app] Starting request: urn:request:0471ecce-97d6-4d0d-8e41-2e4fcfd16c57 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:15:00,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:15:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:15:00,656 [284] [DEBUG] [app] Starting request: urn:request:c97ac3b2-39a0-4d04-9b8f-bac4357d8a8e (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:15:00,656 [291] [DEBUG] [app] Starting request: urn:request:3bbf031f-e323-435a-8b02-e09938b79d20 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:15:00,656 [284] [DEBUG] [app] Ending request: urn:request:c97ac3b2-39a0-4d04-9b8f-bac4357d8a8e (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:c97ac3b2-39a0-4d04-9b8f-bac4357d8a8e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:15:00,657 [291] [DEBUG] [app] Ending request: urn:request:3bbf031f-e323-435a-8b02-e09938b79d20 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:3bbf031f-e323-435a-8b02-e09938b79d20', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:15:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:15:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:15:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:15:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:15:00,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:15:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:15:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:15:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:15:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:15:00,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:15:00,659 [282] [DEBUG] [app] Starting request: urn:request:17231abb-1e03-48c5-acf2-8347654843a7 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:15:00,660 [278] [DEBUG] [app] Starting request: urn:request:34f83320-ec7e-476d-b958-49ae28e394ae (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:15:00,660 [282] [DEBUG] [app] Ending request: urn:request:17231abb-1e03-48c5-acf2-8347654843a7 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:17231abb-1e03-48c5-acf2-8347654843a7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:15:00,660 [278] [DEBUG] [app] Ending request: urn:request:34f83320-ec7e-476d-b958-49ae28e394ae (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:34f83320-ec7e-476d-b958-49ae28e394ae', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:15:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:15:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:15:00,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:15:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:15:00,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:15:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:15:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:15:00,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:15:00,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:15:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:15:00,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:15:00,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:15:00,674 [281] [DEBUG] [app] Ending request: urn:request:0471ecce-97d6-4d0d-8e41-2e4fcfd16c57 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:0471ecce-97d6-4d0d-8e41-2e4fcfd16c57', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:15:00,674 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:15:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:15:00,674 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:15:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:15:00,675 [282] [DEBUG] [app] Ending request: urn:request:14ddfbc3-b5ab-47c8-b47a-b2fe1b438b5b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:14ddfbc3-b5ab-47c8-b47a-b2fe1b438b5b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:15:00,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:15:00,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:15:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:15:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
teamsyncworker stdout | 2024-04-22 04:15:00,711 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:15:00,845 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotatotalworker stdout | 2024-04-22 04:15:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:15:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:15:16.054492+00:00 (in 14.999485 seconds)
quotatotalworker stdout | 2024-04-22 04:15:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:15:16 UTC)" (scheduled at 2024-04-22 04:15:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:15:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:15:01,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:15:01,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:15:16 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:15:01,681 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 04:15:02,376 [279] [DEBUG] [app] Starting request: urn:request:d6919952-5e12-4dfe-aa73-151446326cd2 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:15:02,376 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:15:02,376 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:15:02,377 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:15:02,385 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:15:02,386 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:15:02,386 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:15:02,386 [279] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:15:02,386 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:15:02,386 [279] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:15:02,386 [279] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:15:02,386 [279] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:15:02,388 [279] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:15:02,394 [279] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:15:02,395 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:15:02,399 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:15:02,403 [279] [DEBUG] [app] Ending request: urn:request:d6919952-5e12-4dfe-aa73-151446326cd2 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:d6919952-5e12-4dfe-aa73-151446326cd2', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:15:02,404 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:15:02,404 [279] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:15:02 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:15:02 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1536 0.030)
securityscanningnotificationworker stdout | 2024-04-22 04:15:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:15:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:15:16.552337+00:00 (in 13.995648 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:15:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:16:02 UTC)" (scheduled at 2024-04-22 04:15:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:15:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:15:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:16:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:15:03,211 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:15:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:15:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:15:13.759375+00:00 (in 9.999489 seconds)
notificationworker stdout | 2024-04-22 04:15:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:15:13 UTC)" (scheduled at 2024-04-22 04:15:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:15:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:15:03,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 15, 3, 760205), True, datetime.datetime(2024, 4, 22, 4, 15, 3, 760205), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:15:03,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:15:03,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:15:03,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:15:13 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:15:04,635 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:15:04,827 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
gunicorn-secscan stdout | 2024-04-22 04:15:04,843 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:15:04,849 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:15:04,852 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
exportactionlogsworker stdout | 2024-04-22 04:15:05,032 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:15:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:15:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:15:26.873109+00:00 (in 21.000721 seconds)
securityworker stdout | 2024-04-22 04:15:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:15:35 UTC)" (scheduled at 2024-04-22 04:15:05.871852+00:00)
securityworker stdout | 2024-04-22 04:15:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:15:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:15:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:15:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:15:05,884 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:15:05,884 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:15:35 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:15:06,157 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
repositorygcworker stdout | 2024-04-22 04:15:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:15:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:15:13.555667+00:00 (in 7.002664 seconds)
repositorygcworker stdout | 2024-04-22 04:15:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:16:06 UTC)" (scheduled at 2024-04-22 04:15:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:15:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:15:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 15, 6, 553418), True, datetime.datetime(2024, 4, 22, 4, 15, 6, 553418), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:15:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:15:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:15:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:16:06 UTC)" executed successfully
autopruneworker stdout | 2024-04-22 04:15:07,357 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:15:07,360 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:15:07,550 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:15:08,471 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:15:09,850 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:15:09,877 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:15:10,256 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:15:10,261 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:15:11,182 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:15:11,195 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:15:11,198 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:15:11,203 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:15:11,207 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:15:11,210 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:15:11,214 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:15:11,216 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:15:11,219 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
autopruneworker stdout | 2024-04-22 04:15:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:15:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:15:41.264267+00:00 (in 29.999539 seconds)
autopruneworker stdout | 2024-04-22 04:15:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:15:41 UTC)" (scheduled at 2024-04-22 04:15:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:15:11,271 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759251271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:15:11,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:15:11,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:15:11,275 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:15:41 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:15:11,614 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:15:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:15:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:16:06.552482+00:00 (in 52.996320 seconds)
repositorygcworker stdout | 2024-04-22 04:15:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:16:13 UTC)" (scheduled at 2024-04-22 04:15:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:15:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:15:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:16:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:15:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:15:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:15:19.762424+00:00 (in 6.002581 seconds)
notificationworker stdout | 2024-04-22 04:15:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:15:23 UTC)" (scheduled at 2024-04-22 04:15:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:15:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:15:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 15, 13, 760124), True, datetime.datetime(2024, 4, 22, 4, 15, 13, 760124), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:15:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:15:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:15:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:15:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:15:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:15:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:15:44.952062+00:00 (in 29.999487 seconds)
gcworker stdout | 2024-04-22 04:15:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:15:44 UTC)" (scheduled at 2024-04-22 04:15:14.952062+00:00)
gcworker stdout | 2024-04-22 04:15:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549714952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:15:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:15:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:15:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:15:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:15:15,653 [279] [DEBUG] [app] Starting request: urn:request:fbc81d30-a0d6-4849-be14-f7f0a0ddd63a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:15:15,653 [282] [DEBUG] [app] Starting request: urn:request:494e57fc-034a-4781-a9a2-74a26486247b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:15:15,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:15:15,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:15:15,656 [290] [DEBUG] [app] Starting request: urn:request:f57e0c63-7cf5-4328-a4f8-4e53ff80f5e8 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:15:15,656 [289] [DEBUG] [app] Starting request: urn:request:df855d86-5632-4d6e-8ca1-f1517427bf07 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:15:15,656 [290] [DEBUG] [app] Ending request: urn:request:f57e0c63-7cf5-4328-a4f8-4e53ff80f5e8 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f57e0c63-7cf5-4328-a4f8-4e53ff80f5e8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:15:15,657 [289] [DEBUG] [app] Ending request: urn:request:df855d86-5632-4d6e-8ca1-f1517427bf07 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:df855d86-5632-4d6e-8ca1-f1517427bf07', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:15:15,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:15:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:15:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:15:15,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:15:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:15:15,657 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:15:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:15:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:15:15,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:15:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:15:15,659 [278] [DEBUG] [app] Starting request: urn:request:b824d3c7-d49f-43ff-a7ec-10d3dc1b6f6c (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:15:15,660 [278] [DEBUG] [app] Ending request: urn:request:b824d3c7-d49f-43ff-a7ec-10d3dc1b6f6c (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b824d3c7-d49f-43ff-a7ec-10d3dc1b6f6c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:15:15,660 [281] [DEBUG] [app] Starting request: urn:request:ef1b980e-501d-4916-86a3-5db9fda54c4f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:15:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:15:15,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:15:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:15:15,660 [281] [DEBUG] [app] Ending request: urn:request:ef1b980e-501d-4916-86a3-5db9fda54c4f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:ef1b980e-501d-4916-86a3-5db9fda54c4f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:15:15,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:15:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:15:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:15:15,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:15:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:15:15,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:15:15,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:15:15,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:15:15,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:15:15,674 [282] [DEBUG] [app] Ending request: urn:request:494e57fc-034a-4781-a9a2-74a26486247b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:494e57fc-034a-4781-a9a2-74a26486247b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:15:15,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:15:15,674 [279] [DEBUG] [app] Ending request: urn:request:fbc81d30-a0d6-4849-be14-f7f0a0ddd63a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:fbc81d30-a0d6-4849-be14-f7f0a0ddd63a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:15:15,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:15:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:15:15,674 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:15:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:15:15,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:15:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:15:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotatotalworker stdout | 2024-04-22 04:15:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:15:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:15:31.054492+00:00 (in 14.999483 seconds)
quotatotalworker stdout | 2024-04-22 04:15:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:15:31 UTC)" (scheduled at 2024-04-22 04:15:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:15:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:15:16,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:15:16,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:15:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:15:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:15:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:16:02.556208+00:00 (in 46.003328 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:15:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:16:16 UTC)" (scheduled at 2024-04-22 04:15:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:15:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:15:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 15, 16, 553378), True, datetime.datetime(2024, 4, 22, 4, 15, 16, 553378), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:15:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:15:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:15:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:16:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:15:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:15:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:15:47.052354+00:00 (in 29.999455 seconds)
buildlogsarchiver stdout | 2024-04-22 04:15:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:15:47 UTC)" (scheduled at 2024-04-22 04:15:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:15:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 15, 17, 53253), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:15:17,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:15:17,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:15:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:15:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:15:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:15:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:15:23.759375+00:00 (in 3.996395 seconds)
notificationworker stdout | 2024-04-22 04:15:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:16:19 UTC)" (scheduled at 2024-04-22 04:15:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:15:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:15:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:16:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:15:20,702 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:15:22,033 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
namespacegcworker stdout | 2024-04-22 04:15:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:15:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:15:43.057186+00:00 (in 20.997683 seconds)
namespacegcworker stdout | 2024-04-22 04:15:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:16:22 UTC)" (scheduled at 2024-04-22 04:15:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:15:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:15:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:16:22 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:15:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:15:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:15:33.759375+00:00 (in 9.999518 seconds)
notificationworker stdout | 2024-04-22 04:15:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:15:33 UTC)" (scheduled at 2024-04-22 04:15:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:15:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:15:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 15, 23, 760158), True, datetime.datetime(2024, 4, 22, 4, 15, 23, 760158), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:15:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:15:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:15:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:15:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:15:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:15:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:16:24.361582+00:00 (in 59.999446 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:15:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:16:24 UTC)" (scheduled at 2024-04-22 04:15:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:15:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:15:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:15:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:16:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:15:25,682 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:15:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:15:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:15:35.871852+00:00 (in 8.998201 seconds)
securityworker stdout | 2024-04-22 04:15:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:15:56 UTC)" (scheduled at 2024-04-22 04:15:26.873109+00:00)
securityworker stdout | 2024-04-22 04:15:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:15:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:15:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:15:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:15:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:15:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:15:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:15:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:15:26,883 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:15:26,892 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:15:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:15:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:15:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 10, 26, 883100), 1, 2])
securityworker stdout | 2024-04-22 04:15:26,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:15:26,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:15:26,899 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 10, 26, 883100), 1, 2])
securityworker stdout | 2024-04-22 04:15:26,901 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:15:26,901 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:15:26,901 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:15:26,901 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:15:26,901 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:15:26,901 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:15:26,901 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:15:26,902 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:15:26,902 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:15:26,902 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:15:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:15:27,491 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:15:28,689 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:15:28,721 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:15:30,276 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:15:30,287 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:15:30,301 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:15:30,328 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:15:30,331 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:15:30,653 [281] [DEBUG] [app] Starting request: urn:request:466f9f20-228a-4d0a-be72-b5967727cadf (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:15:30,653 [279] [DEBUG] [app] Starting request: urn:request:c2c282d7-8a74-4734-9a13-fd0b983bc04e (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:15:30,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:15:30,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:15:30,656 [284] [DEBUG] [app] Starting request: urn:request:d0aa04b2-b9be-4329-8466-9dabbfdfb135 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:15:30,656 [291] [DEBUG] [app] Starting request: urn:request:9355f279-d3a1-4a40-9459-81fbb76a83c1 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:15:30,656 [284] [DEBUG] [app] Ending request: urn:request:d0aa04b2-b9be-4329-8466-9dabbfdfb135 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:d0aa04b2-b9be-4329-8466-9dabbfdfb135', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:15:30,657 [291] [DEBUG] [app] Ending request: urn:request:9355f279-d3a1-4a40-9459-81fbb76a83c1 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:9355f279-d3a1-4a40-9459-81fbb76a83c1', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:15:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:15:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:15:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:15:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:15:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:15:30,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:15:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:15:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:15:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:15:30,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:15:30,660 [278] [DEBUG] [app] Starting request: urn:request:173c5984-4808-4742-bc52-04e41e2ca68a (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:15:30,660 [282] [DEBUG] [app] Starting request: urn:request:6bcea936-f504-408e-8b8f-425981eaf4fc (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:15:30,660 [278] [DEBUG] [app] Ending request: urn:request:173c5984-4808-4742-bc52-04e41e2ca68a (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:173c5984-4808-4742-bc52-04e41e2ca68a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:15:30,660 [282] [DEBUG] [app] Ending request: urn:request:6bcea936-f504-408e-8b8f-425981eaf4fc (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:6bcea936-f504-408e-8b8f-425981eaf4fc', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:15:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:15:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:15:30,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:15:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:15:30,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:15:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:15:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:15:30,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:15:30,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:15:30,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:15:30,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:15:30,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:15:30,674 [281] [DEBUG] [app] Ending request: urn:request:466f9f20-228a-4d0a-be72-b5967727cadf (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:466f9f20-228a-4d0a-be72-b5967727cadf', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:15:30,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:15:30,675 [279] [DEBUG] [app] Ending request: urn:request:c2c282d7-8a74-4734-9a13-fd0b983bc04e (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:c2c282d7-8a74-4734-9a13-fd0b983bc04e', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:15:30,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:15:30,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:15:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:15:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:15:30,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:15:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:15:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
teamsyncworker stdout | 2024-04-22 04:15:30,718 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:15:30,879 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotatotalworker stdout | 2024-04-22 04:15:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:15:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:15:46.054492+00:00 (in 14.999466 seconds)
quotatotalworker stdout | 2024-04-22 04:15:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:15:46 UTC)" (scheduled at 2024-04-22 04:15:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:15:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:15:31,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:15:31,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:15:46 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:15:31,697 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 04:15:32,824 [282] [DEBUG] [app] Starting request: urn:request:713ce201-233a-493b-b48a-6848e150cc58 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:15:32,825 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:15:32,825 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:15:32,825 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:15:32,834 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:15:32,834 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:15:32,834 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:15:32,834 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:15:32,834 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:15:32,834 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:15:32,835 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:15:32,835 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:15:32,837 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:15:32,843 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:15:32,844 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:15:32,848 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:15:32,852 [282] [DEBUG] [app] Ending request: urn:request:713ce201-233a-493b-b48a-6848e150cc58 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:713ce201-233a-493b-b48a-6848e150cc58', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:15:32,852 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:15:32,853 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:15:32 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:15:32 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1555 0.030)
notificationworker stdout | 2024-04-22 04:15:33,247 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:15:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:15:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:15:43.759375+00:00 (in 9.999456 seconds)
notificationworker stdout | 2024-04-22 04:15:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:15:43 UTC)" (scheduled at 2024-04-22 04:15:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:15:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:15:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 15, 33, 760347), True, datetime.datetime(2024, 4, 22, 4, 15, 33, 760347), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:15:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:15:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:15:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:15:43 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:15:34,657 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:15:34,839 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
gunicorn-secscan stdout | 2024-04-22 04:15:34,851 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:15:34,856 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:15:34,859 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
exportactionlogsworker stdout | 2024-04-22 04:15:35,065 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:15:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:15:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:15:56.873109+00:00 (in 21.000706 seconds)
securityworker stdout | 2024-04-22 04:15:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:16:05 UTC)" (scheduled at 2024-04-22 04:15:35.871852+00:00)
securityworker stdout | 2024-04-22 04:15:35,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:15:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:15:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:15:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:15:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:15:35,887 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:15:35,890 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:15:35,890 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:15:35,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 10, 35, 876348), 1, 2])
securityworker stdout | 2024-04-22 04:15:35,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:15:35,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:15:35,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 10, 35, 876348), 1, 2])
securityworker stdout | 2024-04-22 04:15:35,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:15:35,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:15:35,895 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:15:35,895 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:16:05 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:15:36,168 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 04:15:37,378 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:15:37,392 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:15:37,586 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:15:38,494 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
exportactionlogsworker stdout | 2024-04-22 04:15:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:15:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:15:41.564959+00:00 (in 1.997421 seconds)
exportactionlogsworker stdout | 2024-04-22 04:15:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:16:39 UTC)" (scheduled at 2024-04-22 04:15:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:15:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:15:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:16:39 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:15:39,878 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:15:39,912 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 04:15:40,286 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:15:40,292 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
gunicorn-registry stdout | 2024-04-22 04:15:41,193 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:15:41,204 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:15:41,208 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:15:41,213 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:15:41,218 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:15:41,222 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:15:41,225 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:15:41,227 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:15:41,230 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
autopruneworker stdout | 2024-04-22 04:15:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:15:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:16:11.264267+00:00 (in 29.999463 seconds)
autopruneworker stdout | 2024-04-22 04:15:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:16:11 UTC)" (scheduled at 2024-04-22 04:15:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:15:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759281271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:15:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:15:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:15:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:16:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:15:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:15:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:16:39.566970+00:00 (in 58.001472 seconds)
exportactionlogsworker stdout | 2024-04-22 04:15:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:16:41 UTC)" (scheduled at 2024-04-22 04:15:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:15:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:15:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 15, 41, 565770), True, datetime.datetime(2024, 4, 22, 4, 15, 41, 565770), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:15:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:15:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:15:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:16:41 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:15:41,650 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
namespacegcworker stdout | 2024-04-22 04:15:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:15:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:16:22.058978+00:00 (in 39.001223 seconds)
namespacegcworker stdout | 2024-04-22 04:15:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:16:43 UTC)" (scheduled at 2024-04-22 04:15:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:15:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:15:43,059 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 15, 43, 58102), True, datetime.datetime(2024, 4, 22, 4, 15, 43, 58102), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:15:43,076 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:15:43,076 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:15:43,076 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:16:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:15:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:15:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:15:53.759375+00:00 (in 9.999499 seconds)
notificationworker stdout | 2024-04-22 04:15:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:15:53 UTC)" (scheduled at 2024-04-22 04:15:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:15:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:15:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 15, 43, 760155), True, datetime.datetime(2024, 4, 22, 4, 15, 43, 760155), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:15:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:15:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:15:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:15:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:15:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:15:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:16:14.952062+00:00 (in 29.999444 seconds)
gcworker stdout | 2024-04-22 04:15:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:16:14 UTC)" (scheduled at 2024-04-22 04:15:44.952062+00:00)
gcworker stdout | 2024-04-22 04:15:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549744952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:15:44,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:15:44,964 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:15:44,964 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:16:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:15:45,653 [282] [DEBUG] [app] Starting request: urn:request:46b62e9c-02e7-4b45-85b9-e0d1de195f46 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:15:45,653 [281] [DEBUG] [app] Starting request: urn:request:cb47f412-feaa-4413-b3d2-ff9b119fdb61 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:15:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:15:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:15:45,656 [290] [DEBUG] [app] Starting request: urn:request:b5103bb4-97cf-4eed-866e-a71eedf20adf (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:15:45,656 [291] [DEBUG] [app] Starting request: urn:request:68bc195e-8b17-49a7-a77e-f7f28ddc8486 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:15:45,656 [291] [DEBUG] [app] Ending request: urn:request:68bc195e-8b17-49a7-a77e-f7f28ddc8486 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:68bc195e-8b17-49a7-a77e-f7f28ddc8486', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:15:45,656 [290] [DEBUG] [app] Ending request: urn:request:b5103bb4-97cf-4eed-866e-a71eedf20adf (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b5103bb4-97cf-4eed-866e-a71eedf20adf', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:15:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:15:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:15:45,656 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:15:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:15:45,656 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:15:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:15:45,656 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:15:45,656 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:15:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:15:45,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:15:45,659 [278] [DEBUG] [app] Starting request: urn:request:e5597f65-ba2b-4134-8d0b-2d7e4ca2efbe (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:15:45,659 [279] [DEBUG] [app] Starting request: urn:request:49c41662-5b84-41cd-943d-bf3b17ae1f8e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:15:45,659 [278] [DEBUG] [app] Ending request: urn:request:e5597f65-ba2b-4134-8d0b-2d7e4ca2efbe (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e5597f65-ba2b-4134-8d0b-2d7e4ca2efbe', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:15:45,660 [279] [DEBUG] [app] Ending request: urn:request:49c41662-5b84-41cd-943d-bf3b17ae1f8e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:49c41662-5b84-41cd-943d-bf3b17ae1f8e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:15:45,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:15:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:15:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:15:45,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:15:45,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:15:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:15:45,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:15:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.001)
gunicorn-web stdout | 2024-04-22 04:15:45,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:15:45,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:15:45,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:15:45,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:15:45,673 [282] [DEBUG] [app] Ending request: urn:request:46b62e9c-02e7-4b45-85b9-e0d1de195f46 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:46b62e9c-02e7-4b45-85b9-e0d1de195f46', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:15:45,674 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:15:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:15:45,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:15:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:15:45,675 [281] [DEBUG] [app] Ending request: urn:request:cb47f412-feaa-4413-b3d2-ff9b119fdb61 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:cb47f412-feaa-4413-b3d2-ff9b119fdb61', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:15:45,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:15:45,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:15:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:15:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotatotalworker stdout | 2024-04-22 04:15:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:15:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:16:01.054492+00:00 (in 14.999468 seconds)
quotatotalworker stdout | 2024-04-22 04:15:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:16:01 UTC)" (scheduled at 2024-04-22 04:15:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:15:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:15:46,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:15:46,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:16:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:15:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:15:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:16:17.052354+00:00 (in 29.999484 seconds)
buildlogsarchiver stdout | 2024-04-22 04:15:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:16:17 UTC)" (scheduled at 2024-04-22 04:15:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:15:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 15, 47, 53228), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:15:47,075 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:15:47,075 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:15:47,075 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:16:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:15:50,739 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:15:52,069 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:15:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:15:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:16:03.759375+00:00 (in 9.999415 seconds)
notificationworker stdout | 2024-04-22 04:15:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:16:03 UTC)" (scheduled at 2024-04-22 04:15:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:15:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:15:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 15, 53, 760420), True, datetime.datetime(2024, 4, 22, 4, 15, 53, 760420), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:15:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:15:53,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:15:53,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:16:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:15:55,707 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:15:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:15:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:16:05.871852+00:00 (in 8.998233 seconds)
securityworker stdout | 2024-04-22 04:15:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:16:26 UTC)" (scheduled at 2024-04-22 04:15:56.873109+00:00)
securityworker stdout | 2024-04-22 04:15:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:15:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:15:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:15:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:15:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:15:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:15:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:15:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:15:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:15:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:15:56,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:15:56,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:15:56,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 10, 56, 880838), 1, 2])
securityworker stdout | 2024-04-22 04:15:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:15:56,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:15:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 10, 56, 880838), 1, 2])
securityworker stdout | 2024-04-22 04:15:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:15:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:15:56,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:15:56,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:15:56,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:15:56,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:15:56,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:15:56,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:15:56,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:15:56,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:16:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:15:57,518 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:15:58,708 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:15:58,745 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:16:00,284 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:16:00,297 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:16:00,314 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:16:00,340 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:16:00,342 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:16:00,653 [281] [DEBUG] [app] Starting request: urn:request:a6b5b2cf-b987-4b2d-b5d9-56650580976a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:16:00,653 [279] [DEBUG] [app] Starting request: urn:request:2c0f0c22-d87a-46ee-8230-52c4e12c3064 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:16:00,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:16:00,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:16:00,657 [284] [DEBUG] [app] Starting request: urn:request:d16a6f6e-5591-4089-a664-bae0873f4cc3 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:16:00,657 [290] [DEBUG] [app] Starting request: urn:request:d8e984fc-a226-4160-af25-6278d655e6b3 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:16:00,657 [290] [DEBUG] [app] Ending request: urn:request:d8e984fc-a226-4160-af25-6278d655e6b3 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:d8e984fc-a226-4160-af25-6278d655e6b3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:16:00,657 [284] [DEBUG] [app] Ending request: urn:request:d16a6f6e-5591-4089-a664-bae0873f4cc3 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:d16a6f6e-5591-4089-a664-bae0873f4cc3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:16:00,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:16:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:16:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:16:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:16:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:16:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:16:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:16:00,658 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:16:00,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:16:00,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:16:00,660 [278] [DEBUG] [app] Starting request: urn:request:5151321a-ae3b-4814-9195-3317aa3a7131 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:16:00,660 [282] [DEBUG] [app] Starting request: urn:request:bcdfc447-4522-43fe-8057-3a237adadc4d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:16:00,660 [278] [DEBUG] [app] Ending request: urn:request:5151321a-ae3b-4814-9195-3317aa3a7131 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:5151321a-ae3b-4814-9195-3317aa3a7131', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:16:00,660 [282] [DEBUG] [app] Ending request: urn:request:bcdfc447-4522-43fe-8057-3a237adadc4d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:bcdfc447-4522-43fe-8057-3a237adadc4d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:16:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:16:00,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:16:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:16:00,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:16:00,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:16:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:16:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:16:00,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:16:00,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:16:00,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:16:00,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:16:00,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:16:00,674 [281] [DEBUG] [app] Ending request: urn:request:a6b5b2cf-b987-4b2d-b5d9-56650580976a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a6b5b2cf-b987-4b2d-b5d9-56650580976a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:16:00,675 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:16:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.022)
gunicorn-web stdout | 2024-04-22 04:16:00,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:16:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:16:00,675 [279] [DEBUG] [app] Ending request: urn:request:2c0f0c22-d87a-46ee-8230-52c4e12c3064 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2c0f0c22-d87a-46ee-8230-52c4e12c3064', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:16:00,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:16:00,676 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:16:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:16:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
teamsyncworker stdout | 2024-04-22 04:16:00,753 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:16:00,889 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotatotalworker stdout | 2024-04-22 04:16:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:16:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:16:16.054492+00:00 (in 14.999466 seconds)
quotatotalworker stdout | 2024-04-22 04:16:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:16:16 UTC)" (scheduled at 2024-04-22 04:16:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:16:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:16:01,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:16:01,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:16:16 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:16:01,713 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:16:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:16:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:16:16.552337+00:00 (in 13.995526 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:16:02,557 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:17:02 UTC)" (scheduled at 2024-04-22 04:16:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:16:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:16:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:17:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:16:03,284 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:16:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:16:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:16:13.759375+00:00 (in 9.999483 seconds)
notificationworker stdout | 2024-04-22 04:16:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:16:13 UTC)" (scheduled at 2024-04-22 04:16:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:16:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:16:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 16, 3, 760313), True, datetime.datetime(2024, 4, 22, 4, 16, 3, 760313), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:16:03,777 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:16:03,777 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:16:03,777 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:16:13 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:16:03,958 [281] [DEBUG] [app] Starting request: urn:request:a2b567b8-266d-44cc-97c0-9ae44eeb4e85 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:16:03,958 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:16:03,958 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:16:03,959 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:16:03,968 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:16:03,968 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:16:03,968 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:16:03,968 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:16:03,968 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:16:03,968 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:16:03,968 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:16:03,968 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:16:03,971 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:16:03,977 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:16:03,978 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:16:03,983 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:16:03,987 [281] [DEBUG] [app] Ending request: urn:request:a2b567b8-266d-44cc-97c0-9ae44eeb4e85 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:a2b567b8-266d-44cc-97c0-9ae44eeb4e85', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:16:03,987 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:16:03,988 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:16:03 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:16:03 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.032 1536 0.032)
buildlogsarchiver stdout | 2024-04-22 04:16:04,693 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:16:04,857 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
gunicorn-secscan stdout | 2024-04-22 04:16:04,861 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:16:04,864 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:16:04,867 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
exportactionlogsworker stdout | 2024-04-22 04:16:05,098 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:16:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:16:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:16:26.873109+00:00 (in 21.000776 seconds)
securityworker stdout | 2024-04-22 04:16:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:16:35 UTC)" (scheduled at 2024-04-22 04:16:05.871852+00:00)
securityworker stdout | 2024-04-22 04:16:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:16:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:16:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:16:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:16:05,885 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:16:05,885 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:16:35 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:16:06,202 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
repositorygcworker stdout | 2024-04-22 04:16:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:16:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:16:13.555667+00:00 (in 7.002673 seconds)
repositorygcworker stdout | 2024-04-22 04:16:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:17:06 UTC)" (scheduled at 2024-04-22 04:16:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:16:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:16:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 16, 6, 553405), True, datetime.datetime(2024, 4, 22, 4, 16, 6, 553405), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:16:06,563 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:16:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:16:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:17:06 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:16:07,409 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:16:07,415 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:16:07,616 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:16:08,524 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:16:09,886 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:16:09,936 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 04:16:10,315 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:16:10,318 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
gunicorn-registry stdout | 2024-04-22 04:16:11,205 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:16:11,217 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:16:11,220 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:16:11,223 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:16:11,227 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:16:11,234 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:16:11,236 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:16:11,240 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:16:11,242 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
autopruneworker stdout | 2024-04-22 04:16:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:16:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:16:41.264267+00:00 (in 29.999514 seconds)
autopruneworker stdout | 2024-04-22 04:16:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:16:41 UTC)" (scheduled at 2024-04-22 04:16:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:16:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759311271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:16:11,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:16:11,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:16:11,275 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:16:41 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:16:11,686 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:16:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:16:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:16:51.555445+00:00 (in 37.999301 seconds)
repositorygcworker stdout | 2024-04-22 04:16:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:17:13 UTC)" (scheduled at 2024-04-22 04:16:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:16:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:16:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:17:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:16:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:16:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:16:19.762424+00:00 (in 6.002597 seconds)
notificationworker stdout | 2024-04-22 04:16:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:16:23 UTC)" (scheduled at 2024-04-22 04:16:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:16:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:16:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 16, 13, 760192), True, datetime.datetime(2024, 4, 22, 4, 16, 13, 760192), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:16:13,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:16:13,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:16:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:16:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:16:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:16:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:16:44.952062+00:00 (in 29.999528 seconds)
gcworker stdout | 2024-04-22 04:16:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:16:44 UTC)" (scheduled at 2024-04-22 04:16:14.952062+00:00)
gcworker stdout | 2024-04-22 04:16:14,952 [68] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."removed_tag_expiration_s" FROM "user" AS "t1" LIMIT %s', [100])
gcworker stdout | 2024-04-22 04:16:14,962 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549774962, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:16:14,966 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:16:14,966 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:16:14,966 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:16:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:16:15,653 [281] [DEBUG] [app] Starting request: urn:request:be4cac56-f33e-4e22-b85a-8ac4117460c7 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:16:15,653 [279] [DEBUG] [app] Starting request: urn:request:896b8f39-9e8c-42cd-9664-64620cd470af (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:16:15,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:16:15,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:16:15,656 [284] [DEBUG] [app] Starting request: urn:request:d4482501-3d58-4442-b53d-d2460f677ec9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:16:15,656 [292] [DEBUG] [app] Starting request: urn:request:2e578673-27df-448a-98cf-94ed4fd8a364 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:16:15,656 [284] [DEBUG] [app] Ending request: urn:request:d4482501-3d58-4442-b53d-d2460f677ec9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:d4482501-3d58-4442-b53d-d2460f677ec9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:16:15,657 [292] [DEBUG] [app] Ending request: urn:request:2e578673-27df-448a-98cf-94ed4fd8a364 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:2e578673-27df-448a-98cf-94ed4fd8a364', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:16:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:16:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:16:15,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:16:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:16:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:16:15,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:16:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:16:15,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:16:15,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:16:15,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:16:15,659 [278] [DEBUG] [app] Starting request: urn:request:1f2fdc36-e67e-49c5-9a30-86cde7fb8d55 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:16:15,660 [278] [DEBUG] [app] Ending request: urn:request:1f2fdc36-e67e-49c5-9a30-86cde7fb8d55 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1f2fdc36-e67e-49c5-9a30-86cde7fb8d55', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:16:15,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:16:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:16:15,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:16:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:16:15,660 [281] [DEBUG] [app] Starting request: urn:request:b76593a8-ec98-40d9-b4f0-3d6c04a3b3ba (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:16:15,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:16:15,661 [281] [DEBUG] [app] Ending request: urn:request:b76593a8-ec98-40d9-b4f0-3d6c04a3b3ba (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b76593a8-ec98-40d9-b4f0-3d6c04a3b3ba', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:16:15,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:16:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:16:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:16:15,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:16:15,662 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:16:15,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:16:15,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:16:15,674 [279] [DEBUG] [app] Ending request: urn:request:896b8f39-9e8c-42cd-9664-64620cd470af (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:896b8f39-9e8c-42cd-9664-64620cd470af', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:16:15,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:16:15,674 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:16:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:16:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:16:15,675 [281] [DEBUG] [app] Ending request: urn:request:be4cac56-f33e-4e22-b85a-8ac4117460c7 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:be4cac56-f33e-4e22-b85a-8ac4117460c7', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:16:15,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:16:15,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:16:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:16:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotatotalworker stdout | 2024-04-22 04:16:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:16:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:16:31.054492+00:00 (in 14.999484 seconds)
quotatotalworker stdout | 2024-04-22 04:16:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:16:31 UTC)" (scheduled at 2024-04-22 04:16:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:16:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:16:16,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:16:16,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:16:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:16:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:16:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:17:02.556208+00:00 (in 46.003407 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:16:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:17:16 UTC)" (scheduled at 2024-04-22 04:16:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:16:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:16:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 16, 16, 553242), True, datetime.datetime(2024, 4, 22, 4, 16, 16, 553242), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:16:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:16:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:16:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:17:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:16:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:16:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:16:47.052354+00:00 (in 29.999447 seconds)
buildlogsarchiver stdout | 2024-04-22 04:16:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:16:47 UTC)" (scheduled at 2024-04-22 04:16:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:16:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 16, 17, 53276), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:16:17,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:16:17,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:16:17,063 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:16:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:16:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:16:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:16:23.759375+00:00 (in 3.996460 seconds)
notificationworker stdout | 2024-04-22 04:16:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:17:19 UTC)" (scheduled at 2024-04-22 04:16:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:16:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:16:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:17:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:16:20,776 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
namespacegcworker stdout | 2024-04-22 04:16:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:16:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:16:43.057186+00:00 (in 20.997679 seconds)
namespacegcworker stdout | 2024-04-22 04:16:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:17:22 UTC)" (scheduled at 2024-04-22 04:16:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:16:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:16:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:17:22 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:16:22,106 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:16:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:16:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:16:33.759375+00:00 (in 9.999462 seconds)
notificationworker stdout | 2024-04-22 04:16:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:16:33 UTC)" (scheduled at 2024-04-22 04:16:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:16:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:16:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 16, 23, 760372), True, datetime.datetime(2024, 4, 22, 4, 16, 23, 760372), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:16:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:16:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:16:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:16:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:16:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:16:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:17:24.361582+00:00 (in 59.999484 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:16:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:17:24 UTC)" (scheduled at 2024-04-22 04:16:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:16:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:16:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:16:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:17:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:16:25,727 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:16:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:16:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:16:35.871852+00:00 (in 8.998186 seconds)
securityworker stdout | 2024-04-22 04:16:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:16:56 UTC)" (scheduled at 2024-04-22 04:16:26.873109+00:00)
securityworker stdout | 2024-04-22 04:16:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:16:26,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:16:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:16:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:16:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:16:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:16:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:16:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:16:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:16:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:16:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:16:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:16:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 11, 26, 881065), 1, 2])
securityworker stdout | 2024-04-22 04:16:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:16:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:16:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 11, 26, 881065), 1, 2])
securityworker stdout | 2024-04-22 04:16:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:16:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:16:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:16:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:16:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:16:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:16:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:16:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:16:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:16:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:16:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:16:27,527 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:16:28,744 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:16:28,781 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:16:30,292 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:16:30,306 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:16:30,325 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:16:30,352 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:16:30,356 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:16:30,653 [281] [DEBUG] [app] Starting request: urn:request:ab81233d-03de-44a3-b437-a53baf6e1239 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:16:30,653 [282] [DEBUG] [app] Starting request: urn:request:2bf27d00-8169-4375-b9b1-c36e71ae2379 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:16:30,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:16:30,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:16:30,656 [290] [DEBUG] [app] Starting request: urn:request:bb84db39-be7c-4cbb-a9b5-141ebe30b00a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:16:30,656 [284] [DEBUG] [app] Starting request: urn:request:16375855-39d1-40da-8bc2-88cd4d362f32 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:16:30,656 [290] [DEBUG] [app] Ending request: urn:request:bb84db39-be7c-4cbb-a9b5-141ebe30b00a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:bb84db39-be7c-4cbb-a9b5-141ebe30b00a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:16:30,656 [284] [DEBUG] [app] Ending request: urn:request:16375855-39d1-40da-8bc2-88cd4d362f32 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:16375855-39d1-40da-8bc2-88cd4d362f32', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:16:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:16:30,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:16:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:16:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:16:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:16:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:16:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:16:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:16:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:16:30,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:16:30,659 [281] [DEBUG] [app] Starting request: urn:request:19098aac-c1eb-4be7-8ff1-ebc04acdf12f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:16:30,659 [281] [DEBUG] [app] Ending request: urn:request:19098aac-c1eb-4be7-8ff1-ebc04acdf12f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:19098aac-c1eb-4be7-8ff1-ebc04acdf12f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:16:30,660 [278] [DEBUG] [app] Starting request: urn:request:59aca0b2-8a21-43a7-bfb6-be67cf5d2955 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:16:30,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:16:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:16:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:16:30,660 [278] [DEBUG] [app] Ending request: urn:request:59aca0b2-8a21-43a7-bfb6-be67cf5d2955 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:59aca0b2-8a21-43a7-bfb6-be67cf5d2955', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:16:30,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:16:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:16:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:16:30,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:16:30,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:16:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:16:30,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:16:30,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:16:30,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:16:30,673 [282] [DEBUG] [app] Ending request: urn:request:2bf27d00-8169-4375-b9b1-c36e71ae2379 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2bf27d00-8169-4375-b9b1-c36e71ae2379', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:16:30,673 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:16:30,674 [281] [DEBUG] [app] Ending request: urn:request:ab81233d-03de-44a3-b437-a53baf6e1239 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:ab81233d-03de-44a3-b437-a53baf6e1239', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:16:30,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:16:30,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:16:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:16:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:16:30,674 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:16:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:16:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
teamsyncworker stdout | 2024-04-22 04:16:30,789 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:16:30,905 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotatotalworker stdout | 2024-04-22 04:16:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:16:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:16:46.054492+00:00 (in 14.999466 seconds)
quotatotalworker stdout | 2024-04-22 04:16:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:16:46 UTC)" (scheduled at 2024-04-22 04:16:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:16:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:16:31,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:16:31,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:16:46 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:16:31,729 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:16:33,321 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:16:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:16:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:16:43.759375+00:00 (in 9.999550 seconds)
notificationworker stdout | 2024-04-22 04:16:33,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:16:43 UTC)" (scheduled at 2024-04-22 04:16:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:16:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:16:33,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 16, 33, 760079), True, datetime.datetime(2024, 4, 22, 4, 16, 33, 760079), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:16:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:16:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:16:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:16:43 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:16:34,353 [279] [DEBUG] [app] Starting request: urn:request:677a130f-9c9e-4986-be36-f67979e93acc (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:16:34,353 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:16:34,353 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:16:34,354 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:16:34,363 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:16:34,363 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:16:34,363 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:16:34,363 [279] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:16:34,363 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:16:34,363 [279] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:16:34,363 [279] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:16:34,364 [279] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:16:34,366 [279] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:16:34,372 [279] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:16:34,373 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:16:34,377 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:16:34,381 [279] [DEBUG] [app] Ending request: urn:request:677a130f-9c9e-4986-be36-f67979e93acc (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:677a130f-9c9e-4986-be36-f67979e93acc', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:16:34,382 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:16:34,382 [279] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:16:34 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:16:34 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1555 0.030)
buildlogsarchiver stdout | 2024-04-22 04:16:34,720 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:16:34,867 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
gunicorn-secscan stdout | 2024-04-22 04:16:34,870 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:16:34,873 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:16:34,875 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
exportactionlogsworker stdout | 2024-04-22 04:16:35,110 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:16:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:16:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:16:56.873109+00:00 (in 21.000701 seconds)
securityworker stdout | 2024-04-22 04:16:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:17:05 UTC)" (scheduled at 2024-04-22 04:16:35.871852+00:00)
securityworker stdout | 2024-04-22 04:16:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:16:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:16:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:16:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:16:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:16:35,887 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:16:35,890 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:16:35,890 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:16:35,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 11, 35, 876246), 1, 2])
securityworker stdout | 2024-04-22 04:16:35,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:16:35,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:16:35,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 11, 35, 876246), 1, 2])
securityworker stdout | 2024-04-22 04:16:35,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:16:35,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:16:35,895 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:16:35,895 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:17:05 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:16:36,215 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
servicekey stdout | 2024-04-22 04:16:37,425 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
autopruneworker stdout | 2024-04-22 04:16:37,441 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
globalpromstats stdout | 2024-04-22 04:16:37,624 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:16:38,561 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
exportactionlogsworker stdout | 2024-04-22 04:16:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:16:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:16:41.564959+00:00 (in 1.997450 seconds)
exportactionlogsworker stdout | 2024-04-22 04:16:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:17:39 UTC)" (scheduled at 2024-04-22 04:16:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:16:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:16:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:17:39 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:16:39,921 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:16:39,970 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 04:16:40,340 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:16:40,352 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
gunicorn-registry stdout | 2024-04-22 04:16:41,215 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:16:41,231 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:16:41,234 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:16:41,237 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:16:41,240 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:16:41,244 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:16:41,248 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:16:41,251 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:16:41,254 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
autopruneworker stdout | 2024-04-22 04:16:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:16:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:17:11.264267+00:00 (in 29.999533 seconds)
autopruneworker stdout | 2024-04-22 04:16:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:17:11 UTC)" (scheduled at 2024-04-22 04:16:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:16:41,271 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759341270, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:16:41,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:16:41,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:16:41,275 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:17:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:16:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:16:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:16:53.566665+00:00 (in 12.001162 seconds)
exportactionlogsworker stdout | 2024-04-22 04:16:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:17:41 UTC)" (scheduled at 2024-04-22 04:16:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:16:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:16:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 16, 41, 565775), True, datetime.datetime(2024, 4, 22, 4, 16, 41, 565775), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:16:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:16:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:16:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:17:41 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:16:41,722 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
namespacegcworker stdout | 2024-04-22 04:16:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:16:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:17:22.058978+00:00 (in 39.001295 seconds)
namespacegcworker stdout | 2024-04-22 04:16:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:17:43 UTC)" (scheduled at 2024-04-22 04:16:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:16:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:16:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 16, 43, 57969), True, datetime.datetime(2024, 4, 22, 4, 16, 43, 57969), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:16:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:16:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:16:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:17:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:16:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:16:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:16:53.759375+00:00 (in 9.999527 seconds)
notificationworker stdout | 2024-04-22 04:16:43,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:16:53 UTC)" (scheduled at 2024-04-22 04:16:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:16:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:16:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 16, 43, 760129), True, datetime.datetime(2024, 4, 22, 4, 16, 43, 760129), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:16:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:16:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:16:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:16:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:16:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:16:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:17:14.952062+00:00 (in 29.999495 seconds)
gcworker stdout | 2024-04-22 04:16:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:17:14 UTC)" (scheduled at 2024-04-22 04:16:44.952062+00:00)
gcworker stdout | 2024-04-22 04:16:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549804952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:16:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:16:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:16:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:17:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:16:45,653 [278] [DEBUG] [app] Starting request: urn:request:c6d3529c-a961-4d99-94bb-3baa82e80955 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:16:45,653 [282] [DEBUG] [app] Starting request: urn:request:f8dc4fd4-667f-4622-a690-19c869f937df (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:16:45,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:16:45,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:16:45,656 [291] [DEBUG] [app] Starting request: urn:request:0fe4dec5-37ab-4a62-a7af-8d0647f1775f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:16:45,657 [292] [DEBUG] [app] Starting request: urn:request:45395ee7-0070-4cf3-9bc1-85d726eaa8e5 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:16:45,657 [291] [DEBUG] [app] Ending request: urn:request:0fe4dec5-37ab-4a62-a7af-8d0647f1775f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:0fe4dec5-37ab-4a62-a7af-8d0647f1775f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:16:45,657 [292] [DEBUG] [app] Ending request: urn:request:45395ee7-0070-4cf3-9bc1-85d726eaa8e5 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:45395ee7-0070-4cf3-9bc1-85d726eaa8e5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:16:45,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:16:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:16:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:16:45,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:16:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:16:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:16:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:16:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:16:45,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:16:45,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:16:45,660 [281] [DEBUG] [app] Starting request: urn:request:8ff4de1d-747d-4609-a8ac-21afa31da16c (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:16:45,660 [281] [DEBUG] [app] Ending request: urn:request:8ff4de1d-747d-4609-a8ac-21afa31da16c (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:8ff4de1d-747d-4609-a8ac-21afa31da16c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:16:45,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:16:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:16:45,661 [282] [DEBUG] [app] Starting request: urn:request:eefc220b-ca84-452e-a338-f974f90d44c5 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:16:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:16:45,661 [282] [DEBUG] [app] Ending request: urn:request:eefc220b-ca84-452e-a338-f974f90d44c5 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:eefc220b-ca84-452e-a338-f974f90d44c5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:16:45,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:16:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:16:45,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:16:45,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:16:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:16:45,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:16:45,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:16:45,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:16:45,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:16:45,675 [282] [DEBUG] [app] Ending request: urn:request:f8dc4fd4-667f-4622-a690-19c869f937df (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f8dc4fd4-667f-4622-a690-19c869f937df', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:16:45,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:16:45,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:16:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:16:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:16:45,676 [278] [DEBUG] [app] Ending request: urn:request:c6d3529c-a961-4d99-94bb-3baa82e80955 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:c6d3529c-a961-4d99-94bb-3baa82e80955', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:16:45,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:16:45,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:16:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:16:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
quotatotalworker stdout | 2024-04-22 04:16:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:16:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:17:01.054492+00:00 (in 14.999478 seconds)
quotatotalworker stdout | 2024-04-22 04:16:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:17:01 UTC)" (scheduled at 2024-04-22 04:16:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:16:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:16:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:16:46,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:17:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:16:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:16:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:17:17.052354+00:00 (in 29.999437 seconds)
buildlogsarchiver stdout | 2024-04-22 04:16:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:17:17 UTC)" (scheduled at 2024-04-22 04:16:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:16:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 16, 47, 53316), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:16:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:16:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:16:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:17:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:16:50,813 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
repositorygcworker stdout | 2024-04-22 04:16:51,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:16:51,555 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:17:06.552482+00:00 (in 14.996533 seconds)
repositorygcworker stdout | 2024-04-22 04:16:51,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:21:51 UTC)" (scheduled at 2024-04-22 04:16:51.555445+00:00)
repositorygcworker stdout | 2024-04-22 04:16:51,556 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 16, 51, 556324), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 04:16:51,566 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 16, 51, 556324), True, datetime.datetime(2024, 4, 22, 4, 16, 51, 556324), 0, 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 04:16:51,569 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 16, 51, 556324), True, datetime.datetime(2024, 4, 22, 4, 16, 51, 556324), 0, 'repositorygc/%', False, datetime.datetime(2024, 4, 22, 4, 16, 51, 556324), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 04:16:51,571 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:16:51,571 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:21:51 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:16:52,113 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
exportactionlogsworker stdout | 2024-04-22 04:16:53,566 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:16:53,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:17:39.566970+00:00 (in 45.999804 seconds)
exportactionlogsworker stdout | 2024-04-22 04:16:53,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:21:53 UTC)" (scheduled at 2024-04-22 04:16:53.566665+00:00)
exportactionlogsworker stdout | 2024-04-22 04:16:53,567 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 16, 53, 567401), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 04:16:53,577 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 16, 53, 567401), True, datetime.datetime(2024, 4, 22, 4, 16, 53, 567401), 0, 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 04:16:53,580 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 16, 53, 567401), True, datetime.datetime(2024, 4, 22, 4, 16, 53, 567401), 0, 'exportactionlogs/%', False, datetime.datetime(2024, 4, 22, 4, 16, 53, 567401), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 04:16:53,582 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:16:53,582 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:21:53 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:16:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:16:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:17:03.759375+00:00 (in 9.999409 seconds)
notificationworker stdout | 2024-04-22 04:16:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:17:03 UTC)" (scheduled at 2024-04-22 04:16:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:16:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:16:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 16, 53, 760450), True, datetime.datetime(2024, 4, 22, 4, 16, 53, 760450), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:16:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:16:53,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:16:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:17:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:16:55,764 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:16:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:16:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:17:05.871852+00:00 (in 8.998207 seconds)
securityworker stdout | 2024-04-22 04:16:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:17:26 UTC)" (scheduled at 2024-04-22 04:16:56.873109+00:00)
securityworker stdout | 2024-04-22 04:16:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:16:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:16:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:16:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:16:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:16:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:16:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:16:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:16:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:16:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:16:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:16:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:16:56,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 11, 56, 881179), 1, 2])
securityworker stdout | 2024-04-22 04:16:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:16:56,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:16:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 11, 56, 881179), 1, 2])
securityworker stdout | 2024-04-22 04:16:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:16:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:16:56,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:16:56,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:16:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:16:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:16:56,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:16:56,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:16:56,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:16:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:17:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:16:57,562 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:16:58,781 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:16:58,818 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:17:00,301 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:17:00,316 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:17:00,337 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:17:00,363 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:17:00,366 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:17:00,653 [281] [DEBUG] [app] Starting request: urn:request:bc6b6890-9301-46d9-83ae-50a0095f93f9 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:17:00,653 [279] [DEBUG] [app] Starting request: urn:request:286bb4b8-93d3-4d83-b53d-aff5e5073b4f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:17:00,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:17:00,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:17:00,656 [284] [DEBUG] [app] Starting request: urn:request:04c21499-afa5-4bf9-93b4-9b313f73f8b9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:17:00,656 [292] [DEBUG] [app] Starting request: urn:request:2c7f605c-f7c2-455a-a5cd-a3bb834ca880 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:17:00,656 [284] [DEBUG] [app] Ending request: urn:request:04c21499-afa5-4bf9-93b4-9b313f73f8b9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:04c21499-afa5-4bf9-93b4-9b313f73f8b9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:17:00,656 [292] [DEBUG] [app] Ending request: urn:request:2c7f605c-f7c2-455a-a5cd-a3bb834ca880 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:2c7f605c-f7c2-455a-a5cd-a3bb834ca880', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:17:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:17:00,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:17:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:17:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:17:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:17:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:17:00,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:17:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-web stdout | 2024-04-22 04:17:00,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:17:00,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:17:00,659 [281] [DEBUG] [app] Starting request: urn:request:37e12441-2006-4962-877b-78727da6c437 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:17:00,659 [281] [DEBUG] [app] Ending request: urn:request:37e12441-2006-4962-877b-78727da6c437 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:37e12441-2006-4962-877b-78727da6c437', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:17:00,659 [278] [DEBUG] [app] Starting request: urn:request:6df40d81-6a86-4ffd-94d6-7f588c9f070d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:17:00,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:17:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:17:00,660 [278] [DEBUG] [app] Ending request: urn:request:6df40d81-6a86-4ffd-94d6-7f588c9f070d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:6df40d81-6a86-4ffd-94d6-7f588c9f070d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:17:00,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:17:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:17:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:17:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:17:00,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:17:00,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:17:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.001)
gunicorn-web stdout | 2024-04-22 04:17:00,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:17:00,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:17:00,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:17:00,673 [279] [DEBUG] [app] Ending request: urn:request:286bb4b8-93d3-4d83-b53d-aff5e5073b4f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:286bb4b8-93d3-4d83-b53d-aff5e5073b4f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:17:00,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:17:00,674 [281] [DEBUG] [app] Ending request: urn:request:bc6b6890-9301-46d9-83ae-50a0095f93f9 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:bc6b6890-9301-46d9-83ae-50a0095f93f9', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:17:00,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:17:00,674 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:17:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:17:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:17:00,674 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:17:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:17:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
teamsyncworker stdout | 2024-04-22 04:17:00,798 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:17:00,926 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotatotalworker stdout | 2024-04-22 04:17:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:17:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:17:16.054492+00:00 (in 14.999468 seconds)
quotatotalworker stdout | 2024-04-22 04:17:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:17:16 UTC)" (scheduled at 2024-04-22 04:17:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:17:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:17:01,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:17:01,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:17:16 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:17:01,748 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:17:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:17:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:17:16.552337+00:00 (in 13.995608 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:17:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:18:02 UTC)" (scheduled at 2024-04-22 04:17:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:17:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:17:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:18:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:17:03,354 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:17:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:17:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:17:13.759375+00:00 (in 9.999454 seconds)
notificationworker stdout | 2024-04-22 04:17:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:17:13 UTC)" (scheduled at 2024-04-22 04:17:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:17:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:17:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 17, 3, 760392), True, datetime.datetime(2024, 4, 22, 4, 17, 3, 760392), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:17:03,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:17:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:17:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:17:13 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:17:04,286 [282] [DEBUG] [app] Starting request: urn:request:7383dffe-1584-462b-afcb-9ff711ce22b5 (/api/v1/user/notifications) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:17:04,287 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:17:04,287 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:17:04,287 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:17:04,297 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:17:04,297 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:17:04,297 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:17:04,297 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:17:04,297 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:17:04,297 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:17:04,297 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:17:04,297 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:17:04,299 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."dismissed" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."dismissed" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', [False, 1, False, 1, 'admin', 6])
gunicorn-web stdout | 2024-04-22 04:17:04,304 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:17:04,306 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:17:04,309 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:17:04,311 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:17:04,313 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:17:04,315 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:17:04,317 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:17:04,319 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:17:04,321 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:17:04,323 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:17:04,325 [282] [DEBUG] [app] Ending request: urn:request:7383dffe-1584-462b-afcb-9ff711ce22b5 (/api/v1/user/notifications) {'endpoint': 'api.usernotificationlist', 'request_id': 'urn:request:7383dffe-1584-462b-afcb-9ff711ce22b5', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/notifications', 'path': '/api/v1/user/notifications', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:17:04,326 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:17:04,326 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:17:04 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 3556 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:17:04 +0000] "GET /api/v1/user/notifications HTTP/1.1" 200 3556 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.041 1511 0.041)
gunicorn-web stdout | 2024-04-22 04:17:04,550 [278] [DEBUG] [app] Starting request: urn:request:a1ec6873-7581-4350-b936-d9b1c13c0b6a (/api/v1/user/apptoken) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:17:04,550 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:17:04,550 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:17:04,551 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:17:04,560 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:17:04,560 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:17:04,560 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:17:04,560 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:17:04,560 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:17:04,560 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:17:04,560 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:17:04,560 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:17:04,561 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."uuid", "t1"."title", "t1"."token_name", "t1"."token_secret", "t1"."created", "t1"."expiration", "t1"."last_accessed" FROM "appspecificauthtoken" AS "t1" WHERE ((("t1"."user_id" = %s) AND ("t1"."expiration" <= %s)) AND ("t1"."expiration" > %s))', [1, datetime.datetime(2024, 4, 24, 23, 29, 4, 561076), datetime.datetime(2024, 4, 22, 4, 17, 4, 561113)])
gunicorn-web stdout | 2024-04-22 04:17:04,563 [278] [DEBUG] [app] Ending request: urn:request:a1ec6873-7581-4350-b936-d9b1c13c0b6a (/api/v1/user/apptoken) {'endpoint': 'api.apptokens', 'request_id': 'urn:request:a1ec6873-7581-4350-b936-d9b1c13c0b6a', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/apptoken?expiring=true', 'path': '/api/v1/user/apptoken', 'parameters': {'expiring': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:17:04,564 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:17:04 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.1" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.015 1520 0.015)
gunicorn-web stdout | 2024-04-22 04:17:04,564 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:17:04 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
buildlogsarchiver stdout | 2024-04-22 04:17:04,750 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gunicorn-web stdout | 2024-04-22 04:17:04,759 [281] [DEBUG] [app] Starting request: urn:request:f7e4a1ac-3e18-4635-a561-160ef33fd82d (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:17:04,760 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:17:04,760 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:17:04,760 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:17:04,770 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:17:04,770 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:17:04,770 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:17:04,770 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:17:04,770 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:17:04,770 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:17:04,770 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:17:04,770 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:17:04,773 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:17:04,779 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:17:04,780 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:17:04,784 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:17:04,788 [281] [DEBUG] [app] Ending request: urn:request:f7e4a1ac-3e18-4635-a561-160ef33fd82d (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:f7e4a1ac-3e18-4635-a561-160ef33fd82d', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:17:04,788 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:17:04 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.031 1536 0.031)
gunicorn-web stdout | 2024-04-22 04:17:04,789 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:17:04 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-secscan stdout | 2024-04-22 04:17:04,878 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:17:04,880 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gcworker stdout | 2024-04-22 04:17:04,884 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
gunicorn-secscan stdout | 2024-04-22 04:17:04,887 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
exportactionlogsworker stdout | 2024-04-22 04:17:05,124 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:17:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:17:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:17:26.873109+00:00 (in 21.000732 seconds)
securityworker stdout | 2024-04-22 04:17:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:17:35 UTC)" (scheduled at 2024-04-22 04:17:05.871852+00:00)
securityworker stdout | 2024-04-22 04:17:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:17:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:17:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:17:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:17:05,885 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:17:05,885 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:17:35 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:17:06,251 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
repositorygcworker stdout | 2024-04-22 04:17:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:17:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:17:13.555667+00:00 (in 7.002586 seconds)
repositorygcworker stdout | 2024-04-22 04:17:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:18:06 UTC)" (scheduled at 2024-04-22 04:17:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:17:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:17:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 17, 6, 553524), True, datetime.datetime(2024, 4, 22, 4, 17, 6, 553524), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:17:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:17:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:17:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:18:06 UTC)" executed successfully
autopruneworker stdout | 2024-04-22 04:17:07,453 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:17:07,462 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:17:07,656 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:17:08,597 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:17:09,958 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:17:10,000 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 04:17:10,377 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:17:10,387 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
gunicorn-registry stdout | 2024-04-22 04:17:11,226 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:17:11,240 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:17:11,245 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:17:11,248 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:17:11,251 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:17:11,255 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:17:11,258 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:17:11,260 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:17:11,263 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
autopruneworker stdout | 2024-04-22 04:17:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:17:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:17:41.264267+00:00 (in 29.999577 seconds)
autopruneworker stdout | 2024-04-22 04:17:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:17:41 UTC)" (scheduled at 2024-04-22 04:17:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:17:11,271 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759371271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:17:11,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:17:11,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:17:11,275 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:17:41 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:17:11,759 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:17:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:17:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:18:06.552482+00:00 (in 52.996320 seconds)
repositorygcworker stdout | 2024-04-22 04:17:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:18:13 UTC)" (scheduled at 2024-04-22 04:17:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:17:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:17:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:18:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:17:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:17:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:17:19.762424+00:00 (in 6.002533 seconds)
notificationworker stdout | 2024-04-22 04:17:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:17:23 UTC)" (scheduled at 2024-04-22 04:17:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:17:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:17:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 17, 13, 760248), True, datetime.datetime(2024, 4, 22, 4, 17, 13, 760248), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:17:13,777 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:17:13,777 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:17:13,777 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:17:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:17:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:17:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:17:44.952062+00:00 (in 29.999535 seconds)
gcworker stdout | 2024-04-22 04:17:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:17:44 UTC)" (scheduled at 2024-04-22 04:17:14.952062+00:00)
gcworker stdout | 2024-04-22 04:17:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549834952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:17:14,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:17:14,964 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:17:14,964 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:17:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:17:15,653 [279] [DEBUG] [app] Starting request: urn:request:cd82a2e8-37dd-4ac6-a014-c01a8a59ea73 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:17:15,653 [282] [DEBUG] [app] Starting request: urn:request:b4447603-a1f0-4e4e-8296-ee9ac4d392d5 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:17:15,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:17:15,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:17:15,656 [284] [DEBUG] [app] Starting request: urn:request:33c68779-7986-4505-8654-4afdcbaeee65 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:17:15,656 [291] [DEBUG] [app] Starting request: urn:request:362d1c54-9f99-4471-980a-755f60189829 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:17:15,656 [284] [DEBUG] [app] Ending request: urn:request:33c68779-7986-4505-8654-4afdcbaeee65 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:33c68779-7986-4505-8654-4afdcbaeee65', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:17:15,656 [291] [DEBUG] [app] Ending request: urn:request:362d1c54-9f99-4471-980a-755f60189829 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:362d1c54-9f99-4471-980a-755f60189829', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:17:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:17:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:17:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:17:15,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:17:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:17:15,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:17:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:17:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:17:15,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:17:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:17:15,659 [278] [DEBUG] [app] Starting request: urn:request:5e597371-927b-4af8-a95b-71121dc3a125 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:17:15,659 [281] [DEBUG] [app] Starting request: urn:request:da433989-c691-4efd-a060-c4b9e9d52a4a (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:17:15,660 [278] [DEBUG] [app] Ending request: urn:request:5e597371-927b-4af8-a95b-71121dc3a125 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:5e597371-927b-4af8-a95b-71121dc3a125', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:17:15,660 [281] [DEBUG] [app] Ending request: urn:request:da433989-c691-4efd-a060-c4b9e9d52a4a (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:da433989-c691-4efd-a060-c4b9e9d52a4a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:17:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:17:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:17:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:17:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:17:15,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:17:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:17:15,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:17:15,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:17:15,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:17:15,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:17:15,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:17:15,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:17:15,674 [279] [DEBUG] [app] Ending request: urn:request:cd82a2e8-37dd-4ac6-a014-c01a8a59ea73 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:cd82a2e8-37dd-4ac6-a014-c01a8a59ea73', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:17:15,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:17:15,674 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:17:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:17:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:17:15,675 [282] [DEBUG] [app] Ending request: urn:request:b4447603-a1f0-4e4e-8296-ee9ac4d392d5 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b4447603-a1f0-4e4e-8296-ee9ac4d392d5', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:17:15,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:17:15,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:17:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:17:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotatotalworker stdout | 2024-04-22 04:17:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:17:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:17:31.054492+00:00 (in 14.999469 seconds)
quotatotalworker stdout | 2024-04-22 04:17:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:17:31 UTC)" (scheduled at 2024-04-22 04:17:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:17:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:17:16,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:17:16,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:17:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:17:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:17:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:17:21.555879+00:00 (in 5.002944 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:17:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:18:16 UTC)" (scheduled at 2024-04-22 04:17:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:17:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:17:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 17, 16, 553365), True, datetime.datetime(2024, 4, 22, 4, 17, 16, 553365), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:17:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:17:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:17:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:18:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:17:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:17:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:17:47.052354+00:00 (in 29.999464 seconds)
buildlogsarchiver stdout | 2024-04-22 04:17:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:17:47 UTC)" (scheduled at 2024-04-22 04:17:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:17:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 17, 17, 53246), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:17:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:17:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:17:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:17:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:17:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:17:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:17:23.759375+00:00 (in 3.996458 seconds)
notificationworker stdout | 2024-04-22 04:17:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:18:19 UTC)" (scheduled at 2024-04-22 04:17:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:17:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:17:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:18:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:17:20,827 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:17:21,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:17:21,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:18:02.556208+00:00 (in 40.999815 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:17:21,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:22:21 UTC)" (scheduled at 2024-04-22 04:17:21.555879+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:17:21,557 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 17, 21, 556775), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 04:17:21,567 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 17, 21, 556775), True, datetime.datetime(2024, 4, 22, 4, 17, 21, 556775), 0, 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 04:17:21,569 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 17, 21, 556775), True, datetime.datetime(2024, 4, 22, 4, 17, 21, 556775), 0, 'secscanv4/%', False, datetime.datetime(2024, 4, 22, 4, 17, 21, 556775), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 04:17:21,571 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:17:21,572 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:22:21 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:17:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:17:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:17:38.058708+00:00 (in 15.999209 seconds)
namespacegcworker stdout | 2024-04-22 04:17:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:18:22 UTC)" (scheduled at 2024-04-22 04:17:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:17:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:17:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:18:22 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:17:22,130 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:17:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:17:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:17:33.759375+00:00 (in 9.999439 seconds)
notificationworker stdout | 2024-04-22 04:17:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:17:33 UTC)" (scheduled at 2024-04-22 04:17:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:17:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:17:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 17, 23, 760389), True, datetime.datetime(2024, 4, 22, 4, 17, 23, 760389), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:17:23,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:17:23,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:17:23,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:17:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:17:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:17:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:18:24.361582+00:00 (in 59.999452 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:17:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:18:24 UTC)" (scheduled at 2024-04-22 04:17:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:17:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:17:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:17:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:18:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:17:25,800 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:17:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:17:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:17:35.871852+00:00 (in 8.998175 seconds)
securityworker stdout | 2024-04-22 04:17:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:17:56 UTC)" (scheduled at 2024-04-22 04:17:26.873109+00:00)
securityworker stdout | 2024-04-22 04:17:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:17:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:17:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:17:26,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:17:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:17:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:17:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:17:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:17:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:17:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:17:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:17:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:17:26,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 12, 26, 880910), 1, 2])
securityworker stdout | 2024-04-22 04:17:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:17:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:17:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 12, 26, 880910), 1, 2])
securityworker stdout | 2024-04-22 04:17:26,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:17:26,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:17:26,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:17:26,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:17:26,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:17:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:17:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:17:26,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:17:26,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:17:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:17:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:17:27,576 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:17:28,810 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:17:28,853 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:17:30,310 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:17:30,325 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:17:30,347 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:17:30,374 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:17:30,377 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:17:30,653 [281] [DEBUG] [app] Starting request: urn:request:29c4e1f8-8892-4d3d-aabb-74be11819e67 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:17:30,653 [278] [DEBUG] [app] Starting request: urn:request:680c7783-629d-415f-a12e-0b495223219e (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:17:30,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:17:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:17:30,655 [284] [DEBUG] [app] Starting request: urn:request:2b30beba-f467-499e-b197-923abef9e28b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:17:30,656 [284] [DEBUG] [app] Ending request: urn:request:2b30beba-f467-499e-b197-923abef9e28b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:2b30beba-f467-499e-b197-923abef9e28b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:17:30,656 [288] [DEBUG] [app] Starting request: urn:request:42292dae-2926-4dcf-a8ed-32c919e18022 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:17:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:17:30,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:17:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:17:30,656 [288] [DEBUG] [app] Ending request: urn:request:42292dae-2926-4dcf-a8ed-32c919e18022 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:42292dae-2926-4dcf-a8ed-32c919e18022', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:17:30,656 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 04:17:30,656 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:17:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:17:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:17:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-web stdout | 2024-04-22 04:17:30,657 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:17:30,658 [281] [DEBUG] [app] Starting request: urn:request:ab84af40-4b5b-4334-83b0-0d18b779998f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:17:30,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:17:30,659 [281] [DEBUG] [app] Ending request: urn:request:ab84af40-4b5b-4334-83b0-0d18b779998f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:ab84af40-4b5b-4334-83b0-0d18b779998f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:17:30,659 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:17:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:17:30,659 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:17:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:17:30,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:17:30,660 [282] [DEBUG] [app] Starting request: urn:request:92669409-ad43-443a-901c-b8922bdf5d97 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:17:30,661 [282] [DEBUG] [app] Ending request: urn:request:92669409-ad43-443a-901c-b8922bdf5d97 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:92669409-ad43-443a-901c-b8922bdf5d97', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:17:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.001)
gunicorn-web stdout | 2024-04-22 04:17:30,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:17:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:17:30,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:17:30,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:17:30,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:17:30,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:17:30,674 [281] [DEBUG] [app] Ending request: urn:request:29c4e1f8-8892-4d3d-aabb-74be11819e67 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:29c4e1f8-8892-4d3d-aabb-74be11819e67', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:17:30,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:17:30,674 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:17:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:17:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:17:30,676 [278] [DEBUG] [app] Ending request: urn:request:680c7783-629d-415f-a12e-0b495223219e (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:680c7783-629d-415f-a12e-0b495223219e', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:17:30,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:17:30,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:17:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:17:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
teamsyncworker stdout | 2024-04-22 04:17:30,826 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:17:30,958 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotatotalworker stdout | 2024-04-22 04:17:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:17:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:17:46.054492+00:00 (in 14.999466 seconds)
quotatotalworker stdout | 2024-04-22 04:17:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:17:46 UTC)" (scheduled at 2024-04-22 04:17:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:17:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:17:31,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:17:31,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:17:46 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:17:31,761 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:17:33,388 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:17:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:17:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:17:43.759375+00:00 (in 9.999470 seconds)
notificationworker stdout | 2024-04-22 04:17:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:17:43 UTC)" (scheduled at 2024-04-22 04:17:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:17:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:17:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 17, 33, 760290), True, datetime.datetime(2024, 4, 22, 4, 17, 33, 760290), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:17:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:17:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:17:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:17:43 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:17:34,786 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gunicorn-secscan stdout | 2024-04-22 04:17:34,887 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:17:34,890 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gcworker stdout | 2024-04-22 04:17:34,893 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
gunicorn-secscan stdout | 2024-04-22 04:17:34,895 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
gunicorn-web stdout | 2024-04-22 04:17:35,142 [278] [DEBUG] [app] Starting request: urn:request:a9804ea8-97c8-467f-9fbb-5c74f097ef7d (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:17:35,142 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:17:35,142 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:17:35,142 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:17:35,152 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:17:35,152 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:17:35,152 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:17:35,152 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:17:35,152 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:17:35,152 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:17:35,152 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:17:35,152 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:17:35,154 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
exportactionlogsworker stdout | 2024-04-22 04:17:35,160 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-web stdout | 2024-04-22 04:17:35,161 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:17:35,162 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:17:35,166 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:17:35,170 [278] [DEBUG] [app] Ending request: urn:request:a9804ea8-97c8-467f-9fbb-5c74f097ef7d (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:a9804ea8-97c8-467f-9fbb-5c74f097ef7d', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:17:35,171 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:17:35,171 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:17:35 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:17:35 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.031 1555 0.031)
securityworker stdout | 2024-04-22 04:17:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:17:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:17:56.873109+00:00 (in 21.000716 seconds)
securityworker stdout | 2024-04-22 04:17:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:18:05 UTC)" (scheduled at 2024-04-22 04:17:35.871852+00:00)
securityworker stdout | 2024-04-22 04:17:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:17:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:17:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:17:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:17:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:17:35,887 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:17:35,889 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:17:35,889 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:17:35,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 12, 35, 876198), 1, 2])
securityworker stdout | 2024-04-22 04:17:35,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:17:35,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:17:35,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 12, 35, 876198), 1, 2])
securityworker stdout | 2024-04-22 04:17:35,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:17:35,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:17:35,895 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:17:35,895 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:18:05 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:17:36,288 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:17:37,471 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:17:37,497 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:17:37,686 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
namespacegcworker stdout | 2024-04-22 04:17:38,058 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:17:38,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:17:43.057186+00:00 (in 4.997998 seconds)
namespacegcworker stdout | 2024-04-22 04:17:38,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:22:38 UTC)" (scheduled at 2024-04-22 04:17:38.058708+00:00)
namespacegcworker stdout | 2024-04-22 04:17:38,060 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 17, 38, 59428), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 04:17:38,073 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 17, 38, 59428), True, datetime.datetime(2024, 4, 22, 4, 17, 38, 59428), 0, 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 04:17:38,076 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 17, 38, 59428), True, datetime.datetime(2024, 4, 22, 4, 17, 38, 59428), 0, 'namespacegc/%', False, datetime.datetime(2024, 4, 22, 4, 17, 38, 59428), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 04:17:38,078 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:17:38,078 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:22:38 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 04:17:38,619 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
exportactionlogsworker stdout | 2024-04-22 04:17:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:17:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:17:41.564959+00:00 (in 1.997452 seconds)
exportactionlogsworker stdout | 2024-04-22 04:17:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:18:39 UTC)" (scheduled at 2024-04-22 04:17:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:17:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:17:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:18:39 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:17:39,994 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:17:40,023 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:17:40,406 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:17:40,409 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:17:41,235 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:17:41,250 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:17:41,257 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:17:41,260 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:17:41,263 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
autopruneworker stdout | 2024-04-22 04:17:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:17:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:18:11.264267+00:00 (in 29.999569 seconds)
autopruneworker stdout | 2024-04-22 04:17:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:18:11 UTC)" (scheduled at 2024-04-22 04:17:41.264267+00:00)
gunicorn-registry stdout | 2024-04-22 04:17:41,266 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:17:41,269 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
autopruneworker stdout | 2024-04-22 04:17:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759401271, None, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:17:41,273 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
autopruneworker stdout | 2024-04-22 04:17:41,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:17:41,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:17:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:18:11 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:17:41,276 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
exportactionlogsworker stdout | 2024-04-22 04:17:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:17:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:18:39.566970+00:00 (in 58.001505 seconds)
exportactionlogsworker stdout | 2024-04-22 04:17:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:18:41 UTC)" (scheduled at 2024-04-22 04:17:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:17:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:17:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 17, 41, 565740), True, datetime.datetime(2024, 4, 22, 4, 17, 41, 565740), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:17:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:17:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:17:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:18:41 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:17:41,793 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
namespacegcworker stdout | 2024-04-22 04:17:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:17:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:18:22.058978+00:00 (in 39.001270 seconds)
namespacegcworker stdout | 2024-04-22 04:17:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:18:43 UTC)" (scheduled at 2024-04-22 04:17:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:17:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:17:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 17, 43, 58056), True, datetime.datetime(2024, 4, 22, 4, 17, 43, 58056), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:17:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:17:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:17:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:18:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:17:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:17:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:17:53.759375+00:00 (in 9.999504 seconds)
notificationworker stdout | 2024-04-22 04:17:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:17:53 UTC)" (scheduled at 2024-04-22 04:17:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:17:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:17:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 17, 43, 760271), True, datetime.datetime(2024, 4, 22, 4, 17, 43, 760271), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:17:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:17:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:17:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:17:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:17:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:17:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:18:14.952062+00:00 (in 29.999501 seconds)
gcworker stdout | 2024-04-22 04:17:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:18:14 UTC)" (scheduled at 2024-04-22 04:17:44.952062+00:00)
gcworker stdout | 2024-04-22 04:17:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549864952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:17:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:17:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:17:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:18:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:17:45,652 [282] [DEBUG] [app] Starting request: urn:request:782b698a-cae3-4a1d-a155-41def5d5b0f2 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:17:45,652 [278] [DEBUG] [app] Starting request: urn:request:612a6a07-fc97-4308-9c4b-d26c1a4fdc4d (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:17:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:17:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:17:45,656 [284] [DEBUG] [app] Starting request: urn:request:7e4c2dc7-7d5c-4931-8902-3154694145a9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:17:45,656 [292] [DEBUG] [app] Starting request: urn:request:7681959a-1884-45cc-aba4-3f6c67b8a8e2 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:17:45,656 [284] [DEBUG] [app] Ending request: urn:request:7e4c2dc7-7d5c-4931-8902-3154694145a9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7e4c2dc7-7d5c-4931-8902-3154694145a9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:17:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:17:45,656 [292] [DEBUG] [app] Ending request: urn:request:7681959a-1884-45cc-aba4-3f6c67b8a8e2 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7681959a-1884-45cc-aba4-3f6c67b8a8e2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:17:45,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:17:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:17:45,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:17:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:17:45,656 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:17:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:17:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:17:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:17:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:17:45,659 [281] [DEBUG] [app] Starting request: urn:request:a6893c3e-1ea1-4392-892a-4adbc3be1ed9 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:17:45,659 [282] [DEBUG] [app] Starting request: urn:request:fc0ad339-51aa-423b-9e0e-13f347b12dfc (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:17:45,660 [281] [DEBUG] [app] Ending request: urn:request:a6893c3e-1ea1-4392-892a-4adbc3be1ed9 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a6893c3e-1ea1-4392-892a-4adbc3be1ed9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:17:45,660 [282] [DEBUG] [app] Ending request: urn:request:fc0ad339-51aa-423b-9e0e-13f347b12dfc (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:fc0ad339-51aa-423b-9e0e-13f347b12dfc', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:17:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:17:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:17:45,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:17:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:17:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:17:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:17:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:17:45,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:17:45,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:17:45,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:17:45,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:17:45,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:17:45,674 [278] [DEBUG] [app] Ending request: urn:request:612a6a07-fc97-4308-9c4b-d26c1a4fdc4d (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:612a6a07-fc97-4308-9c4b-d26c1a4fdc4d', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:17:45,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:17:45,674 [282] [DEBUG] [app] Ending request: urn:request:782b698a-cae3-4a1d-a155-41def5d5b0f2 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:782b698a-cae3-4a1d-a155-41def5d5b0f2', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:17:45,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:17:45,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:17:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:17:45,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:17:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:17:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:17:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.022)
quotatotalworker stdout | 2024-04-22 04:17:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:17:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:18:01.054492+00:00 (in 14.999493 seconds)
quotatotalworker stdout | 2024-04-22 04:17:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:18:01 UTC)" (scheduled at 2024-04-22 04:17:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:17:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:17:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:17:46,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:18:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:17:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:17:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:18:17.052354+00:00 (in 29.999467 seconds)
buildlogsarchiver stdout | 2024-04-22 04:17:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:18:17 UTC)" (scheduled at 2024-04-22 04:17:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:17:47,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 17, 47, 53241), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:17:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:17:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:17:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:18:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:17:50,834 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:17:52,150 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:17:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:17:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:18:03.759375+00:00 (in 9.999471 seconds)
notificationworker stdout | 2024-04-22 04:17:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:18:03 UTC)" (scheduled at 2024-04-22 04:17:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:17:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:17:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 17, 53, 760320), True, datetime.datetime(2024, 4, 22, 4, 17, 53, 760320), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:17:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:17:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:17:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:18:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:17:55,837 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:17:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:17:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:18:05.871852+00:00 (in 8.998188 seconds)
securityworker stdout | 2024-04-22 04:17:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:18:26 UTC)" (scheduled at 2024-04-22 04:17:56.873109+00:00)
securityworker stdout | 2024-04-22 04:17:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:17:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:17:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:17:56,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:17:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:17:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:17:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:17:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:17:56,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:17:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:17:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:17:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:17:56,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 12, 56, 880728), 1, 2])
securityworker stdout | 2024-04-22 04:17:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:17:56,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:17:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 12, 56, 880728), 1, 2])
securityworker stdout | 2024-04-22 04:17:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:17:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:17:56,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:17:56,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:17:56,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:17:56,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:17:56,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:17:56,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:17:56,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:17:56,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:18:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:17:57,597 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:17:58,817 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:17:58,889 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:18:00,317 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:18:00,333 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:18:00,359 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:18:00,387 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:18:00,390 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:18:00,652 [281] [DEBUG] [app] Starting request: urn:request:b782135f-fc10-4a68-878a-486ee3b0694c (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:18:00,653 [282] [DEBUG] [app] Starting request: urn:request:95473f96-f237-4573-b631-e4432e70d3db (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:18:00,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:18:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:18:00,655 [284] [DEBUG] [app] Starting request: urn:request:18d35169-a32e-4ada-876a-0804a45eb86b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:18:00,656 [292] [DEBUG] [app] Starting request: urn:request:95802361-4136-47d9-8719-64c8370dd90b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:18:00,656 [284] [DEBUG] [app] Ending request: urn:request:18d35169-a32e-4ada-876a-0804a45eb86b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:18d35169-a32e-4ada-876a-0804a45eb86b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:18:00,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:18:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:18:00,656 [292] [DEBUG] [app] Ending request: urn:request:95802361-4136-47d9-8719-64c8370dd90b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:95802361-4136-47d9-8719-64c8370dd90b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:18:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:18:00,656 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:18:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:18:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:18:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:18:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:18:00,657 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:18:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:18:00,658 [281] [DEBUG] [app] Starting request: urn:request:675f88af-a36b-48c3-9bc6-c9d0816a5dfc (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:18:00,659 [281] [DEBUG] [app] Ending request: urn:request:675f88af-a36b-48c3-9bc6-c9d0816a5dfc (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:675f88af-a36b-48c3-9bc6-c9d0816a5dfc', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:18:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:18:00,659 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:18:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:18:00,659 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:18:00,659 [278] [DEBUG] [app] Starting request: urn:request:cbee0e73-b667-49cd-9e0d-daa5ecd9c2f9 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:18:00,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:18:00,660 [278] [DEBUG] [app] Ending request: urn:request:cbee0e73-b667-49cd-9e0d-daa5ecd9c2f9 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:cbee0e73-b667-49cd-9e0d-daa5ecd9c2f9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:18:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:18:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:18:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:18:00,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:18:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:18:00,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:18:00,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:18:00,673 [281] [DEBUG] [app] Ending request: urn:request:b782135f-fc10-4a68-878a-486ee3b0694c (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b782135f-fc10-4a68-878a-486ee3b0694c', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:18:00,673 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:18:00,674 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:18:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:18:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:18:00,674 [282] [DEBUG] [app] Ending request: urn:request:95473f96-f237-4573-b631-e4432e70d3db (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:95473f96-f237-4573-b631-e4432e70d3db', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:18:00,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:18:00,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:18:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:18:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
teamsyncworker stdout | 2024-04-22 04:18:00,863 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:18:00,985 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotatotalworker stdout | 2024-04-22 04:18:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:18:01,054 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:18:16.054492+00:00 (in 14.999535 seconds)
quotatotalworker stdout | 2024-04-22 04:18:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:18:16 UTC)" (scheduled at 2024-04-22 04:18:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:18:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:18:01,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:18:01,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:18:16 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:18:01,797 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:18:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:18:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:18:16.552337+00:00 (in 13.995582 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:18:02,557 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:19:02 UTC)" (scheduled at 2024-04-22 04:18:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:18:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:18:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:19:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:18:03,425 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:18:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:18:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:18:13.759375+00:00 (in 9.999532 seconds)
notificationworker stdout | 2024-04-22 04:18:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:18:13 UTC)" (scheduled at 2024-04-22 04:18:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:18:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:18:03,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 18, 3, 760212), True, datetime.datetime(2024, 4, 22, 4, 18, 3, 760212), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:18:03,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:18:03,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:18:03,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:18:13 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:18:04,822 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gunicorn-secscan stdout | 2024-04-22 04:18:04,895 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:18:04,898 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:18:04,902 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
gcworker stdout | 2024-04-22 04:18:04,915 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:18:05,194 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:18:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:18:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:18:26.873109+00:00 (in 21.000706 seconds)
securityworker stdout | 2024-04-22 04:18:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:18:35 UTC)" (scheduled at 2024-04-22 04:18:05.871852+00:00)
securityworker stdout | 2024-04-22 04:18:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:18:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:18:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:18:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:18:05,884 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:18:05,885 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:18:35 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:18:06,289 [282] [DEBUG] [app] Starting request: urn:request:ab0b699b-d465-4455-b8d0-93dcf18e1804 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:18:06,289 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:18:06,289 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:18:06,290 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
logrotateworker stdout | 2024-04-22 04:18:06,298 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-web stdout | 2024-04-22 04:18:06,299 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:18:06,299 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:18:06,299 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:18:06,300 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:18:06,300 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:18:06,300 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:18:06,300 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:18:06,300 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:18:06,302 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:18:06,309 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:18:06,310 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:18:06,314 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:18:06,318 [282] [DEBUG] [app] Ending request: urn:request:ab0b699b-d465-4455-b8d0-93dcf18e1804 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:ab0b699b-d465-4455-b8d0-93dcf18e1804', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:18:06,318 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:18:06,319 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:18:06 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:18:06 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.032 1536 0.032)
repositorygcworker stdout | 2024-04-22 04:18:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:18:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:18:13.555667+00:00 (in 7.002677 seconds)
repositorygcworker stdout | 2024-04-22 04:18:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:19:06 UTC)" (scheduled at 2024-04-22 04:18:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:18:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:18:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 18, 6, 553347), True, datetime.datetime(2024, 4, 22, 4, 18, 6, 553347), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:18:06,563 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:18:06,563 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:18:06,563 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:19:06 UTC)" executed successfully
autopruneworker stdout | 2024-04-22 04:18:07,492 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:18:07,533 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:18:07,723 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:18:08,646 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:18:10,008 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:18:10,054 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:18:10,423 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:18:10,427 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:18:11,244 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:18:11,257 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
autopruneworker stdout | 2024-04-22 04:18:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:18:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:18:41.264267+00:00 (in 29.999574 seconds)
autopruneworker stdout | 2024-04-22 04:18:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:18:41 UTC)" (scheduled at 2024-04-22 04:18:11.264267+00:00)
gunicorn-registry stdout | 2024-04-22 04:18:11,267 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:18:11,271 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
autopruneworker stdout | 2024-04-22 04:18:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759431271, None, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:18:11,275 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
autopruneworker stdout | 2024-04-22 04:18:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:18:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:18:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:18:41 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:18:11,278 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:18:11,281 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:18:11,284 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:18:11,287 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
storagereplication stdout | 2024-04-22 04:18:11,828 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:18:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:18:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:19:06.552482+00:00 (in 52.996276 seconds)
repositorygcworker stdout | 2024-04-22 04:18:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:19:13 UTC)" (scheduled at 2024-04-22 04:18:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:18:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:18:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:19:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:18:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:18:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:18:19.762160+00:00 (in 6.002319 seconds)
notificationworker stdout | 2024-04-22 04:18:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:18:23 UTC)" (scheduled at 2024-04-22 04:18:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:18:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:18:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 18, 13, 760171), True, datetime.datetime(2024, 4, 22, 4, 18, 13, 760171), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:18:13,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:18:13,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:18:13,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:18:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:18:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:18:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:18:44.952062+00:00 (in 29.999505 seconds)
gcworker stdout | 2024-04-22 04:18:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:18:44 UTC)" (scheduled at 2024-04-22 04:18:14.952062+00:00)
gcworker stdout | 2024-04-22 04:18:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549894952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:18:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:18:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:18:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:18:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:18:15,653 [278] [DEBUG] [app] Starting request: urn:request:7b492cd2-69a9-4bcc-9112-ec6398a377e6 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:18:15,653 [281] [DEBUG] [app] Starting request: urn:request:d434dad5-2340-48d8-89e0-ed9ec3789bc5 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:18:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:18:15,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:18:15,656 [289] [DEBUG] [app] Starting request: urn:request:389134c6-b51e-4c31-8520-078ed36b4819 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:18:15,656 [290] [DEBUG] [app] Starting request: urn:request:46d647a3-2fad-44d4-97d9-4f945f7bd4de (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:18:15,656 [289] [DEBUG] [app] Ending request: urn:request:389134c6-b51e-4c31-8520-078ed36b4819 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:389134c6-b51e-4c31-8520-078ed36b4819', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:18:15,656 [290] [DEBUG] [app] Ending request: urn:request:46d647a3-2fad-44d4-97d9-4f945f7bd4de (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:46d647a3-2fad-44d4-97d9-4f945f7bd4de', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:18:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:18:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:18:15,656 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:18:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:18:15,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:18:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:18:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:18:15,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:18:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:18:15,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:18:15,659 [278] [DEBUG] [app] Starting request: urn:request:52968a54-7b58-42b5-a6ae-17fe13a5285f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:18:15,659 [278] [DEBUG] [app] Ending request: urn:request:52968a54-7b58-42b5-a6ae-17fe13a5285f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:52968a54-7b58-42b5-a6ae-17fe13a5285f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:18:15,659 [282] [DEBUG] [app] Starting request: urn:request:15927c47-6aa6-4b4a-835f-5620f8c5e464 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:18:15,659 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:18:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:18:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:18:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:18:15,660 [282] [DEBUG] [app] Ending request: urn:request:15927c47-6aa6-4b4a-835f-5620f8c5e464 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:15927c47-6aa6-4b4a-835f-5620f8c5e464', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:18:15,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:18:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:18:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:18:15,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:18:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.001)
gunicorn-web stdout | 2024-04-22 04:18:15,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:18:15,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:18:15,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:18:15,674 [278] [DEBUG] [app] Ending request: urn:request:7b492cd2-69a9-4bcc-9112-ec6398a377e6 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:7b492cd2-69a9-4bcc-9112-ec6398a377e6', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:18:15,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:18:15,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:18:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:18:15,674 [281] [DEBUG] [app] Ending request: urn:request:d434dad5-2340-48d8-89e0-ed9ec3789bc5 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:d434dad5-2340-48d8-89e0-ed9ec3789bc5', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:18:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:18:15,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:18:15,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:18:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:18:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.023)
quotatotalworker stdout | 2024-04-22 04:18:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:18:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:18:31.054492+00:00 (in 14.999474 seconds)
quotatotalworker stdout | 2024-04-22 04:18:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:18:31 UTC)" (scheduled at 2024-04-22 04:18:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:18:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:18:16,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:18:16,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:18:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:18:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:18:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:19:02.556208+00:00 (in 46.003264 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:18:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:19:16 UTC)" (scheduled at 2024-04-22 04:18:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:18:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:18:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 18, 16, 553350), True, datetime.datetime(2024, 4, 22, 4, 18, 16, 553350), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:18:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:18:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:18:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:19:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:18:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:18:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:18:47.052354+00:00 (in 29.999446 seconds)
buildlogsarchiver stdout | 2024-04-22 04:18:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:18:47 UTC)" (scheduled at 2024-04-22 04:18:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:18:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 18, 17, 53263), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:18:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:18:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:18:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:18:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:18:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:18:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:18:23.759375+00:00 (in 3.996660 seconds)
notificationworker stdout | 2024-04-22 04:18:19,762 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:23:19 UTC)" (scheduled at 2024-04-22 04:18:19.762160+00:00)
notificationworker stdout | 2024-04-22 04:18:19,763 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 18, 19, 763146), 'notification/%'])
notificationworker stdout | 2024-04-22 04:18:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:19:19 UTC)" (scheduled at 2024-04-22 04:18:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:18:19,764 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:18:19,764 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:19:19 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:18:19,773 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 18, 19, 763146), True, datetime.datetime(2024, 4, 22, 4, 18, 19, 763146), 0, 'notification/%'])
notificationworker stdout | 2024-04-22 04:18:19,776 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 18, 19, 763146), True, datetime.datetime(2024, 4, 22, 4, 18, 19, 763146), 0, 'notification/%', False, datetime.datetime(2024, 4, 22, 4, 18, 19, 763146), 'notification/%'])
notificationworker stdout | 2024-04-22 04:18:19,779 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:18:19,779 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:23:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:18:20,871 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
namespacegcworker stdout | 2024-04-22 04:18:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:18:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:18:43.057186+00:00 (in 20.997662 seconds)
namespacegcworker stdout | 2024-04-22 04:18:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:19:22 UTC)" (scheduled at 2024-04-22 04:18:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:18:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:18:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:19:22 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:18:22,159 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:18:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:18:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:18:33.759375+00:00 (in 9.999406 seconds)
notificationworker stdout | 2024-04-22 04:18:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:18:33 UTC)" (scheduled at 2024-04-22 04:18:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:18:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:18:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 18, 23, 760329), True, datetime.datetime(2024, 4, 22, 4, 18, 23, 760329), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:18:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:18:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:18:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:18:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:18:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:18:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:19:24.361582+00:00 (in 59.999437 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:18:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:19:24 UTC)" (scheduled at 2024-04-22 04:18:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:18:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:18:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:18:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:19:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:18:25,873 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:18:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:18:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:18:35.871852+00:00 (in 8.998196 seconds)
securityworker stdout | 2024-04-22 04:18:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:18:56 UTC)" (scheduled at 2024-04-22 04:18:26.873109+00:00)
securityworker stdout | 2024-04-22 04:18:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:18:26,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:18:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:18:26,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:18:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:18:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:18:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:18:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:18:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:18:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:18:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:18:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:18:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 13, 26, 880742), 1, 2])
securityworker stdout | 2024-04-22 04:18:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:18:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:18:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 13, 26, 880742), 1, 2])
securityworker stdout | 2024-04-22 04:18:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:18:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:18:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:18:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:18:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:18:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:18:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:18:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:18:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:18:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:18:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:18:27,624 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:18:28,853 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:18:28,919 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:18:30,326 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:18:30,343 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:18:30,369 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:18:30,399 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:18:30,403 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:18:30,652 [281] [DEBUG] [app] Starting request: urn:request:8a198453-fb56-4d69-b0ff-320df759a042 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:18:30,653 [279] [DEBUG] [app] Starting request: urn:request:2fcd6621-36c6-4cb4-ae3b-a1a26034ea4a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:18:30,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:18:30,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:18:30,656 [291] [DEBUG] [app] Starting request: urn:request:00a770c4-0856-4c08-b599-1098a84d6fd7 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:18:30,656 [284] [DEBUG] [app] Starting request: urn:request:9f1c81e5-0242-4f66-a459-91b738554b68 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:18:30,656 [291] [DEBUG] [app] Ending request: urn:request:00a770c4-0856-4c08-b599-1098a84d6fd7 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:00a770c4-0856-4c08-b599-1098a84d6fd7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:18:30,656 [284] [DEBUG] [app] Ending request: urn:request:9f1c81e5-0242-4f66-a459-91b738554b68 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:9f1c81e5-0242-4f66-a459-91b738554b68', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:18:30,656 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:18:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:18:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:18:30,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:18:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:18:30,656 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:18:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:18:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:18:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:18:30,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:18:30,659 [281] [DEBUG] [app] Starting request: urn:request:04c9765a-6819-47bb-9ab4-f38b591922dd (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:18:30,659 [281] [DEBUG] [app] Ending request: urn:request:04c9765a-6819-47bb-9ab4-f38b591922dd (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:04c9765a-6819-47bb-9ab4-f38b591922dd', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:18:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.000)
gunicorn-web stdout | 2024-04-22 04:18:30,659 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:18:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:18:30,660 [278] [DEBUG] [app] Starting request: urn:request:c4f764cd-e05b-4f84-aee9-d7e96833c2dd (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:18:30,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:18:30,660 [278] [DEBUG] [app] Ending request: urn:request:c4f764cd-e05b-4f84-aee9-d7e96833c2dd (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:c4f764cd-e05b-4f84-aee9-d7e96833c2dd', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:18:30,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:18:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:18:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:18:30,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:18:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:18:30,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:18:30,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:18:30,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:18:30,674 [281] [DEBUG] [app] Ending request: urn:request:8a198453-fb56-4d69-b0ff-320df759a042 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:8a198453-fb56-4d69-b0ff-320df759a042', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:18:30,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:18:30,674 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:18:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:18:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:18:30,674 [279] [DEBUG] [app] Ending request: urn:request:2fcd6621-36c6-4cb4-ae3b-a1a26034ea4a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2fcd6621-36c6-4cb4-ae3b-a1a26034ea4a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:18:30,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:18:30,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:18:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:18:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
teamsyncworker stdout | 2024-04-22 04:18:30,883 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:18:31,008 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotatotalworker stdout | 2024-04-22 04:18:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:18:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:18:46.054492+00:00 (in 14.999445 seconds)
quotatotalworker stdout | 2024-04-22 04:18:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:18:46 UTC)" (scheduled at 2024-04-22 04:18:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:18:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:18:31,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:18:31,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:18:46 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:18:31,832 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:18:33,461 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:18:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:18:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:18:43.759375+00:00 (in 9.999431 seconds)
notificationworker stdout | 2024-04-22 04:18:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:18:43 UTC)" (scheduled at 2024-04-22 04:18:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:18:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:18:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 18, 33, 760416), True, datetime.datetime(2024, 4, 22, 4, 18, 33, 760416), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:18:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:18:33,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:18:33,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:18:43 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:18:34,859 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gunicorn-secscan stdout | 2024-04-22 04:18:34,904 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:18:34,908 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:18:34,911 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
gcworker stdout | 2024-04-22 04:18:34,948 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:18:35,229 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:18:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:18:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:18:56.873109+00:00 (in 21.000721 seconds)
securityworker stdout | 2024-04-22 04:18:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:19:05 UTC)" (scheduled at 2024-04-22 04:18:35.871852+00:00)
securityworker stdout | 2024-04-22 04:18:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:18:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:18:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:18:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:18:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:18:35,888 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:18:35,890 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:18:35,890 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:18:35,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 13, 35, 876122), 1, 2])
securityworker stdout | 2024-04-22 04:18:35,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:18:35,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:18:35,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 13, 35, 876122), 1, 2])
securityworker stdout | 2024-04-22 04:18:35,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:18:35,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:18:35,896 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:18:35,896 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:19:05 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:18:36,313 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-web stdout | 2024-04-22 04:18:36,687 [282] [DEBUG] [app] Starting request: urn:request:d6a32d17-a98d-4b54-85cb-6ae36cc24846 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:18:36,687 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:18:36,688 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:18:36,688 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:18:36,698 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:18:36,698 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:18:36,698 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:18:36,698 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:18:36,698 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:18:36,698 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:18:36,698 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:18:36,698 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:18:36,700 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:18:36,707 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:18:36,708 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:18:36,713 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:18:36,717 [282] [DEBUG] [app] Ending request: urn:request:d6a32d17-a98d-4b54-85cb-6ae36cc24846 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:d6a32d17-a98d-4b54-85cb-6ae36cc24846', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:18:36,717 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:18:36,717 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:18:36 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:18:36 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.031 1555 0.031)
autopruneworker stdout | 2024-04-22 04:18:37,510 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:18:37,565 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:18:37,750 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:18:38,682 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
exportactionlogsworker stdout | 2024-04-22 04:18:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:18:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:18:41.564959+00:00 (in 1.997470 seconds)
exportactionlogsworker stdout | 2024-04-22 04:18:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:19:39 UTC)" (scheduled at 2024-04-22 04:18:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:18:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:18:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:19:39 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:18:40,028 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:18:40,079 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:18:40,432 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:18:40,452 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:18:41,253 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
autopruneworker stdout | 2024-04-22 04:18:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:18:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:19:11.264267+00:00 (in 29.999570 seconds)
autopruneworker stdout | 2024-04-22 04:18:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:19:11 UTC)" (scheduled at 2024-04-22 04:18:41.264267+00:00)
gunicorn-registry stdout | 2024-04-22 04:18:41,265 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
autopruneworker stdout | 2024-04-22 04:18:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759461271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:18:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:18:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:18:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:19:11 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:18:41,277 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:18:41,279 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:18:41,284 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:18:41,288 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:18:41,292 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:18:41,294 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:18:41,297 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
exportactionlogsworker stdout | 2024-04-22 04:18:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:18:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:19:39.566970+00:00 (in 58.001448 seconds)
exportactionlogsworker stdout | 2024-04-22 04:18:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:19:41 UTC)" (scheduled at 2024-04-22 04:18:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:18:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:18:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 18, 41, 565878), True, datetime.datetime(2024, 4, 22, 4, 18, 41, 565878), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:18:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:18:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:18:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:19:41 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:18:41,860 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
namespacegcworker stdout | 2024-04-22 04:18:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:18:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:19:22.058978+00:00 (in 39.001231 seconds)
namespacegcworker stdout | 2024-04-22 04:18:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:19:43 UTC)" (scheduled at 2024-04-22 04:18:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:18:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:18:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 18, 43, 58105), True, datetime.datetime(2024, 4, 22, 4, 18, 43, 58105), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:18:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:18:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:18:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:19:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:18:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:18:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:18:53.759375+00:00 (in 9.999451 seconds)
notificationworker stdout | 2024-04-22 04:18:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:18:53 UTC)" (scheduled at 2024-04-22 04:18:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:18:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:18:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 18, 43, 760219), True, datetime.datetime(2024, 4, 22, 4, 18, 43, 760219), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:18:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:18:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:18:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:18:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:18:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:18:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:19:14.952062+00:00 (in 29.999535 seconds)
gcworker stdout | 2024-04-22 04:18:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:19:14 UTC)" (scheduled at 2024-04-22 04:18:44.952062+00:00)
gcworker stdout | 2024-04-22 04:18:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549924952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:18:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:18:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:18:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:19:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:18:45,653 [279] [DEBUG] [app] Starting request: urn:request:c20e7fe2-8732-4273-8d60-716ea2130834 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:18:45,653 [278] [DEBUG] [app] Starting request: urn:request:0db46ab2-658e-4435-a159-cc6b771be344 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:18:45,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:18:45,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:18:45,656 [289] [DEBUG] [app] Starting request: urn:request:18d21497-b00c-43e5-8dd1-07035d28bab8 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:18:45,656 [289] [DEBUG] [app] Ending request: urn:request:18d21497-b00c-43e5-8dd1-07035d28bab8 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:18d21497-b00c-43e5-8dd1-07035d28bab8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:18:45,656 [290] [DEBUG] [app] Starting request: urn:request:b641b4c3-49aa-43d4-a919-2888eaac879f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:18:45,657 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:18:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:18:45,657 [290] [DEBUG] [app] Ending request: urn:request:b641b4c3-49aa-43d4-a919-2888eaac879f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b641b4c3-49aa-43d4-a919-2888eaac879f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:18:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:18:45,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 04:18:45,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:18:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:18:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:18:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:18:45,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:18:45,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:18:45,659 [279] [DEBUG] [app] Starting request: urn:request:61bab768-642d-4095-9d0b-fac52a109db4 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:18:45,660 [279] [DEBUG] [app] Ending request: urn:request:61bab768-642d-4095-9d0b-fac52a109db4 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:61bab768-642d-4095-9d0b-fac52a109db4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:18:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:18:45,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:18:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:18:45,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:18:45,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:18:45,661 [282] [DEBUG] [app] Starting request: urn:request:4c260cae-865b-4b6b-a921-2b0c138c08b4 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:18:45,661 [282] [DEBUG] [app] Ending request: urn:request:4c260cae-865b-4b6b-a921-2b0c138c08b4 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:4c260cae-865b-4b6b-a921-2b0c138c08b4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:18:45,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:18:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:18:45,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:18:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:18:45,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:18:45,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:18:45,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:18:45,674 [279] [DEBUG] [app] Ending request: urn:request:c20e7fe2-8732-4273-8d60-716ea2130834 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:c20e7fe2-8732-4273-8d60-716ea2130834', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:18:45,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:18:45,674 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:18:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:18:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:18:45,676 [278] [DEBUG] [app] Ending request: urn:request:0db46ab2-658e-4435-a159-cc6b771be344 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:0db46ab2-658e-4435-a159-cc6b771be344', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:18:45,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:18:45,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:18:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:18:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
quotatotalworker stdout | 2024-04-22 04:18:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:18:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:19:01.054492+00:00 (in 14.999432 seconds)
quotatotalworker stdout | 2024-04-22 04:18:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:19:01 UTC)" (scheduled at 2024-04-22 04:18:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:18:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:18:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:18:46,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:19:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:18:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:18:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:19:17.052354+00:00 (in 29.999473 seconds)
buildlogsarchiver stdout | 2024-04-22 04:18:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:19:17 UTC)" (scheduled at 2024-04-22 04:18:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:18:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 18, 47, 53279), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:18:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:18:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:18:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:19:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:18:50,909 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:18:52,189 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:18:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:18:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:19:03.759375+00:00 (in 9.999524 seconds)
notificationworker stdout | 2024-04-22 04:18:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:19:03 UTC)" (scheduled at 2024-04-22 04:18:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:18:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:18:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 18, 53, 760275), True, datetime.datetime(2024, 4, 22, 4, 18, 53, 760275), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:18:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:18:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:18:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:19:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:18:55,901 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:18:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:18:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:19:05.871852+00:00 (in 8.998190 seconds)
securityworker stdout | 2024-04-22 04:18:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:19:26 UTC)" (scheduled at 2024-04-22 04:18:56.873109+00:00)
securityworker stdout | 2024-04-22 04:18:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:18:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:18:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:18:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:18:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:18:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:18:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:18:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:18:56,882 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:18:56,892 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:18:56,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:18:56,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:18:56,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 13, 56, 882234), 1, 2])
securityworker stdout | 2024-04-22 04:18:56,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:18:56,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:18:56,898 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 13, 56, 882234), 1, 2])
securityworker stdout | 2024-04-22 04:18:56,900 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:18:56,900 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:18:56,900 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:18:56,900 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:18:56,901 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:18:56,901 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:18:56,901 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:18:56,901 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:18:56,901 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:18:56,902 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:19:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:18:57,656 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:18:58,880 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:18:58,955 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:19:00,335 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:19:00,352 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:19:00,380 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:19:00,410 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:19:00,414 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:19:00,653 [279] [DEBUG] [app] Starting request: urn:request:6f19e4ac-e360-4df6-9dda-9ff46e0d5ff1 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:19:00,653 [278] [DEBUG] [app] Starting request: urn:request:2457aa04-924b-48cc-8e0e-98d9e9ce7f4d (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:19:00,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:19:00,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:19:00,656 [289] [DEBUG] [app] Starting request: urn:request:b1be92ff-0352-4d15-8df4-ba5e7c434d03 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:19:00,656 [290] [DEBUG] [app] Starting request: urn:request:cc8752cf-b4e9-412a-a366-881efbaf1eef (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:19:00,657 [289] [DEBUG] [app] Ending request: urn:request:b1be92ff-0352-4d15-8df4-ba5e7c434d03 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b1be92ff-0352-4d15-8df4-ba5e7c434d03', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:19:00,657 [290] [DEBUG] [app] Ending request: urn:request:cc8752cf-b4e9-412a-a366-881efbaf1eef (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:cc8752cf-b4e9-412a-a366-881efbaf1eef', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:19:00,657 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:19:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:19:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
gunicorn-web stdout | 2024-04-22 04:19:00,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:19:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:19:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:19:00,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:19:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:19:00,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:19:00,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:19:00,660 [281] [DEBUG] [app] Starting request: urn:request:924a878a-65c1-40fa-8756-d952d9f048f6 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:19:00,660 [279] [DEBUG] [app] Starting request: urn:request:842e4ff1-2b7d-4e97-8575-1220af5bc078 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:19:00,660 [279] [DEBUG] [app] Ending request: urn:request:842e4ff1-2b7d-4e97-8575-1220af5bc078 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:842e4ff1-2b7d-4e97-8575-1220af5bc078', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:19:00,660 [281] [DEBUG] [app] Ending request: urn:request:924a878a-65c1-40fa-8756-d952d9f048f6 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:924a878a-65c1-40fa-8756-d952d9f048f6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:19:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:19:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:19:00,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:19:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:19:00,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:19:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:19:00,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:19:00,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:19:00,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:19:00,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:19:00,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:19:00,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:19:00,679 [279] [DEBUG] [app] Ending request: urn:request:6f19e4ac-e360-4df6-9dda-9ff46e0d5ff1 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:6f19e4ac-e360-4df6-9dda-9ff46e0d5ff1', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:19:00,679 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:19:00,679 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:19:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:19:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
gunicorn-web stdout | 2024-04-22 04:19:00,682 [278] [DEBUG] [app] Ending request: urn:request:2457aa04-924b-48cc-8e0e-98d9e9ce7f4d (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2457aa04-924b-48cc-8e0e-98d9e9ce7f4d', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:19:00,682 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:19:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.030 118 0.029)
gunicorn-web stdout | 2024-04-22 04:19:00,682 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:19:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
teamsyncworker stdout | 2024-04-22 04:19:00,905 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:19:01,028 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotatotalworker stdout | 2024-04-22 04:19:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:19:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:19:16.054492+00:00 (in 14.999441 seconds)
quotatotalworker stdout | 2024-04-22 04:19:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:19:16 UTC)" (scheduled at 2024-04-22 04:19:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:19:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:19:01,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:19:01,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:19:16 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:19:01,857 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:19:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:19:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:19:16.552337+00:00 (in 13.995611 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:19:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:20:02 UTC)" (scheduled at 2024-04-22 04:19:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:19:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:19:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:20:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:19:03,498 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:19:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:19:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:19:13.759375+00:00 (in 9.999441 seconds)
notificationworker stdout | 2024-04-22 04:19:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:19:13 UTC)" (scheduled at 2024-04-22 04:19:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:19:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:19:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 19, 3, 760284), True, datetime.datetime(2024, 4, 22, 4, 19, 3, 760284), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:19:03,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:19:03,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:19:03,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:19:13 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:19:04,895 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gunicorn-secscan stdout | 2024-04-22 04:19:04,912 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:19:04,915 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:19:04,918 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
gcworker stdout | 2024-04-22 04:19:04,984 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:19:05,265 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:19:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:19:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:19:26.873109+00:00 (in 21.000726 seconds)
securityworker stdout | 2024-04-22 04:19:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:19:35 UTC)" (scheduled at 2024-04-22 04:19:05.871852+00:00)
securityworker stdout | 2024-04-22 04:19:05,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:19:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:19:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:19:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:19:05,886 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:19:05,886 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:19:35 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:19:06,350 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
repositorygcworker stdout | 2024-04-22 04:19:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:19:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:19:13.555667+00:00 (in 7.002640 seconds)
repositorygcworker stdout | 2024-04-22 04:19:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:20:06 UTC)" (scheduled at 2024-04-22 04:19:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:19:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:19:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 19, 6, 553441), True, datetime.datetime(2024, 4, 22, 4, 19, 6, 553441), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:19:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:19:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:19:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:20:06 UTC)" executed successfully
autopruneworker stdout | 2024-04-22 04:19:07,546 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:19:07,589 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:19:07,786 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
gunicorn-web stdout | 2024-04-22 04:19:07,947 [278] [DEBUG] [app] Starting request: urn:request:3d1646df-5267-4f38-89f8-c0cf87cdcca1 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:19:07,948 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:19:07,948 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:19:07,948 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:19:07,958 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:19:07,958 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:19:07,958 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:19:07,958 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:19:07,958 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:19:07,958 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:19:07,958 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:19:07,958 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:19:07,960 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:19:07,966 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:19:07,967 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:19:07,972 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:19:07,975 [278] [DEBUG] [app] Ending request: urn:request:3d1646df-5267-4f38-89f8-c0cf87cdcca1 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:3d1646df-5267-4f38-89f8-c0cf87cdcca1', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:19:07,976 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:19:07,976 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:19:07 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:19:07 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1536 0.030)
blobuploadcleanupworker stdout | 2024-04-22 04:19:08,706 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:19:10,037 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:19:10,115 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:19:10,449 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:19:10,476 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
gunicorn-registry stdout | 2024-04-22 04:19:11,260 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
autopruneworker stdout | 2024-04-22 04:19:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:19:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:19:41.264267+00:00 (in 29.999572 seconds)
autopruneworker stdout | 2024-04-22 04:19:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:19:41 UTC)" (scheduled at 2024-04-22 04:19:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:19:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759491271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:19:11,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:19:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:19:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:19:41 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:19:11,278 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:19:11,286 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:19:11,290 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:19:11,294 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:19:11,299 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:19:11,302 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:19:11,305 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:19:11,309 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
storagereplication stdout | 2024-04-22 04:19:11,895 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:19:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:19:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:20:06.552482+00:00 (in 52.996350 seconds)
repositorygcworker stdout | 2024-04-22 04:19:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:20:13 UTC)" (scheduled at 2024-04-22 04:19:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:19:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:19:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:20:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:19:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:19:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:19:19.762424+00:00 (in 6.002590 seconds)
notificationworker stdout | 2024-04-22 04:19:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:19:23 UTC)" (scheduled at 2024-04-22 04:19:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:19:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:19:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 19, 13, 760238), True, datetime.datetime(2024, 4, 22, 4, 19, 13, 760238), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:19:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:19:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:19:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:19:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:19:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:19:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:19:44.952062+00:00 (in 29.999552 seconds)
gcworker stdout | 2024-04-22 04:19:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:19:44 UTC)" (scheduled at 2024-04-22 04:19:14.952062+00:00)
gcworker stdout | 2024-04-22 04:19:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549954952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:19:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:19:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:19:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:19:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:19:15,653 [281] [DEBUG] [app] Starting request: urn:request:ce48ee12-3a85-4594-9d78-8864af7d805e (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:19:15,653 [279] [DEBUG] [app] Starting request: urn:request:636a482a-15c8-4e66-845f-b7785357c1ba (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:19:15,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:19:15,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:19:15,656 [284] [DEBUG] [app] Starting request: urn:request:a185ec78-05bc-42e6-b0dc-f57a19c0a2d7 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:19:15,656 [291] [DEBUG] [app] Starting request: urn:request:32965860-7cb7-4dee-b34c-5976178739fc (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:19:15,657 [284] [DEBUG] [app] Ending request: urn:request:a185ec78-05bc-42e6-b0dc-f57a19c0a2d7 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:a185ec78-05bc-42e6-b0dc-f57a19c0a2d7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:19:15,657 [291] [DEBUG] [app] Ending request: urn:request:32965860-7cb7-4dee-b34c-5976178739fc (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:32965860-7cb7-4dee-b34c-5976178739fc', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:19:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:19:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:19:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:19:15,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:19:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:19:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:19:15,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:19:15,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:19:15,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:19:15,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:19:15,660 [279] [DEBUG] [app] Starting request: urn:request:3fd9627e-3a19-4efe-946f-fe0660a7faa8 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:19:15,660 [278] [DEBUG] [app] Starting request: urn:request:db8b8a5d-4987-4e49-b955-77d1f7a5b54d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:19:15,660 [279] [DEBUG] [app] Ending request: urn:request:3fd9627e-3a19-4efe-946f-fe0660a7faa8 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3fd9627e-3a19-4efe-946f-fe0660a7faa8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:19:15,660 [278] [DEBUG] [app] Ending request: urn:request:db8b8a5d-4987-4e49-b955-77d1f7a5b54d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:db8b8a5d-4987-4e49-b955-77d1f7a5b54d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:19:15,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:19:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:19:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:19:15,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:19:15,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:19:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:19:15,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:19:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 04:19:15,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:19:15,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:19:15,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:19:15,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:19:15,674 [279] [DEBUG] [app] Ending request: urn:request:636a482a-15c8-4e66-845f-b7785357c1ba (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:636a482a-15c8-4e66-845f-b7785357c1ba', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:19:15,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:19:15,674 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:19:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:19:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:19:15,675 [281] [DEBUG] [app] Ending request: urn:request:ce48ee12-3a85-4594-9d78-8864af7d805e (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:ce48ee12-3a85-4594-9d78-8864af7d805e', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:19:15,675 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:19:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 04:19:15,676 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:19:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:19:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:19:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:19:31.054492+00:00 (in 14.999487 seconds)
quotatotalworker stdout | 2024-04-22 04:19:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:19:31 UTC)" (scheduled at 2024-04-22 04:19:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:19:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:19:16,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:19:16,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:19:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:19:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:19:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:20:02.556208+00:00 (in 46.003287 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:19:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:20:16 UTC)" (scheduled at 2024-04-22 04:19:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:19:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:19:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 19, 16, 553310), True, datetime.datetime(2024, 4, 22, 4, 19, 16, 553310), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:19:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:19:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:19:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:20:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:19:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:19:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:19:47.052354+00:00 (in 29.999513 seconds)
buildlogsarchiver stdout | 2024-04-22 04:19:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:19:47 UTC)" (scheduled at 2024-04-22 04:19:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:19:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 19, 17, 53200), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:19:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:19:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:19:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:19:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:19:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:19:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:19:23.759375+00:00 (in 3.996399 seconds)
notificationworker stdout | 2024-04-22 04:19:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:20:19 UTC)" (scheduled at 2024-04-22 04:19:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:19:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:19:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:20:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:19:20,945 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
namespacegcworker stdout | 2024-04-22 04:19:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:19:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:19:43.057186+00:00 (in 20.997638 seconds)
namespacegcworker stdout | 2024-04-22 04:19:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:20:22 UTC)" (scheduled at 2024-04-22 04:19:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:19:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:19:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:20:22 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:19:22,216 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:19:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:19:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:19:33.759375+00:00 (in 9.999460 seconds)
notificationworker stdout | 2024-04-22 04:19:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:19:33 UTC)" (scheduled at 2024-04-22 04:19:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:19:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:19:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 19, 23, 760293), True, datetime.datetime(2024, 4, 22, 4, 19, 23, 760293), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:19:23,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:19:23,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:19:23,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:19:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:19:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:19:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:20:24.361582+00:00 (in 59.999438 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:19:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:20:24 UTC)" (scheduled at 2024-04-22 04:19:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:19:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:19:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:19:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:20:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:19:25,937 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:19:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:19:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:19:35.871852+00:00 (in 8.998203 seconds)
securityworker stdout | 2024-04-22 04:19:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:19:56 UTC)" (scheduled at 2024-04-22 04:19:26.873109+00:00)
securityworker stdout | 2024-04-22 04:19:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:19:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:19:26,875 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:19:26,875 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:19:26,875 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:19:26,876 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:19:26,876 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:19:26,878 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:19:26,879 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:19:26,888 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:19:26,891 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:19:26,891 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:19:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 14, 26, 879473), 1, 2])
securityworker stdout | 2024-04-22 04:19:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:19:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:19:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 14, 26, 879473), 1, 2])
securityworker stdout | 2024-04-22 04:19:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:19:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:19:26,896 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:19:26,896 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:19:26,896 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:19:26,897 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:19:26,897 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:19:26,897 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:19:26,897 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:19:26,897 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:19:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:19:27,664 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:19:28,917 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:19:28,962 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:19:30,342 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:19:30,362 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:19:30,391 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:19:30,422 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:19:30,426 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:19:30,653 [278] [DEBUG] [app] Starting request: urn:request:d10c3f6d-dcc8-4e7d-bf8a-3ae54c29d581 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:19:30,653 [281] [DEBUG] [app] Starting request: urn:request:5a109cf9-c87a-4634-8d94-5b952d72835b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:19:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:19:30,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:19:30,656 [286] [DEBUG] [app] Starting request: urn:request:94b64d89-e915-48c7-8adc-f7fae9346076 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:19:30,656 [284] [DEBUG] [app] Starting request: urn:request:04dd049e-8d5c-49fa-8667-15f069b071ec (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:19:30,656 [286] [DEBUG] [app] Ending request: urn:request:94b64d89-e915-48c7-8adc-f7fae9346076 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:94b64d89-e915-48c7-8adc-f7fae9346076', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:19:30,657 [284] [DEBUG] [app] Ending request: urn:request:04dd049e-8d5c-49fa-8667-15f069b071ec (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:04dd049e-8d5c-49fa-8667-15f069b071ec', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:19:30,657 [286] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:19:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:19:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:19:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:19:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:19:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:19:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:19:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:19:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:19:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:19:30,659 [278] [DEBUG] [app] Starting request: urn:request:04610f14-ef02-4111-9f16-cb476db39c0e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:19:30,659 [278] [DEBUG] [app] Ending request: urn:request:04610f14-ef02-4111-9f16-cb476db39c0e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:04610f14-ef02-4111-9f16-cb476db39c0e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:19:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:19:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:19:30,660 [282] [DEBUG] [app] Starting request: urn:request:c33d082f-78db-4c7e-8450-7d7a882b33e9 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:19:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:19:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:19:30,660 [282] [DEBUG] [app] Ending request: urn:request:c33d082f-78db-4c7e-8450-7d7a882b33e9 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:c33d082f-78db-4c7e-8450-7d7a882b33e9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:19:30,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:19:30,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:19:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:19:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:19:30,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:19:30,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:19:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:19:30,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:19:30,674 [278] [DEBUG] [app] Ending request: urn:request:d10c3f6d-dcc8-4e7d-bf8a-3ae54c29d581 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:d10c3f6d-dcc8-4e7d-bf8a-3ae54c29d581', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:19:30,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:19:30,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:19:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:19:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:19:30,675 [281] [DEBUG] [app] Ending request: urn:request:5a109cf9-c87a-4634-8d94-5b952d72835b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:5a109cf9-c87a-4634-8d94-5b952d72835b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:19:30,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:19:30,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:19:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:19:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
teamsyncworker stdout | 2024-04-22 04:19:30,924 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:19:31,036 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotatotalworker stdout | 2024-04-22 04:19:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:19:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:19:46.054492+00:00 (in 14.999470 seconds)
quotatotalworker stdout | 2024-04-22 04:19:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:19:46 UTC)" (scheduled at 2024-04-22 04:19:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:19:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:19:31,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:19:31,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:19:46 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:19:31,894 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:19:33,525 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:19:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:19:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:19:43.759375+00:00 (in 9.999560 seconds)
notificationworker stdout | 2024-04-22 04:19:33,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:19:43 UTC)" (scheduled at 2024-04-22 04:19:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:19:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:19:33,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 19, 33, 760068), True, datetime.datetime(2024, 4, 22, 4, 19, 33, 760068), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:19:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:19:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:19:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:19:43 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 04:19:34,921 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
buildlogsarchiver stdout | 2024-04-22 04:19:34,923 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gunicorn-secscan stdout | 2024-04-22 04:19:34,926 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:19:34,928 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
gcworker stdout | 2024-04-22 04:19:35,011 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:19:35,301 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:19:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:19:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:19:56.873109+00:00 (in 21.000710 seconds)
securityworker stdout | 2024-04-22 04:19:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:20:05 UTC)" (scheduled at 2024-04-22 04:19:35.871852+00:00)
securityworker stdout | 2024-04-22 04:19:35,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:19:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:19:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:19:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:19:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:19:35,888 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:19:35,891 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:19:35,891 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:19:35,892 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 14, 35, 876613), 1, 2])
securityworker stdout | 2024-04-22 04:19:35,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:19:35,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:19:35,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 14, 35, 876613), 1, 2])
securityworker stdout | 2024-04-22 04:19:35,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:19:35,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:19:35,897 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:19:35,897 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:20:05 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:19:36,369 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:19:37,568 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:19:37,612 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:19:37,823 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
gunicorn-web stdout | 2024-04-22 04:19:38,381 [278] [DEBUG] [app] Starting request: urn:request:214a0356-2c11-4dd1-b105-9f925d82f4b5 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:19:38,381 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:19:38,381 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:19:38,382 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:19:38,392 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:19:38,392 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:19:38,392 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:19:38,393 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:19:38,393 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:19:38,393 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:19:38,393 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:19:38,393 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:19:38,395 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:19:38,402 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:19:38,403 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:19:38,408 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:19:38,412 [278] [DEBUG] [app] Ending request: urn:request:214a0356-2c11-4dd1-b105-9f925d82f4b5 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:214a0356-2c11-4dd1-b105-9f925d82f4b5', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:19:38,413 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:19:38 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.034 1555 0.034)
gunicorn-web stdout | 2024-04-22 04:19:38,413 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:19:38 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
blobuploadcleanupworker stdout | 2024-04-22 04:19:38,724 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
exportactionlogsworker stdout | 2024-04-22 04:19:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:19:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:19:41.564959+00:00 (in 1.997428 seconds)
exportactionlogsworker stdout | 2024-04-22 04:19:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:20:39 UTC)" (scheduled at 2024-04-22 04:19:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:19:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:19:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:20:39 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:19:40,065 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:19:40,145 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:19:40,476 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:19:40,494 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
autopruneworker stdout | 2024-04-22 04:19:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:19:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:20:11.264267+00:00 (in 29.999521 seconds)
autopruneworker stdout | 2024-04-22 04:19:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:20:11 UTC)" (scheduled at 2024-04-22 04:19:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:19:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759521271, None, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:19:41,274 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
autopruneworker stdout | 2024-04-22 04:19:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:19:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:19:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:20:11 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:19:41,289 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:19:41,294 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:19:41,301 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:19:41,304 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:19:41,310 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:19:41,313 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:19:41,316 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:19:41,319 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
exportactionlogsworker stdout | 2024-04-22 04:19:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:19:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:20:39.566970+00:00 (in 58.001509 seconds)
exportactionlogsworker stdout | 2024-04-22 04:19:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:20:41 UTC)" (scheduled at 2024-04-22 04:19:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:19:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:19:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 19, 41, 565691), True, datetime.datetime(2024, 4, 22, 4, 19, 41, 565691), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:19:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:19:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:19:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:20:41 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:19:41,931 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
namespacegcworker stdout | 2024-04-22 04:19:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:19:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:20:22.058978+00:00 (in 39.001263 seconds)
namespacegcworker stdout | 2024-04-22 04:19:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:20:43 UTC)" (scheduled at 2024-04-22 04:19:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:19:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:19:43,059 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 19, 43, 58053), True, datetime.datetime(2024, 4, 22, 4, 19, 43, 58053), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:19:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:19:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:19:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:20:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:19:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:19:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:19:53.759375+00:00 (in 9.999522 seconds)
notificationworker stdout | 2024-04-22 04:19:43,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:19:53 UTC)" (scheduled at 2024-04-22 04:19:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:19:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:19:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 19, 43, 760172), True, datetime.datetime(2024, 4, 22, 4, 19, 43, 760172), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:19:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:19:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:19:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:19:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:19:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:19:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:20:14.952062+00:00 (in 29.999478 seconds)
gcworker stdout | 2024-04-22 04:19:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:20:14 UTC)" (scheduled at 2024-04-22 04:19:44.952062+00:00)
gcworker stdout | 2024-04-22 04:19:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712549984952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:19:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:19:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:19:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:20:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:19:45,652 [278] [DEBUG] [app] Starting request: urn:request:bb416628-3677-42d2-b059-1505da990289 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:19:45,652 [279] [DEBUG] [app] Starting request: urn:request:88c0c0b5-36a5-4945-9806-4c57ff4bda5d (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:19:45,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:19:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:19:45,656 [288] [DEBUG] [app] Starting request: urn:request:4a87cedf-303e-4ecb-8e82-c33466b3c6f0 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:19:45,656 [291] [DEBUG] [app] Starting request: urn:request:7044e35d-858e-49dc-a988-742d7eee7f63 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:19:45,656 [288] [DEBUG] [app] Ending request: urn:request:4a87cedf-303e-4ecb-8e82-c33466b3c6f0 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:4a87cedf-303e-4ecb-8e82-c33466b3c6f0', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:19:45,656 [291] [DEBUG] [app] Ending request: urn:request:7044e35d-858e-49dc-a988-742d7eee7f63 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7044e35d-858e-49dc-a988-742d7eee7f63', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:19:45,656 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:19:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:19:45,656 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:19:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:19:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:19:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:19:45,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:19:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:19:45,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:19:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:19:45,659 [281] [DEBUG] [app] Starting request: urn:request:f45ba537-2f2d-4b46-87af-ec9abf288dd5 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:19:45,659 [282] [DEBUG] [app] Starting request: urn:request:0280fc0d-5f7f-4e77-a665-355af6b02d6c (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:19:45,659 [281] [DEBUG] [app] Ending request: urn:request:f45ba537-2f2d-4b46-87af-ec9abf288dd5 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:f45ba537-2f2d-4b46-87af-ec9abf288dd5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:19:45,660 [282] [DEBUG] [app] Ending request: urn:request:0280fc0d-5f7f-4e77-a665-355af6b02d6c (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:0280fc0d-5f7f-4e77-a665-355af6b02d6c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:19:45,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:19:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:19:45,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:19:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:19:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:19:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:19:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:19:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:19:45,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:19:45,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:19:45,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:19:45,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:19:45,674 [279] [DEBUG] [app] Ending request: urn:request:88c0c0b5-36a5-4945-9806-4c57ff4bda5d (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:88c0c0b5-36a5-4945-9806-4c57ff4bda5d', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:19:45,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:19:45,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:19:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:19:45,675 [278] [DEBUG] [app] Ending request: urn:request:bb416628-3677-42d2-b059-1505da990289 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:bb416628-3677-42d2-b059-1505da990289', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:19:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.023)
gunicorn-web stdout | 2024-04-22 04:19:45,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:19:45,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:19:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:19:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotatotalworker stdout | 2024-04-22 04:19:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:19:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:20:01.054492+00:00 (in 14.999450 seconds)
quotatotalworker stdout | 2024-04-22 04:19:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:20:01 UTC)" (scheduled at 2024-04-22 04:19:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:19:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:19:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:19:46,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:20:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:19:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:19:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:20:17.052354+00:00 (in 29.999450 seconds)
buildlogsarchiver stdout | 2024-04-22 04:19:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:20:17 UTC)" (scheduled at 2024-04-22 04:19:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:19:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 19, 47, 53254), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:19:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:19:47,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:19:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:20:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:19:50,982 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:19:52,228 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:19:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:19:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:20:03.759375+00:00 (in 9.999492 seconds)
notificationworker stdout | 2024-04-22 04:19:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:20:03 UTC)" (scheduled at 2024-04-22 04:19:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:19:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:19:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 19, 53, 760204), True, datetime.datetime(2024, 4, 22, 4, 19, 53, 760204), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:19:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:19:53,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:19:53,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:20:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:19:55,951 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:19:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:19:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:20:05.871852+00:00 (in 8.998231 seconds)
securityworker stdout | 2024-04-22 04:19:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:20:26 UTC)" (scheduled at 2024-04-22 04:19:56.873109+00:00)
securityworker stdout | 2024-04-22 04:19:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:19:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:19:56,875 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:19:56,875 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:19:56,875 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:19:56,876 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:19:56,876 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:19:56,878 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:19:56,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:19:56,889 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:19:56,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:19:56,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:19:56,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 14, 56, 879799), 1, 2])
securityworker stdout | 2024-04-22 04:19:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:19:56,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:19:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 14, 56, 879799), 1, 2])
securityworker stdout | 2024-04-22 04:19:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:19:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:19:56,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:19:56,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:19:56,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:19:56,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:19:56,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:19:56,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:19:56,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:19:56,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:20:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:19:57,680 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:19:58,949 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:19:58,979 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:20:00,349 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:20:00,372 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:20:00,402 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:20:00,434 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:20:00,437 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:20:00,653 [282] [DEBUG] [app] Starting request: urn:request:00b6c789-b40f-43ca-bb35-1a0414bcd38d (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:20:00,653 [278] [DEBUG] [app] Starting request: urn:request:7b06d5e8-8b9d-42e0-b8ea-5e34dea59734 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:20:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:20:00,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:20:00,656 [292] [DEBUG] [app] Starting request: urn:request:da822d3f-8c0f-4977-b825-fd0a6dc81157 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:20:00,656 [284] [DEBUG] [app] Starting request: urn:request:0852bb82-250f-4dea-9aee-7dd31c1d3729 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:20:00,656 [284] [DEBUG] [app] Ending request: urn:request:0852bb82-250f-4dea-9aee-7dd31c1d3729 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:0852bb82-250f-4dea-9aee-7dd31c1d3729', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:20:00,656 [292] [DEBUG] [app] Ending request: urn:request:da822d3f-8c0f-4977-b825-fd0a6dc81157 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:da822d3f-8c0f-4977-b825-fd0a6dc81157', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:20:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:20:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:20:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:20:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:20:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:20:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:20:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:20:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:20:00,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:20:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:20:00,659 [278] [DEBUG] [app] Starting request: urn:request:7cbb5ae5-dd80-4df3-aeee-c82f90623006 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:20:00,659 [278] [DEBUG] [app] Ending request: urn:request:7cbb5ae5-dd80-4df3-aeee-c82f90623006 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:7cbb5ae5-dd80-4df3-aeee-c82f90623006', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:20:00,659 [279] [DEBUG] [app] Starting request: urn:request:3ea6b7be-5243-40ea-8c5f-09f4c7e98eed (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:20:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.000 159 0.001)
gunicorn-web stdout | 2024-04-22 04:20:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:20:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:20:00,660 [279] [DEBUG] [app] Ending request: urn:request:3ea6b7be-5243-40ea-8c5f-09f4c7e98eed (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3ea6b7be-5243-40ea-8c5f-09f4c7e98eed', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:20:00,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:20:00,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:20:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:20:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:20:00,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:20:00,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:20:00,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:20:00,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:20:00,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:20:00,674 [282] [DEBUG] [app] Ending request: urn:request:00b6c789-b40f-43ca-bb35-1a0414bcd38d (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:00b6c789-b40f-43ca-bb35-1a0414bcd38d', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:20:00,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:20:00,675 [278] [DEBUG] [app] Ending request: urn:request:7b06d5e8-8b9d-42e0-b8ea-5e34dea59734 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:7b06d5e8-8b9d-42e0-b8ea-5e34dea59734', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:20:00,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:20:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:20:00,675 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:20:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:20:00,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:20:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:20:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
teamsyncworker stdout | 2024-04-22 04:20:00,961 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
quotatotalworker stdout | 2024-04-22 04:20:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:20:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:20:16.054492+00:00 (in 14.999432 seconds)
quotatotalworker stdout | 2024-04-22 04:20:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:20:16 UTC)" (scheduled at 2024-04-22 04:20:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:20:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:20:01,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:20:01,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:20:16 UTC)" executed successfully
chunkcleanupworker stdout | 2024-04-22 04:20:01,072 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotaregistrysizeworker stdout | 2024-04-22 04:20:01,927 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:20:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:20:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:20:16.552337+00:00 (in 13.995611 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:20:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:21:02 UTC)" (scheduled at 2024-04-22 04:20:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:20:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:20:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:21:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:20:03,556 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:20:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:20:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:20:13.759375+00:00 (in 9.999454 seconds)
notificationworker stdout | 2024-04-22 04:20:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:20:13 UTC)" (scheduled at 2024-04-22 04:20:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:20:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:20:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 20, 3, 760354), True, datetime.datetime(2024, 4, 22, 4, 20, 3, 760354), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:20:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:20:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:20:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:20:13 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 04:20:04,929 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:20:04,933 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:20:04,936 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
buildlogsarchiver stdout | 2024-04-22 04:20:04,961 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:20:05,026 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:20:05,338 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:20:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:20:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:20:26.873109+00:00 (in 21.000731 seconds)
securityworker stdout | 2024-04-22 04:20:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:20:35 UTC)" (scheduled at 2024-04-22 04:20:05.871852+00:00)
securityworker stdout | 2024-04-22 04:20:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:20:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:20:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:20:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:20:05,886 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:20:05,886 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:20:35 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:20:06,385 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
repositorygcworker stdout | 2024-04-22 04:20:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:20:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:20:13.555667+00:00 (in 7.002707 seconds)
repositorygcworker stdout | 2024-04-22 04:20:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:21:06 UTC)" (scheduled at 2024-04-22 04:20:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:20:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:20:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 20, 6, 553341), True, datetime.datetime(2024, 4, 22, 4, 20, 6, 553341), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:20:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:20:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:20:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:21:06 UTC)" executed successfully
autopruneworker stdout | 2024-04-22 04:20:07,577 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:20:07,625 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:20:07,860 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:20:08,761 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
gunicorn-web stdout | 2024-04-22 04:20:09,463 [279] [DEBUG] [app] Starting request: urn:request:d8fd2645-7ac7-4d05-a820-34f42b04e0ff (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:20:09,463 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:09,463 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:09,464 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:09,473 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:20:09,473 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:20:09,473 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:09,473 [279] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:20:09,473 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:09,473 [279] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:09,473 [279] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:09,473 [279] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:09,475 [279] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:20:09,481 [279] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:09,482 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:09,487 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:20:09,490 [279] [DEBUG] [app] Ending request: urn:request:d8fd2645-7ac7-4d05-a820-34f42b04e0ff (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:d8fd2645-7ac7-4d05-a820-34f42b04e0ff', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:20:09,491 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:20:09,491 [279] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:20:09 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:20:09 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.029 1536 0.029)
securityworker stdout | 2024-04-22 04:20:10,080 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:20:10,161 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:20:10,509 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:20:10,530 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
autopruneworker stdout | 2024-04-22 04:20:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:20:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:20:41.264267+00:00 (in 29.999460 seconds)
autopruneworker stdout | 2024-04-22 04:20:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:20:41 UTC)" (scheduled at 2024-04-22 04:20:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:20:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759551272, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:20:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:20:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:20:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:20:41 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:20:11,285 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:20:11,300 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:20:11,302 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:20:11,308 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:20:11,316 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:20:11,321 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:20:11,323 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:20:11,326 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:20:11,329 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
storagereplication stdout | 2024-04-22 04:20:11,957 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:20:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:20:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:21:06.552482+00:00 (in 52.996331 seconds)
repositorygcworker stdout | 2024-04-22 04:20:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:21:13 UTC)" (scheduled at 2024-04-22 04:20:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:20:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:20:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:21:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:20:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:20:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:20:19.762424+00:00 (in 6.002503 seconds)
notificationworker stdout | 2024-04-22 04:20:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:20:23 UTC)" (scheduled at 2024-04-22 04:20:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:20:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:20:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 20, 13, 760297), True, datetime.datetime(2024, 4, 22, 4, 20, 13, 760297), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:20:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:20:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:20:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:20:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:20:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:20:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:20:44.952062+00:00 (in 29.999517 seconds)
gcworker stdout | 2024-04-22 04:20:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:20:44 UTC)" (scheduled at 2024-04-22 04:20:14.952062+00:00)
gcworker stdout | 2024-04-22 04:20:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712550014952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:20:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:20:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:20:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:20:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:20:15,652 [281] [DEBUG] [app] Starting request: urn:request:608d720c-879d-4612-b298-d4e333ea3ace (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:20:15,652 [282] [DEBUG] [app] Starting request: urn:request:10b6ae70-3246-467c-b2db-956bd5f2fcea (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:20:15,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:20:15,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:20:15,656 [290] [DEBUG] [app] Starting request: urn:request:c500a545-3012-4bfa-a7f1-bfa11dc53fea (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:20:15,656 [284] [DEBUG] [app] Starting request: urn:request:6dfa8fe4-8e81-44ef-9483-4903572120bb (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:20:15,656 [284] [DEBUG] [app] Ending request: urn:request:6dfa8fe4-8e81-44ef-9483-4903572120bb (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:6dfa8fe4-8e81-44ef-9483-4903572120bb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:20:15,656 [290] [DEBUG] [app] Ending request: urn:request:c500a545-3012-4bfa-a7f1-bfa11dc53fea (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:c500a545-3012-4bfa-a7f1-bfa11dc53fea', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:20:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:20:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:20:15,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:20:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:20:15,656 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:20:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:20:15,656 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:20:15,656 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:20:15,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:20:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:20:15,659 [281] [DEBUG] [app] Starting request: urn:request:d1496cdc-7fc5-4bc3-ab31-dea67783c0b5 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:20:15,659 [281] [DEBUG] [app] Ending request: urn:request:d1496cdc-7fc5-4bc3-ab31-dea67783c0b5 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d1496cdc-7fc5-4bc3-ab31-dea67783c0b5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:20:15,659 [278] [DEBUG] [app] Starting request: urn:request:13e122e9-eb60-4709-b963-e714bc3becd6 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:20:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:20:15,659 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:20:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:20:15,659 [278] [DEBUG] [app] Ending request: urn:request:13e122e9-eb60-4709-b963-e714bc3becd6 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:13e122e9-eb60-4709-b963-e714bc3becd6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:20:15,659 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:20:15,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:20:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:20:15,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:20:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:20:15,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:20:15,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:20:15,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:20:15,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:20:15,674 [281] [DEBUG] [app] Ending request: urn:request:608d720c-879d-4612-b298-d4e333ea3ace (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:608d720c-879d-4612-b298-d4e333ea3ace', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:20:15,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:20:15,674 [282] [DEBUG] [app] Ending request: urn:request:10b6ae70-3246-467c-b2db-956bd5f2fcea (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:10b6ae70-3246-467c-b2db-956bd5f2fcea', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:20:15,674 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:20:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:20:15,674 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:20:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:20:15,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:20:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:20:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotatotalworker stdout | 2024-04-22 04:20:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:20:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:20:31.054492+00:00 (in 14.999440 seconds)
quotatotalworker stdout | 2024-04-22 04:20:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:20:31 UTC)" (scheduled at 2024-04-22 04:20:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:20:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:20:16,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:20:16,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:20:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:20:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:20:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:21:02.556208+00:00 (in 46.003263 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:20:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:21:16 UTC)" (scheduled at 2024-04-22 04:20:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:20:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:20:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 20, 16, 553378), True, datetime.datetime(2024, 4, 22, 4, 20, 16, 553378), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:20:16,565 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:20:16,565 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:20:16,565 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:21:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:20:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:20:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:20:47.052354+00:00 (in 29.999442 seconds)
buildlogsarchiver stdout | 2024-04-22 04:20:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:20:47 UTC)" (scheduled at 2024-04-22 04:20:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:20:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 20, 17, 53257), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:20:17,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:20:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:20:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:20:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:20:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:20:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:20:23.759375+00:00 (in 3.996403 seconds)
notificationworker stdout | 2024-04-22 04:20:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:21:19 UTC)" (scheduled at 2024-04-22 04:20:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:20:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:20:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:21:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:20:21,020 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
namespacegcworker stdout | 2024-04-22 04:20:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:20:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:20:43.057186+00:00 (in 20.997728 seconds)
namespacegcworker stdout | 2024-04-22 04:20:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:21:22 UTC)" (scheduled at 2024-04-22 04:20:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:20:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:20:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:21:22 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:20:22,263 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:20:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:20:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:20:33.759375+00:00 (in 9.999461 seconds)
notificationworker stdout | 2024-04-22 04:20:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:20:33 UTC)" (scheduled at 2024-04-22 04:20:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:20:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:20:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 20, 23, 760228), True, datetime.datetime(2024, 4, 22, 4, 20, 23, 760228), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:20:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:20:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:20:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:20:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:20:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:20:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:21:24.361582+00:00 (in 59.999450 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:20:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:21:24 UTC)" (scheduled at 2024-04-22 04:20:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:20:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:20:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:20:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:21:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:20:25,963 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:20:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:20:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:20:35.871852+00:00 (in 8.998270 seconds)
securityworker stdout | 2024-04-22 04:20:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:20:56 UTC)" (scheduled at 2024-04-22 04:20:26.873109+00:00)
securityworker stdout | 2024-04-22 04:20:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:20:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:20:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:20:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:20:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:20:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:20:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:20:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:20:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:20:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:20:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:20:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:20:26,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 15, 26, 880974), 1, 2])
securityworker stdout | 2024-04-22 04:20:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:20:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:20:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 15, 26, 880974), 1, 2])
securityworker stdout | 2024-04-22 04:20:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:20:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:20:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:20:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:20:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:20:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:20:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:20:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:20:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:20:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:20:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:20:27,706 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:20:28,986 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:20:28,995 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:20:30,357 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:20:30,382 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:20:30,413 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:20:30,446 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:20:30,449 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:20:30,653 [279] [DEBUG] [app] Starting request: urn:request:5192f7c6-094c-401d-b99f-5b42ad34e7ad (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:20:30,653 [282] [DEBUG] [app] Starting request: urn:request:91ae54d3-c9b6-48b1-bdd1-d202bd42611b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:20:30,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:20:30,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:20:30,656 [291] [DEBUG] [app] Starting request: urn:request:5c5bbc85-6b5c-48ab-a934-c97b0e73b619 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:20:30,656 [284] [DEBUG] [app] Starting request: urn:request:946fd9b5-61b9-42f0-871b-e24768b3f16b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:20:30,657 [284] [DEBUG] [app] Ending request: urn:request:946fd9b5-61b9-42f0-871b-e24768b3f16b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:946fd9b5-61b9-42f0-871b-e24768b3f16b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:20:30,657 [291] [DEBUG] [app] Ending request: urn:request:5c5bbc85-6b5c-48ab-a934-c97b0e73b619 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5c5bbc85-6b5c-48ab-a934-c97b0e73b619', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:20:30,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:20:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:20:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:20:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:20:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:20:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:20:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:20:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:20:30,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:20:30,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:20:30,659 [279] [DEBUG] [app] Starting request: urn:request:8777a195-0ea5-4688-8bb1-e2ba4d0afd81 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:20:30,660 [279] [DEBUG] [app] Ending request: urn:request:8777a195-0ea5-4688-8bb1-e2ba4d0afd81 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:8777a195-0ea5-4688-8bb1-e2ba4d0afd81', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:20:30,660 [278] [DEBUG] [app] Starting request: urn:request:ff586175-4dcb-4311-810f-a9b8dd105995 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:20:30,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:20:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:20:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:20:30,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:20:30,660 [278] [DEBUG] [app] Ending request: urn:request:ff586175-4dcb-4311-810f-a9b8dd105995 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:ff586175-4dcb-4311-810f-a9b8dd105995', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:20:30,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:20:30,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:20:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:20:30,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:20:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:20:30,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:20:30,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:20:30,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:20:30,674 [279] [DEBUG] [app] Ending request: urn:request:5192f7c6-094c-401d-b99f-5b42ad34e7ad (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:5192f7c6-094c-401d-b99f-5b42ad34e7ad', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:20:30,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:20:30,674 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:20:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:20:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:20:30,675 [282] [DEBUG] [app] Ending request: urn:request:91ae54d3-c9b6-48b1-bdd1-d202bd42611b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:91ae54d3-c9b6-48b1-bdd1-d202bd42611b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:20:30,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:20:30,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:20:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:20:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
teamsyncworker stdout | 2024-04-22 04:20:30,967 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
quotatotalworker stdout | 2024-04-22 04:20:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:20:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:20:46.054492+00:00 (in 14.999466 seconds)
quotatotalworker stdout | 2024-04-22 04:20:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:20:46 UTC)" (scheduled at 2024-04-22 04:20:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:20:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:20:31,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:20:31,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:20:46 UTC)" executed successfully
chunkcleanupworker stdout | 2024-04-22 04:20:31,108 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotaregistrysizeworker stdout | 2024-04-22 04:20:31,934 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:20:33,590 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:20:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:20:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:20:43.759375+00:00 (in 9.999445 seconds)
notificationworker stdout | 2024-04-22 04:20:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:20:43 UTC)" (scheduled at 2024-04-22 04:20:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:20:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:20:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 20, 33, 760360), True, datetime.datetime(2024, 4, 22, 4, 20, 33, 760360), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:20:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:20:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:20:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:20:43 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 04:20:34,937 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:20:34,942 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:20:34,945 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
buildlogsarchiver stdout | 2024-04-22 04:20:34,997 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:20:35,057 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:20:35,361 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:20:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:20:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:20:56.873109+00:00 (in 21.000760 seconds)
securityworker stdout | 2024-04-22 04:20:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:21:05 UTC)" (scheduled at 2024-04-22 04:20:35.871852+00:00)
securityworker stdout | 2024-04-22 04:20:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:20:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:20:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:20:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:20:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:20:35,888 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:20:35,890 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:20:35,890 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:20:35,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 15, 35, 876342), 1, 2])
securityworker stdout | 2024-04-22 04:20:35,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:20:35,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:20:35,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 15, 35, 876342), 1, 2])
securityworker stdout | 2024-04-22 04:20:35,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:20:35,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:20:35,896 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:20:35,896 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:21:05 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:20:36,411 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:20:37,613 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:20:37,662 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:20:37,897 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:20:38,787 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
exportactionlogsworker stdout | 2024-04-22 04:20:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:20:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:20:41.564959+00:00 (in 1.997449 seconds)
exportactionlogsworker stdout | 2024-04-22 04:20:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:21:39 UTC)" (scheduled at 2024-04-22 04:20:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:20:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:20:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:21:39 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:20:39,825 [278] [DEBUG] [app] Starting request: urn:request:bcc1bb6c-4b50-4140-9113-1ab0fc8a4e9c (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:20:39,825 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:39,825 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:39,826 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:39,836 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:20:39,836 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:20:39,836 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:39,836 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:20:39,836 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:39,836 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:39,836 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:39,836 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:39,838 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:20:39,844 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:39,845 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:39,849 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:20:39,853 [278] [DEBUG] [app] Ending request: urn:request:bcc1bb6c-4b50-4140-9113-1ab0fc8a4e9c (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:bcc1bb6c-4b50-4140-9113-1ab0fc8a4e9c', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:20:39,854 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:20:39,854 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:20:39 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:20:39 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1555 0.030)
securityworker stdout | 2024-04-22 04:20:40,115 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:20:40,186 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:20:40,519 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:20:40,542 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
autopruneworker stdout | 2024-04-22 04:20:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:20:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:21:11.264267+00:00 (in 29.999462 seconds)
autopruneworker stdout | 2024-04-22 04:20:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:21:11 UTC)" (scheduled at 2024-04-22 04:20:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:20:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759581271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:20:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:20:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:20:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:21:11 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:20:41,296 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:20:41,309 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:20:41,313 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:20:41,318 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:20:41,323 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:20:41,330 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:20:41,332 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:20:41,336 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:20:41,339 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
exportactionlogsworker stdout | 2024-04-22 04:20:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:20:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:21:39.566970+00:00 (in 58.001468 seconds)
exportactionlogsworker stdout | 2024-04-22 04:20:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:21:41 UTC)" (scheduled at 2024-04-22 04:20:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:20:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:20:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 20, 41, 565771), True, datetime.datetime(2024, 4, 22, 4, 20, 41, 565771), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:20:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:20:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:20:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:21:41 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:20:41,978 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
namespacegcworker stdout | 2024-04-22 04:20:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:20:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:21:22.058978+00:00 (in 39.001346 seconds)
namespacegcworker stdout | 2024-04-22 04:20:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:21:43 UTC)" (scheduled at 2024-04-22 04:20:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:20:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:20:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 20, 43, 58088), True, datetime.datetime(2024, 4, 22, 4, 20, 43, 58088), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:20:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:20:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:20:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:21:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:20:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:20:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:20:53.759375+00:00 (in 9.999535 seconds)
notificationworker stdout | 2024-04-22 04:20:43,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:20:53 UTC)" (scheduled at 2024-04-22 04:20:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:20:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:20:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 20, 43, 760093), True, datetime.datetime(2024, 4, 22, 4, 20, 43, 760093), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:20:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:20:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:20:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:20:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:20:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:20:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:21:14.952062+00:00 (in 29.999520 seconds)
gcworker stdout | 2024-04-22 04:20:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:21:14 UTC)" (scheduled at 2024-04-22 04:20:44.952062+00:00)
gcworker stdout | 2024-04-22 04:20:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712550044952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:20:44,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:20:44,964 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:20:44,964 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:21:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:20:45,653 [282] [DEBUG] [app] Starting request: urn:request:b9431d9a-6a72-4e9a-846d-47ca08ceaeb4 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:20:45,653 [278] [DEBUG] [app] Starting request: urn:request:43119a01-1dad-4d98-8dfb-38ad44c8e64a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:20:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:20:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:20:45,656 [284] [DEBUG] [app] Starting request: urn:request:9c12e1f0-7603-4101-98e3-3443522e752f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:20:45,656 [288] [DEBUG] [app] Starting request: urn:request:129dadb3-f2e7-4fec-823a-9d6822620c5c (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:20:45,656 [288] [DEBUG] [app] Ending request: urn:request:129dadb3-f2e7-4fec-823a-9d6822620c5c (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:129dadb3-f2e7-4fec-823a-9d6822620c5c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:20:45,656 [284] [DEBUG] [app] Ending request: urn:request:9c12e1f0-7603-4101-98e3-3443522e752f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:9c12e1f0-7603-4101-98e3-3443522e752f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:20:45,656 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:20:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:20:45,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:20:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:20:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:20:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:20:45,656 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:20:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:20:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:20:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:20:45,659 [282] [DEBUG] [app] Starting request: urn:request:1f46bb2b-86f4-4532-82d3-15bb07343276 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:20:45,659 [282] [DEBUG] [app] Ending request: urn:request:1f46bb2b-86f4-4532-82d3-15bb07343276 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1f46bb2b-86f4-4532-82d3-15bb07343276', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:20:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:20:45,659 [281] [DEBUG] [app] Starting request: urn:request:deaf853e-bf5f-447c-ab22-58480951ed93 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:20:45,659 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:20:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:20:45,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:20:45,660 [281] [DEBUG] [app] Ending request: urn:request:deaf853e-bf5f-447c-ab22-58480951ed93 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:deaf853e-bf5f-447c-ab22-58480951ed93', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:20:45,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:20:45,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:20:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:20:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:20:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.001)
gunicorn-web stdout | 2024-04-22 04:20:45,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:20:45,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:20:45,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:20:45,674 [282] [DEBUG] [app] Ending request: urn:request:b9431d9a-6a72-4e9a-846d-47ca08ceaeb4 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b9431d9a-6a72-4e9a-846d-47ca08ceaeb4', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:20:45,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:20:45,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:20:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:20:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:20:45,674 [278] [DEBUG] [app] Ending request: urn:request:43119a01-1dad-4d98-8dfb-38ad44c8e64a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:43119a01-1dad-4d98-8dfb-38ad44c8e64a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:20:45,674 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:20:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.023)
gunicorn-web stdout | 2024-04-22 04:20:45,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:20:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:20:45,943 [279] [DEBUG] [app] Starting request: urn:request:9eb07ea3-bf03-45af-81ac-d3c011ef6c3f (/api/v1/user/notifications/b9d5d775-3afe-4509-ae1a-0b6c840bded0) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:20:45,943 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:45,943 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:45,943 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:45,952 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:20:45,953 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:20:45,953 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:45,953 [279] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:20:45,953 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:45,953 [279] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:45,953 [279] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:45,953 [279] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:45,955 [279] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."uuid" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', ['b9d5d775-3afe-4509-ae1a-0b6c840bded0', 1, 'b9d5d775-3afe-4509-ae1a-0b6c840bded0', 1, 'admin', 1])
gunicorn-web stdout | 2024-04-22 04:20:45,961 [279] [DEBUG] [peewee] ('UPDATE "notification" SET "uuid" = %s, "kind_id" = %s, "target_id" = %s, "metadata_json" = %s, "created" = %s, "dismissed" = %s, "lookup_path" = %s WHERE ("notification"."id" = %s)', ['b9d5d775-3afe-4509-ae1a-0b6c840bded0', 12, 1, '{"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68467", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2022-4304", "priority": "", "has_fix": true}}', datetime.datetime(2024, 4, 22, 4, 12, 46, 843580), True, None, 14])
gunicorn-web stdout | 2024-04-22 04:20:45,965 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:45,967 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:45,969 [279] [DEBUG] [app] Ending request: urn:request:9eb07ea3-bf03-45af-81ac-d3c011ef6c3f (/api/v1/user/notifications/b9d5d775-3afe-4509-ae1a-0b6c840bded0) {'endpoint': 'api.usernotification', 'request_id': 'urn:request:9eb07ea3-bf03-45af-81ac-d3c011ef6c3f', 'remote_addr': '10.128.2.8', 'http_method': 'PUT', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/notifications/b9d5d775-3afe-4509-ae1a-0b6c840bded0', 'path': '/api/v1/user/notifications/b9d5d775-3afe-4509-ae1a-0b6c840bded0', 'parameters': {}, 'json_body': {'id': 'b9d5d775-3afe-4509-ae1a-0b6c840bded0', 'organization': None, 'kind': 'vulnerability_found', 'created': 'Mon, 22 Apr 2024 04:12:46 -0000', 'metadata': {'repository': 'build_test/pushno', 'namespace': 'build_test', 'name': 'pushno', 'docker_url': 'quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno', 'homepage': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno', 'vulnerable_index_report_created': 'true', 'vulnerability': {'id': '68467', 'description': '', 'link': 'https://www.cve.org/CVERecord?id=CVE-2022-4304', 'priority': '', 'has_fix': True}}, 'dismissed': True}, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:20:45,970 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:20:45,970 [279] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:20:45 +0000] "PUT /api/v1/user/notifications/b9d5d775-3afe-4509-ae1a-0b6c840bded0 HTTP/1.0" 200 701 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:20:45 +0000] "PUT /api/v1/user/notifications/b9d5d775-3afe-4509-ae1a-0b6c840bded0 HTTP/1.1" 200 701 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 2383 0.029)
quotatotalworker stdout | 2024-04-22 04:20:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:20:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:21:01.054492+00:00 (in 14.999459 seconds)
quotatotalworker stdout | 2024-04-22 04:20:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:21:01 UTC)" (scheduled at 2024-04-22 04:20:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:20:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:20:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:20:46,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:21:01 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:20:46,297 [278] [DEBUG] [app] Starting request: urn:request:a1dbe6ff-f1bd-4e53-bdf3-a13d01d6502e (/api/v1/user/notifications) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:20:46,297 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:46,297 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:46,298 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:46,308 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:20:46,308 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:20:46,308 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:46,308 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:20:46,308 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:46,308 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:46,308 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:46,308 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:46,309 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."dismissed" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."dismissed" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', [False, 1, False, 1, 'admin', 6])
gunicorn-web stdout | 2024-04-22 04:20:46,315 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:46,317 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:46,320 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:46,322 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:46,324 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:46,326 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:46,328 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:46,330 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:46,332 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:46,334 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:46,337 [278] [DEBUG] [app] Ending request: urn:request:a1dbe6ff-f1bd-4e53-bdf3-a13d01d6502e (/api/v1/user/notifications) {'endpoint': 'api.usernotificationlist', 'request_id': 'urn:request:a1dbe6ff-f1bd-4e53-bdf3-a13d01d6502e', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/notifications', 'path': '/api/v1/user/notifications', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:20:46,337 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:20:46,337 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:20:46 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 3556 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:20:46 +0000] "GET /api/v1/user/notifications HTTP/1.1" 200 3556 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.041 1511 0.041)
gunicorn-web stdout | 2024-04-22 04:20:47,015 [278] [DEBUG] [app] Starting request: urn:request:7d366207-4a8b-40ba-86c2-fe929f4de370 (/api/v1/user/apptoken) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:20:47,015 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:47,015 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:47,016 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:47,025 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:20:47,025 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:20:47,025 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:47,025 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:20:47,025 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:47,025 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:47,025 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:47,026 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:47,026 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."uuid", "t1"."title", "t1"."token_name", "t1"."token_secret", "t1"."created", "t1"."expiration", "t1"."last_accessed" FROM "appspecificauthtoken" AS "t1" WHERE ((("t1"."user_id" = %s) AND ("t1"."expiration" <= %s)) AND ("t1"."expiration" > %s))', [1, datetime.datetime(2024, 4, 24, 23, 32, 47, 26136), datetime.datetime(2024, 4, 22, 4, 20, 47, 26180)])
gunicorn-web stdout | 2024-04-22 04:20:47,028 [278] [DEBUG] [app] Ending request: urn:request:7d366207-4a8b-40ba-86c2-fe929f4de370 (/api/v1/user/apptoken) {'endpoint': 'api.apptokens', 'request_id': 'urn:request:7d366207-4a8b-40ba-86c2-fe929f4de370', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/apptoken?expiring=true', 'path': '/api/v1/user/apptoken', 'parameters': {'expiring': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:20:47,029 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:20:47,029 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:20:47 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:20:47 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.1" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.016 1520 0.016)
buildlogsarchiver stdout | 2024-04-22 04:20:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:20:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:21:17.052354+00:00 (in 29.999562 seconds)
buildlogsarchiver stdout | 2024-04-22 04:20:47,052 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:21:17 UTC)" (scheduled at 2024-04-22 04:20:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:20:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 20, 47, 53172), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:20:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:20:47,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:20:47,063 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:21:17 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:20:48,650 [278] [DEBUG] [app] Starting request: urn:request:751dbd07-9414-404b-989c-0b9137a56812 (/api/v1/user/notifications/2eb11cc7-ca69-4e22-a528-7035ebc969af) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:20:48,650 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:48,650 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:48,651 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:48,660 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:20:48,660 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:20:48,660 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:48,660 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:20:48,660 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:48,660 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:48,660 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:48,660 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:48,662 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."uuid" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', ['2eb11cc7-ca69-4e22-a528-7035ebc969af', 1, '2eb11cc7-ca69-4e22-a528-7035ebc969af', 1, 'admin', 1])
gunicorn-web stdout | 2024-04-22 04:20:48,667 [278] [DEBUG] [peewee] ('UPDATE "notification" SET "uuid" = %s, "kind_id" = %s, "target_id" = %s, "metadata_json" = %s, "created" = %s, "dismissed" = %s, "lookup_path" = %s WHERE ("notification"."id" = %s)', ['2eb11cc7-ca69-4e22-a528-7035ebc969af', 12, 1, '{"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "71141", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2022-37434", "priority": "", "has_fix": true}}', datetime.datetime(2024, 4, 22, 4, 12, 46, 291056), True, None, 13])
gunicorn-web stdout | 2024-04-22 04:20:48,672 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:48,674 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:48,676 [278] [DEBUG] [app] Ending request: urn:request:751dbd07-9414-404b-989c-0b9137a56812 (/api/v1/user/notifications/2eb11cc7-ca69-4e22-a528-7035ebc969af) {'endpoint': 'api.usernotification', 'request_id': 'urn:request:751dbd07-9414-404b-989c-0b9137a56812', 'remote_addr': '10.128.2.8', 'http_method': 'PUT', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/notifications/2eb11cc7-ca69-4e22-a528-7035ebc969af', 'path': '/api/v1/user/notifications/2eb11cc7-ca69-4e22-a528-7035ebc969af', 'parameters': {}, 'json_body': {'id': '2eb11cc7-ca69-4e22-a528-7035ebc969af', 'organization': None, 'kind': 'vulnerability_found', 'created': 'Mon, 22 Apr 2024 04:12:46 -0000', 'metadata': {'repository': 'build_test/pushno', 'namespace': 'build_test', 'name': 'pushno', 'docker_url': 'quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno', 'homepage': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno', 'vulnerable_index_report_created': 'true', 'vulnerability': {'id': '71141', 'description': '', 'link': 'https://www.cve.org/CVERecord?id=CVE-2022-37434', 'priority': '', 'has_fix': True}}, 'dismissed': True}, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:20:48,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:20:48,677 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:20:48 +0000] "PUT /api/v1/user/notifications/2eb11cc7-ca69-4e22-a528-7035ebc969af HTTP/1.0" 200 702 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:20:48 +0000] "PUT /api/v1/user/notifications/2eb11cc7-ca69-4e22-a528-7035ebc969af HTTP/1.1" 200 702 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.028 2384 0.028)
gunicorn-web stdout | 2024-04-22 04:20:49,101 [281] [DEBUG] [app] Starting request: urn:request:0e472669-5dae-4012-895a-954ef8a0bc97 (/api/v1/user/apptoken) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:20:49,101 [278] [DEBUG] [app] Starting request: urn:request:50da91ef-d7c8-4733-b852-f3d46b8244de (/api/v1/user/notifications) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:20:49,101 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:49,101 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:49,101 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:49,101 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:49,102 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:49,102 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:49,111 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:20:49,111 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:20:49,111 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:20:49,111 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:49,111 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:20:49,111 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:49,111 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:20:49,111 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:49,111 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:20:49,111 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:49,111 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:49,111 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:49,112 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:49,112 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:49,112 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:49,112 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:49,112 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."uuid", "t1"."title", "t1"."token_name", "t1"."token_secret", "t1"."created", "t1"."expiration", "t1"."last_accessed" FROM "appspecificauthtoken" AS "t1" WHERE ((("t1"."user_id" = %s) AND ("t1"."expiration" <= %s)) AND ("t1"."expiration" > %s))', [1, datetime.datetime(2024, 4, 24, 23, 32, 49, 112157), datetime.datetime(2024, 4, 22, 4, 20, 49, 112206)])
gunicorn-web stdout | 2024-04-22 04:20:49,113 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."dismissed" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."dismissed" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', [False, 1, False, 1, 'admin', 6])
gunicorn-web stdout | 2024-04-22 04:20:49,115 [281] [DEBUG] [app] Ending request: urn:request:0e472669-5dae-4012-895a-954ef8a0bc97 (/api/v1/user/apptoken) {'endpoint': 'api.apptokens', 'request_id': 'urn:request:0e472669-5dae-4012-895a-954ef8a0bc97', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/apptoken?expiring=true', 'path': '/api/v1/user/apptoken', 'parameters': {'expiring': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:20:49,115 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:20:49 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.1" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.015 1520 0.015)
gunicorn-web stdout | 2024-04-22 04:20:49,115 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:20:49 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:20:49,119 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:49,121 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:49,123 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:49,125 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:49,127 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:49,130 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:49,132 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:49,134 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:49,136 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:49,138 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:49,140 [278] [DEBUG] [app] Ending request: urn:request:50da91ef-d7c8-4733-b852-f3d46b8244de (/api/v1/user/notifications) {'endpoint': 'api.usernotificationlist', 'request_id': 'urn:request:50da91ef-d7c8-4733-b852-f3d46b8244de', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/notifications', 'path': '/api/v1/user/notifications', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:20:49,141 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:20:49,141 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:20:49 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 3555 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:20:49 +0000] "GET /api/v1/user/notifications HTTP/1.1" 200 3555 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.041 1511 0.041)
gunicorn-web stdout | 2024-04-22 04:20:50,546 [278] [DEBUG] [app] Starting request: urn:request:6df3ae13-6496-4dbe-9952-43356bf5491f (/api/v1/user/notifications/f06c857f-3646-47b5-a72d-a0dd7104c8e8) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:20:50,546 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:50,546 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:50,547 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:50,556 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:20:50,556 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:20:50,556 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:50,556 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:20:50,557 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:50,557 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:50,557 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:50,557 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:50,558 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."uuid" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', ['f06c857f-3646-47b5-a72d-a0dd7104c8e8', 1, 'f06c857f-3646-47b5-a72d-a0dd7104c8e8', 1, 'admin', 1])
gunicorn-web stdout | 2024-04-22 04:20:50,564 [278] [DEBUG] [peewee] ('UPDATE "notification" SET "uuid" = %s, "kind_id" = %s, "target_id" = %s, "metadata_json" = %s, "created" = %s, "dismissed" = %s, "lookup_path" = %s WHERE ("notification"."id" = %s)', ['f06c857f-3646-47b5-a72d-a0dd7104c8e8', 12, 1, '{"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68448", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2023-0464", "priority": "", "has_fix": true}}', datetime.datetime(2024, 4, 22, 4, 12, 46, 210969), True, None, 12])
gunicorn-web stdout | 2024-04-22 04:20:50,568 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:50,570 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:50,572 [278] [DEBUG] [app] Ending request: urn:request:6df3ae13-6496-4dbe-9952-43356bf5491f (/api/v1/user/notifications/f06c857f-3646-47b5-a72d-a0dd7104c8e8) {'endpoint': 'api.usernotification', 'request_id': 'urn:request:6df3ae13-6496-4dbe-9952-43356bf5491f', 'remote_addr': '10.128.2.8', 'http_method': 'PUT', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/notifications/f06c857f-3646-47b5-a72d-a0dd7104c8e8', 'path': '/api/v1/user/notifications/f06c857f-3646-47b5-a72d-a0dd7104c8e8', 'parameters': {}, 'json_body': {'id': 'f06c857f-3646-47b5-a72d-a0dd7104c8e8', 'organization': None, 'kind': 'vulnerability_found', 'created': 'Mon, 22 Apr 2024 04:12:46 -0000', 'metadata': {'repository': 'build_test/pushno', 'namespace': 'build_test', 'name': 'pushno', 'docker_url': 'quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno', 'homepage': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno', 'vulnerable_index_report_created': 'true', 'vulnerability': {'id': '68448', 'description': '', 'link': 'https://www.cve.org/CVERecord?id=CVE-2023-0464', 'priority': '', 'has_fix': True}}, 'dismissed': True}, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:20:50,573 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:20:50,573 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:20:50 +0000] "PUT /api/v1/user/notifications/f06c857f-3646-47b5-a72d-a0dd7104c8e8 HTTP/1.0" 200 701 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:20:50 +0000] "PUT /api/v1/user/notifications/f06c857f-3646-47b5-a72d-a0dd7104c8e8 HTTP/1.1" 200 701 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.028 2383 0.028)
gunicorn-web stdout | 2024-04-22 04:20:50,898 [279] [DEBUG] [app] Starting request: urn:request:783e83bd-3711-40b9-932e-a13a52ffafb5 (/api/v1/user/notifications) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:20:50,898 [281] [DEBUG] [app] Starting request: urn:request:fecf8b7f-0d18-4103-8257-55ac54bf2852 (/api/v1/user/apptoken) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:20:50,898 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:50,898 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:50,898 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:50,898 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:50,899 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:50,899 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:50,908 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:20:50,908 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:20:50,908 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:50,908 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:20:50,908 [279] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:20:50,908 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:20:50,908 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:50,908 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:50,909 [279] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:50,909 [279] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:50,909 [279] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:50,909 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:20:50,909 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:50,909 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:50,909 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:50,909 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:50,909 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."uuid", "t1"."title", "t1"."token_name", "t1"."token_secret", "t1"."created", "t1"."expiration", "t1"."last_accessed" FROM "appspecificauthtoken" AS "t1" WHERE ((("t1"."user_id" = %s) AND ("t1"."expiration" <= %s)) AND ("t1"."expiration" > %s))', [1, datetime.datetime(2024, 4, 24, 23, 32, 50, 909437), datetime.datetime(2024, 4, 22, 4, 20, 50, 909474)])
gunicorn-web stdout | 2024-04-22 04:20:50,910 [279] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."dismissed" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."dismissed" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', [False, 1, False, 1, 'admin', 6])
gunicorn-web stdout | 2024-04-22 04:20:50,912 [281] [DEBUG] [app] Ending request: urn:request:fecf8b7f-0d18-4103-8257-55ac54bf2852 (/api/v1/user/apptoken) {'endpoint': 'api.apptokens', 'request_id': 'urn:request:fecf8b7f-0d18-4103-8257-55ac54bf2852', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/apptoken?expiring=true', 'path': '/api/v1/user/apptoken', 'parameters': {'expiring': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:20:50,912 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:20:50,913 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:20:50 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:20:50 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.1" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.015 1520 0.015)
gunicorn-web stdout | 2024-04-22 04:20:50,916 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:50,918 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:50,920 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:50,922 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:50,924 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:50,926 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:50,929 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:50,931 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:50,933 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:50,935 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:50,937 [279] [DEBUG] [app] Ending request: urn:request:783e83bd-3711-40b9-932e-a13a52ffafb5 (/api/v1/user/notifications) {'endpoint': 'api.usernotificationlist', 'request_id': 'urn:request:783e83bd-3711-40b9-932e-a13a52ffafb5', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/notifications', 'path': '/api/v1/user/notifications', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:20:50,938 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:20:50,938 [279] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:20:50 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 3555 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:20:50 +0000] "GET /api/v1/user/notifications HTTP/1.1" 200 3555 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.041 1511 0.041)
expiredappspecifictokenworker stdout | 2024-04-22 04:20:51,058 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:20:52,301 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
gunicorn-web stdout | 2024-04-22 04:20:52,402 [282] [DEBUG] [app] Starting request: urn:request:a9f0d658-5b0d-4bd0-b4c4-5679626d725c (/api/v1/user/notifications/e4cf6d18-570a-4982-bf09-4e2c50127249) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:20:52,402 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:52,402 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:52,403 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:52,412 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:20:52,412 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:20:52,412 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:52,412 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:20:52,412 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:52,412 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:52,413 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:52,413 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:52,415 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."uuid" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', ['e4cf6d18-570a-4982-bf09-4e2c50127249', 1, 'e4cf6d18-570a-4982-bf09-4e2c50127249', 1, 'admin', 1])
gunicorn-web stdout | 2024-04-22 04:20:52,420 [282] [DEBUG] [peewee] ('UPDATE "notification" SET "uuid" = %s, "kind_id" = %s, "target_id" = %s, "metadata_json" = %s, "created" = %s, "dismissed" = %s, "lookup_path" = %s WHERE ("notification"."id" = %s)', ['e4cf6d18-570a-4982-bf09-4e2c50127249', 12, 1, '{"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68476", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2023-0286", "priority": "", "has_fix": true}}', datetime.datetime(2024, 4, 22, 4, 12, 46, 121167), True, None, 11])
gunicorn-web stdout | 2024-04-22 04:20:52,424 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:52,426 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:52,428 [282] [DEBUG] [app] Ending request: urn:request:a9f0d658-5b0d-4bd0-b4c4-5679626d725c (/api/v1/user/notifications/e4cf6d18-570a-4982-bf09-4e2c50127249) {'endpoint': 'api.usernotification', 'request_id': 'urn:request:a9f0d658-5b0d-4bd0-b4c4-5679626d725c', 'remote_addr': '10.128.2.8', 'http_method': 'PUT', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/notifications/e4cf6d18-570a-4982-bf09-4e2c50127249', 'path': '/api/v1/user/notifications/e4cf6d18-570a-4982-bf09-4e2c50127249', 'parameters': {}, 'json_body': {'id': 'e4cf6d18-570a-4982-bf09-4e2c50127249', 'organization': None, 'kind': 'vulnerability_found', 'created': 'Mon, 22 Apr 2024 04:12:46 -0000', 'metadata': {'repository': 'build_test/pushno', 'namespace': 'build_test', 'name': 'pushno', 'docker_url': 'quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno', 'homepage': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno', 'vulnerable_index_report_created': 'true', 'vulnerability': {'id': '68476', 'description': '', 'link': 'https://www.cve.org/CVERecord?id=CVE-2023-0286', 'priority': '', 'has_fix': True}}, 'dismissed': True}, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:20:52,429 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:20:52,429 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:20:52 +0000] "PUT /api/v1/user/notifications/e4cf6d18-570a-4982-bf09-4e2c50127249 HTTP/1.0" 200 701 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:20:52 +0000] "PUT /api/v1/user/notifications/e4cf6d18-570a-4982-bf09-4e2c50127249 HTTP/1.1" 200 701 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.029 2383 0.028)
gunicorn-web stdout | 2024-04-22 04:20:52,753 [278] [DEBUG] [app] Starting request: urn:request:d61d9732-f02e-4678-9565-3c964879be0f (/api/v1/user/notifications) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:20:52,753 [282] [DEBUG] [app] Starting request: urn:request:5d9f81ae-8b07-4480-9864-5e859fa6bf04 (/api/v1/user/apptoken) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:20:52,753 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:52,753 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:52,754 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:52,754 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:52,754 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:52,754 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:52,763 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:20:52,763 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:20:52,763 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:52,763 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:20:52,764 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:52,764 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:52,764 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:52,764 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:52,764 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:20:52,764 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:20:52,764 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:52,764 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:20:52,764 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:52,764 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:52,764 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:52,765 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:52,765 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."uuid", "t1"."title", "t1"."token_name", "t1"."token_secret", "t1"."created", "t1"."expiration", "t1"."last_accessed" FROM "appspecificauthtoken" AS "t1" WHERE ((("t1"."user_id" = %s) AND ("t1"."expiration" <= %s)) AND ("t1"."expiration" > %s))', [1, datetime.datetime(2024, 4, 24, 23, 32, 52, 764389), datetime.datetime(2024, 4, 22, 4, 20, 52, 764435)])
gunicorn-web stdout | 2024-04-22 04:20:52,766 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."dismissed" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."dismissed" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', [False, 1, False, 1, 'admin', 6])
gunicorn-web stdout | 2024-04-22 04:20:52,767 [282] [DEBUG] [app] Ending request: urn:request:5d9f81ae-8b07-4480-9864-5e859fa6bf04 (/api/v1/user/apptoken) {'endpoint': 'api.apptokens', 'request_id': 'urn:request:5d9f81ae-8b07-4480-9864-5e859fa6bf04', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/apptoken?expiring=true', 'path': '/api/v1/user/apptoken', 'parameters': {'expiring': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:20:52,767 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:20:52,768 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:20:52 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:20:52 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.1" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.015 1520 0.015)
gunicorn-web stdout | 2024-04-22 04:20:52,771 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:52,773 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:52,775 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:52,778 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:52,780 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:52,782 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:52,784 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:52,786 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:52,788 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:52,790 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:52,792 [278] [DEBUG] [app] Ending request: urn:request:d61d9732-f02e-4678-9565-3c964879be0f (/api/v1/user/notifications) {'endpoint': 'api.usernotificationlist', 'request_id': 'urn:request:d61d9732-f02e-4678-9565-3c964879be0f', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/notifications', 'path': '/api/v1/user/notifications', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:20:52,793 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:20:52 +0000] "GET /api/v1/user/notifications HTTP/1.1" 200 3556 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.041 1511 0.041)
gunicorn-web stdout | 2024-04-22 04:20:52,793 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:20:52 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 3556 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
notificationworker stdout | 2024-04-22 04:20:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:20:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:21:03.759375+00:00 (in 9.999488 seconds)
notificationworker stdout | 2024-04-22 04:20:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:21:03 UTC)" (scheduled at 2024-04-22 04:20:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:20:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:20:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 20, 53, 760346), True, datetime.datetime(2024, 4, 22, 4, 20, 53, 760346), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:20:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:20:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:20:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:21:03 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:20:54,154 [282] [DEBUG] [app] Starting request: urn:request:d63ae620-004f-4abd-8aef-050690400974 (/api/v1/user/notifications/0986eed1-1eca-42ee-8e23-6ba3ae4d60ad) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:20:54,154 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:54,154 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:54,155 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:54,164 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:20:54,165 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:20:54,165 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:54,165 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:20:54,165 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:54,165 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:54,165 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:54,165 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:54,167 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."uuid" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', ['0986eed1-1eca-42ee-8e23-6ba3ae4d60ad', 1, '0986eed1-1eca-42ee-8e23-6ba3ae4d60ad', 1, 'admin', 1])
gunicorn-web stdout | 2024-04-22 04:20:54,173 [282] [DEBUG] [peewee] ('UPDATE "notification" SET "uuid" = %s, "kind_id" = %s, "target_id" = %s, "metadata_json" = %s, "created" = %s, "dismissed" = %s, "lookup_path" = %s WHERE ("notification"."id" = %s)', ['0986eed1-1eca-42ee-8e23-6ba3ae4d60ad', 12, 1, '{"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68470", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2022-4450", "priority": "", "has_fix": true}}', datetime.datetime(2024, 4, 22, 4, 12, 46, 54910), True, None, 10])
gunicorn-web stdout | 2024-04-22 04:20:54,177 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:54,179 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:54,181 [282] [DEBUG] [app] Ending request: urn:request:d63ae620-004f-4abd-8aef-050690400974 (/api/v1/user/notifications/0986eed1-1eca-42ee-8e23-6ba3ae4d60ad) {'endpoint': 'api.usernotification', 'request_id': 'urn:request:d63ae620-004f-4abd-8aef-050690400974', 'remote_addr': '10.128.2.8', 'http_method': 'PUT', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/notifications/0986eed1-1eca-42ee-8e23-6ba3ae4d60ad', 'path': '/api/v1/user/notifications/0986eed1-1eca-42ee-8e23-6ba3ae4d60ad', 'parameters': {}, 'json_body': {'id': '0986eed1-1eca-42ee-8e23-6ba3ae4d60ad', 'organization': None, 'kind': 'vulnerability_found', 'created': 'Mon, 22 Apr 2024 04:12:46 -0000', 'metadata': {'repository': 'build_test/pushno', 'namespace': 'build_test', 'name': 'pushno', 'docker_url': 'quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno', 'homepage': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno', 'vulnerable_index_report_created': 'true', 'vulnerability': {'id': '68470', 'description': '', 'link': 'https://www.cve.org/CVERecord?id=CVE-2022-4450', 'priority': '', 'has_fix': True}}, 'dismissed': True}, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:20:54,182 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:20:54,182 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:20:54 +0000] "PUT /api/v1/user/notifications/0986eed1-1eca-42ee-8e23-6ba3ae4d60ad HTTP/1.0" 200 701 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:20:54 +0000] "PUT /api/v1/user/notifications/0986eed1-1eca-42ee-8e23-6ba3ae4d60ad HTTP/1.1" 200 701 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 2383 0.029)
gunicorn-web stdout | 2024-04-22 04:20:54,507 [281] [DEBUG] [app] Starting request: urn:request:5bd64386-6b8a-4c57-bea5-5f5ead80a83f (/api/v1/user/notifications) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:20:54,507 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:54,507 [279] [DEBUG] [app] Starting request: urn:request:cc1069f5-55c0-43f0-8055-7ccf726f608c (/api/v1/user/apptoken) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:20:54,507 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:54,507 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:54,507 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:54,508 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:54,508 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:54,517 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:20:54,517 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:20:54,517 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:20:54,517 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:54,517 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:20:54,518 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:54,518 [279] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:20:54,518 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:54,518 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:20:54,518 [279] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:54,518 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:54,518 [279] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:54,518 [279] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:54,518 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:54,518 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:54,518 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:54,518 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."uuid", "t1"."title", "t1"."token_name", "t1"."token_secret", "t1"."created", "t1"."expiration", "t1"."last_accessed" FROM "appspecificauthtoken" AS "t1" WHERE ((("t1"."user_id" = %s) AND ("t1"."expiration" <= %s)) AND ("t1"."expiration" > %s))', [1, datetime.datetime(2024, 4, 24, 23, 32, 54, 518414), datetime.datetime(2024, 4, 22, 4, 20, 54, 518464)])
gunicorn-web stdout | 2024-04-22 04:20:54,519 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."dismissed" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."dismissed" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', [False, 1, False, 1, 'admin', 6])
gunicorn-web stdout | 2024-04-22 04:20:54,521 [279] [DEBUG] [app] Ending request: urn:request:cc1069f5-55c0-43f0-8055-7ccf726f608c (/api/v1/user/apptoken) {'endpoint': 'api.apptokens', 'request_id': 'urn:request:cc1069f5-55c0-43f0-8055-7ccf726f608c', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/apptoken?expiring=true', 'path': '/api/v1/user/apptoken', 'parameters': {'expiring': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:20:54,521 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:20:54,522 [279] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:20:54 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:20:54 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.1" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.016 1520 0.016)
gunicorn-web stdout | 2024-04-22 04:20:54,525 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:54,527 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:54,530 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:54,532 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:54,534 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:54,536 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:54,538 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:54,540 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:54,542 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:54,544 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:54,547 [281] [DEBUG] [app] Ending request: urn:request:5bd64386-6b8a-4c57-bea5-5f5ead80a83f (/api/v1/user/notifications) {'endpoint': 'api.usernotificationlist', 'request_id': 'urn:request:5bd64386-6b8a-4c57-bea5-5f5ead80a83f', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/notifications', 'path': '/api/v1/user/notifications', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:20:54,547 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:20:54,548 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:20:54 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 3556 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:20:54 +0000] "GET /api/v1/user/notifications HTTP/1.1" 200 3556 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.041 1511 0.041)
builder stdout | 2024-04-22 04:20:55,969 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
gunicorn-web stdout | 2024-04-22 04:20:56,118 [279] [DEBUG] [app] Starting request: urn:request:0006a8e0-5a34-4d68-9a44-4b192d52619d (/api/v1/user/notifications/13f2ba0b-9766-4e80-be02-36e0d0f26db4) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:20:56,118 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:56,118 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:56,119 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:56,128 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:20:56,128 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:20:56,128 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:56,129 [279] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:20:56,129 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:56,129 [279] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:56,129 [279] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:56,129 [279] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:56,131 [279] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."uuid" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', ['13f2ba0b-9766-4e80-be02-36e0d0f26db4', 1, '13f2ba0b-9766-4e80-be02-36e0d0f26db4', 1, 'admin', 1])
gunicorn-web stdout | 2024-04-22 04:20:56,136 [279] [DEBUG] [peewee] ('UPDATE "notification" SET "uuid" = %s, "kind_id" = %s, "target_id" = %s, "metadata_json" = %s, "created" = %s, "dismissed" = %s, "lookup_path" = %s WHERE ("notification"."id" = %s)', ['13f2ba0b-9766-4e80-be02-36e0d0f26db4', 12, 1, '{"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68495", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2023-2650", "priority": "", "has_fix": true}}', datetime.datetime(2024, 4, 22, 4, 12, 45, 32480), True, None, 9])
gunicorn-web stdout | 2024-04-22 04:20:56,141 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:56,143 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:56,146 [279] [DEBUG] [app] Ending request: urn:request:0006a8e0-5a34-4d68-9a44-4b192d52619d (/api/v1/user/notifications/13f2ba0b-9766-4e80-be02-36e0d0f26db4) {'endpoint': 'api.usernotification', 'request_id': 'urn:request:0006a8e0-5a34-4d68-9a44-4b192d52619d', 'remote_addr': '10.128.2.8', 'http_method': 'PUT', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/notifications/13f2ba0b-9766-4e80-be02-36e0d0f26db4', 'path': '/api/v1/user/notifications/13f2ba0b-9766-4e80-be02-36e0d0f26db4', 'parameters': {}, 'json_body': {'id': '13f2ba0b-9766-4e80-be02-36e0d0f26db4', 'organization': None, 'kind': 'vulnerability_found', 'created': 'Mon, 22 Apr 2024 04:12:45 -0000', 'metadata': {'repository': 'build_test/pushno', 'namespace': 'build_test', 'name': 'pushno', 'docker_url': 'quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno', 'homepage': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno', 'vulnerable_index_report_created': 'true', 'vulnerability': {'id': '68495', 'description': '', 'link': 'https://www.cve.org/CVERecord?id=CVE-2023-2650', 'priority': '', 'has_fix': True}}, 'dismissed': True}, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:20:56,146 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:20:56,146 [279] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:20:56 +0000] "PUT /api/v1/user/notifications/13f2ba0b-9766-4e80-be02-36e0d0f26db4 HTTP/1.0" 200 701 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:20:56 +0000] "PUT /api/v1/user/notifications/13f2ba0b-9766-4e80-be02-36e0d0f26db4 HTTP/1.1" 200 701 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 2383 0.029)
gunicorn-web stdout | 2024-04-22 04:20:56,471 [282] [DEBUG] [app] Starting request: urn:request:02fdb4e8-d0aa-4fa7-bdc6-b20cd5bb9550 (/api/v1/user/notifications) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:20:56,472 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:56,472 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:56,472 [281] [DEBUG] [app] Starting request: urn:request:5a96565d-a3c9-4ac2-8ac7-030b6ec48dac (/api/v1/user/apptoken) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:20:56,472 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:56,472 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:56,472 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:56,473 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:56,482 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:20:56,482 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:20:56,482 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:56,482 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:20:56,482 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:20:56,482 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:56,482 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:20:56,482 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:56,482 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:56,482 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:56,482 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:56,482 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:20:56,482 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:56,482 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:56,483 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:56,483 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:56,483 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."uuid", "t1"."title", "t1"."token_name", "t1"."token_secret", "t1"."created", "t1"."expiration", "t1"."last_accessed" FROM "appspecificauthtoken" AS "t1" WHERE ((("t1"."user_id" = %s) AND ("t1"."expiration" <= %s)) AND ("t1"."expiration" > %s))', [1, datetime.datetime(2024, 4, 24, 23, 32, 56, 483197), datetime.datetime(2024, 4, 22, 4, 20, 56, 483250)])
gunicorn-web stdout | 2024-04-22 04:20:56,484 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."dismissed" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."dismissed" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', [False, 1, False, 1, 'admin', 6])
gunicorn-web stdout | 2024-04-22 04:20:56,486 [281] [DEBUG] [app] Ending request: urn:request:5a96565d-a3c9-4ac2-8ac7-030b6ec48dac (/api/v1/user/apptoken) {'endpoint': 'api.apptokens', 'request_id': 'urn:request:5a96565d-a3c9-4ac2-8ac7-030b6ec48dac', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/apptoken?expiring=true', 'path': '/api/v1/user/apptoken', 'parameters': {'expiring': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:20:56,486 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:20:56 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.1" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.015 1520 0.015)
gunicorn-web stdout | 2024-04-22 04:20:56,486 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:20:56 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:20:56,490 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:56,492 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:56,494 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:56,496 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:56,498 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:56,500 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:56,502 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:56,504 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:56,507 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:56,509 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:56,511 [282] [DEBUG] [app] Ending request: urn:request:02fdb4e8-d0aa-4fa7-bdc6-b20cd5bb9550 (/api/v1/user/notifications) {'endpoint': 'api.usernotificationlist', 'request_id': 'urn:request:02fdb4e8-d0aa-4fa7-bdc6-b20cd5bb9550', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/notifications', 'path': '/api/v1/user/notifications', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:20:56,511 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:20:56 +0000] "GET /api/v1/user/notifications HTTP/1.1" 200 3556 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.042 1511 0.042)
gunicorn-web stdout | 2024-04-22 04:20:56,512 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:20:56 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 3556 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
securityworker stdout | 2024-04-22 04:20:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:20:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:21:05.871852+00:00 (in 8.998252 seconds)
securityworker stdout | 2024-04-22 04:20:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:21:26 UTC)" (scheduled at 2024-04-22 04:20:56.873109+00:00)
securityworker stdout | 2024-04-22 04:20:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:20:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:20:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:20:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:20:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:20:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:20:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:20:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:20:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:20:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:20:56,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:20:56,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:20:56,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 15, 56, 881126), 1, 2])
securityworker stdout | 2024-04-22 04:20:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:20:56,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:20:56,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 15, 56, 881126), 1, 2])
securityworker stdout | 2024-04-22 04:20:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:20:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:20:56,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:20:56,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:20:56,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:20:56,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:20:56,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:20:56,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:20:56,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:20:56,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:21:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:20:57,737 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
gunicorn-web stdout | 2024-04-22 04:20:58,044 [282] [DEBUG] [app] Starting request: urn:request:ff7ef8ed-f7c6-4e6c-b140-9f399337eb44 (/api/v1/user/notifications/68c3f40b-0fc5-4dfe-8d18-065c7a600aae) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:20:58,044 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:58,044 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:58,045 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:58,054 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:20:58,054 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:20:58,054 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:58,054 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:20:58,054 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:58,054 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:58,054 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:58,054 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:58,056 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."uuid" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', ['68c3f40b-0fc5-4dfe-8d18-065c7a600aae', 1, '68c3f40b-0fc5-4dfe-8d18-065c7a600aae', 1, 'admin', 1])
gunicorn-web stdout | 2024-04-22 04:20:58,061 [282] [DEBUG] [peewee] ('UPDATE "notification" SET "uuid" = %s, "kind_id" = %s, "target_id" = %s, "metadata_json" = %s, "created" = %s, "dismissed" = %s, "lookup_path" = %s WHERE ("notification"."id" = %s)', ['68c3f40b-0fc5-4dfe-8d18-065c7a600aae', 12, 1, '{"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68473", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2023-0215", "priority": "", "has_fix": true}}', datetime.datetime(2024, 4, 22, 4, 12, 44, 414711), True, None, 8])
gunicorn-web stdout | 2024-04-22 04:20:58,065 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:58,068 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:58,070 [282] [DEBUG] [app] Ending request: urn:request:ff7ef8ed-f7c6-4e6c-b140-9f399337eb44 (/api/v1/user/notifications/68c3f40b-0fc5-4dfe-8d18-065c7a600aae) {'endpoint': 'api.usernotification', 'request_id': 'urn:request:ff7ef8ed-f7c6-4e6c-b140-9f399337eb44', 'remote_addr': '10.128.2.8', 'http_method': 'PUT', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/notifications/68c3f40b-0fc5-4dfe-8d18-065c7a600aae', 'path': '/api/v1/user/notifications/68c3f40b-0fc5-4dfe-8d18-065c7a600aae', 'parameters': {}, 'json_body': {'id': '68c3f40b-0fc5-4dfe-8d18-065c7a600aae', 'organization': None, 'kind': 'vulnerability_found', 'created': 'Mon, 22 Apr 2024 04:12:44 -0000', 'metadata': {'repository': 'build_test/pushno', 'namespace': 'build_test', 'name': 'pushno', 'docker_url': 'quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno', 'homepage': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno', 'vulnerable_index_report_created': 'true', 'vulnerability': {'id': '68473', 'description': '', 'link': 'https://www.cve.org/CVERecord?id=CVE-2023-0215', 'priority': '', 'has_fix': True}}, 'dismissed': True}, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:20:58,070 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:20:58,070 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:20:58 +0000] "PUT /api/v1/user/notifications/68c3f40b-0fc5-4dfe-8d18-065c7a600aae HTTP/1.0" 200 701 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:20:58 +0000] "PUT /api/v1/user/notifications/68c3f40b-0fc5-4dfe-8d18-065c7a600aae HTTP/1.1" 200 701 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.029 2383 0.027)
gunicorn-web stdout | 2024-04-22 04:20:58,397 [282] [DEBUG] [app] Starting request: urn:request:2a7a3a72-164d-4301-88ac-4e8dfe6aef42 (/api/v1/user/notifications) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:20:58,397 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:58,397 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:58,397 [281] [DEBUG] [app] Starting request: urn:request:8a80cea4-7de0-464b-bf81-9e49002bbab4 (/api/v1/user/apptoken) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:20:58,397 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:58,397 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:58,398 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:58,398 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:58,406 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:20:58,406 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:20:58,406 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:58,406 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:20:58,406 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:58,406 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:58,406 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:58,406 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:58,407 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:20:58,407 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:20:58,407 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:58,407 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:20:58,407 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:58,407 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:58,407 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:58,407 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:58,408 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."uuid", "t1"."title", "t1"."token_name", "t1"."token_secret", "t1"."created", "t1"."expiration", "t1"."last_accessed" FROM "appspecificauthtoken" AS "t1" WHERE ((("t1"."user_id" = %s) AND ("t1"."expiration" <= %s)) AND ("t1"."expiration" > %s))', [1, datetime.datetime(2024, 4, 24, 23, 32, 58, 407747), datetime.datetime(2024, 4, 22, 4, 20, 58, 407805)])
gunicorn-web stdout | 2024-04-22 04:20:58,408 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."dismissed" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."dismissed" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', [False, 1, False, 1, 'admin', 6])
gunicorn-web stdout | 2024-04-22 04:20:58,410 [281] [DEBUG] [app] Ending request: urn:request:8a80cea4-7de0-464b-bf81-9e49002bbab4 (/api/v1/user/apptoken) {'endpoint': 'api.apptokens', 'request_id': 'urn:request:8a80cea4-7de0-464b-bf81-9e49002bbab4', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/apptoken?expiring=true', 'path': '/api/v1/user/apptoken', 'parameters': {'expiring': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:20:58,411 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:20:58,411 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:20:58 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:20:58 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.1" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.015 1520 0.015)
gunicorn-web stdout | 2024-04-22 04:20:58,413 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:58,415 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:58,418 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:58,420 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:58,422 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:58,424 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:58,426 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:58,428 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:58,431 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:58,433 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:58,435 [282] [DEBUG] [app] Ending request: urn:request:2a7a3a72-164d-4301-88ac-4e8dfe6aef42 (/api/v1/user/notifications) {'endpoint': 'api.usernotificationlist', 'request_id': 'urn:request:2a7a3a72-164d-4301-88ac-4e8dfe6aef42', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/notifications', 'path': '/api/v1/user/notifications', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:20:58,435 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:20:58 +0000] "GET /api/v1/user/notifications HTTP/1.1" 200 3556 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.039 1511 0.039)
gunicorn-web stdout | 2024-04-22 04:20:58,435 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:20:58 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 3556 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
quotatotalworker stdout | 2024-04-22 04:20:59,022 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:20:59,032 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:20:59,412 [282] [DEBUG] [app] Starting request: urn:request:aea679ec-73bf-410a-9898-4638b8e3bff1 (/api/v1/user/notifications/dca3f36b-0220-4de0-a30f-09f07183a2c5) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:20:59,412 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:59,412 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:59,413 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:59,423 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:20:59,423 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:20:59,423 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:59,423 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:20:59,423 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:59,423 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:59,423 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:59,423 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:59,425 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."uuid" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', ['dca3f36b-0220-4de0-a30f-09f07183a2c5', 1, 'dca3f36b-0220-4de0-a30f-09f07183a2c5', 1, 'admin', 1])
gunicorn-web stdout | 2024-04-22 04:20:59,430 [282] [DEBUG] [peewee] ('UPDATE "notification" SET "uuid" = %s, "kind_id" = %s, "target_id" = %s, "metadata_json" = %s, "created" = %s, "dismissed" = %s, "lookup_path" = %s WHERE ("notification"."id" = %s)', ['dca3f36b-0220-4de0-a30f-09f07183a2c5', 12, 1, '{"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "68526", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2023-0465", "priority": "", "has_fix": true}}', datetime.datetime(2024, 4, 22, 4, 12, 43, 825925), True, None, 7])
gunicorn-web stdout | 2024-04-22 04:20:59,435 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:59,437 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:59,439 [282] [DEBUG] [app] Ending request: urn:request:aea679ec-73bf-410a-9898-4638b8e3bff1 (/api/v1/user/notifications/dca3f36b-0220-4de0-a30f-09f07183a2c5) {'endpoint': 'api.usernotification', 'request_id': 'urn:request:aea679ec-73bf-410a-9898-4638b8e3bff1', 'remote_addr': '10.128.2.8', 'http_method': 'PUT', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/notifications/dca3f36b-0220-4de0-a30f-09f07183a2c5', 'path': '/api/v1/user/notifications/dca3f36b-0220-4de0-a30f-09f07183a2c5', 'parameters': {}, 'json_body': {'id': 'dca3f36b-0220-4de0-a30f-09f07183a2c5', 'organization': None, 'kind': 'vulnerability_found', 'created': 'Mon, 22 Apr 2024 04:12:43 -0000', 'metadata': {'repository': 'build_test/pushno', 'namespace': 'build_test', 'name': 'pushno', 'docker_url': 'quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno', 'homepage': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno', 'vulnerable_index_report_created': 'true', 'vulnerability': {'id': '68526', 'description': '', 'link': 'https://www.cve.org/CVERecord?id=CVE-2023-0465', 'priority': '', 'has_fix': True}}, 'dismissed': True}, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:20:59,439 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:20:59,440 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:20:59 +0000] "PUT /api/v1/user/notifications/dca3f36b-0220-4de0-a30f-09f07183a2c5 HTTP/1.0" 200 701 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:20:59 +0000] "PUT /api/v1/user/notifications/dca3f36b-0220-4de0-a30f-09f07183a2c5 HTTP/1.1" 200 701 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.029 2383 0.029)
gunicorn-web stdout | 2024-04-22 04:20:59,765 [279] [DEBUG] [app] Starting request: urn:request:776324e5-880d-44e9-a4e9-80a59cbbf038 (/api/v1/user/notifications) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:20:59,765 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:59,765 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:59,765 [282] [DEBUG] [app] Starting request: urn:request:c9948342-84fe-4c07-b9d9-509fea075d5b (/api/v1/user/apptoken) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:20:59,765 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:59,765 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:59,766 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:59,766 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:59,774 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:20:59,775 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:20:59,775 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:59,775 [279] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:20:59,775 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:59,775 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:20:59,775 [279] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:59,775 [279] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:59,775 [279] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:59,775 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:20:59,775 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:59,775 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:20:59,775 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:20:59,775 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:59,775 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:59,775 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:20:59,776 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."uuid", "t1"."title", "t1"."token_name", "t1"."token_secret", "t1"."created", "t1"."expiration", "t1"."last_accessed" FROM "appspecificauthtoken" AS "t1" WHERE ((("t1"."user_id" = %s) AND ("t1"."expiration" <= %s)) AND ("t1"."expiration" > %s))', [1, datetime.datetime(2024, 4, 24, 23, 32, 59, 776019), datetime.datetime(2024, 4, 22, 4, 20, 59, 776056)])
gunicorn-web stdout | 2024-04-22 04:20:59,776 [279] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."dismissed" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."dismissed" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', [False, 1, False, 1, 'admin', 6])
gunicorn-web stdout | 2024-04-22 04:20:59,778 [282] [DEBUG] [app] Ending request: urn:request:c9948342-84fe-4c07-b9d9-509fea075d5b (/api/v1/user/apptoken) {'endpoint': 'api.apptokens', 'request_id': 'urn:request:c9948342-84fe-4c07-b9d9-509fea075d5b', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/apptoken?expiring=true', 'path': '/api/v1/user/apptoken', 'parameters': {'expiring': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:20:59,779 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:20:59,779 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:20:59 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:20:59 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.1" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.015 1520 0.015)
gunicorn-web stdout | 2024-04-22 04:20:59,782 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:59,784 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:59,786 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:59,788 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:59,790 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:59,793 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:59,795 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:59,797 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:59,799 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:59,801 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:20:59,803 [279] [DEBUG] [app] Ending request: urn:request:776324e5-880d-44e9-a4e9-80a59cbbf038 (/api/v1/user/notifications) {'endpoint': 'api.usernotificationlist', 'request_id': 'urn:request:776324e5-880d-44e9-a4e9-80a59cbbf038', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/notifications', 'path': '/api/v1/user/notifications', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:20:59,804 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:20:59,804 [279] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:20:59 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 3556 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:20:59 +0000] "GET /api/v1/user/notifications HTTP/1.1" 200 3556 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.041 1511 0.041)
gunicorn-web stdout | 2024-04-22 04:21:00,366 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:21:00,392 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:21:00,423 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:21:00,458 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:21:00,461 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:21:00,653 [279] [DEBUG] [app] Starting request: urn:request:e79b6535-16b8-4549-9f08-b3646ed176ab (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:21:00,653 [281] [DEBUG] [app] Starting request: urn:request:68a06e0f-2b7d-459f-831b-14fa429b4a3c (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:21:00,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:21:00,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:21:00,656 [284] [DEBUG] [app] Starting request: urn:request:fc8d1433-18e3-4087-b108-9e9499b9d522 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:21:00,656 [284] [DEBUG] [app] Ending request: urn:request:fc8d1433-18e3-4087-b108-9e9499b9d522 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:fc8d1433-18e3-4087-b108-9e9499b9d522', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:21:00,656 [292] [DEBUG] [app] Starting request: urn:request:9eab0f42-b1ad-4883-b124-ad95da7b0c0a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:21:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:21:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:21:00,657 [292] [DEBUG] [app] Ending request: urn:request:9eab0f42-b1ad-4883-b124-ad95da7b0c0a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:9eab0f42-b1ad-4883-b124-ad95da7b0c0a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:21:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:21:00,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:21:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:21:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:21:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:21:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:21:00,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:21:00,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:21:00,659 [279] [DEBUG] [app] Starting request: urn:request:52574779-76ca-42b2-ba13-c0c7d6f4b59c (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:21:00,660 [282] [DEBUG] [app] Starting request: urn:request:fb694cbb-e2f1-4915-9680-8394dd0ebf68 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:21:00,660 [279] [DEBUG] [app] Ending request: urn:request:52574779-76ca-42b2-ba13-c0c7d6f4b59c (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:52574779-76ca-42b2-ba13-c0c7d6f4b59c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:21:00,660 [282] [DEBUG] [app] Ending request: urn:request:fb694cbb-e2f1-4915-9680-8394dd0ebf68 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:fb694cbb-e2f1-4915-9680-8394dd0ebf68', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:21:00,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:21:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:21:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:21:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:21:00,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:21:00,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:21:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:21:00,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:21:00,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:21:00,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:21:00,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:21:00,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:21:00,674 [281] [DEBUG] [app] Ending request: urn:request:68a06e0f-2b7d-459f-831b-14fa429b4a3c (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:68a06e0f-2b7d-459f-831b-14fa429b4a3c', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:21:00,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:21:00,674 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:21:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:21:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:21:00,675 [279] [DEBUG] [app] Ending request: urn:request:e79b6535-16b8-4549-9f08-b3646ed176ab (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e79b6535-16b8-4549-9f08-b3646ed176ab', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:21:00,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:21:00,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:21:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:21:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:21:00,830 [279] [DEBUG] [app] Starting request: urn:request:b9187ed1-d529-4e2a-ba77-04ed52a6ec60 (/api/v1/user/notifications/aa0bb5fc-c91d-4e44-a400-df94410d25f5) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:21:00,830 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:21:00,830 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:21:00,831 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:21:00,840 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:21:00,840 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:21:00,840 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:21:00,840 [279] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:21:00,840 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:21:00,840 [279] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:21:00,840 [279] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:21:00,841 [279] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:21:00,842 [279] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."uuid" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."uuid" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', ['aa0bb5fc-c91d-4e44-a400-df94410d25f5', 1, 'aa0bb5fc-c91d-4e44-a400-df94410d25f5', 1, 'admin', 1])
gunicorn-web stdout | 2024-04-22 04:21:00,847 [279] [DEBUG] [peewee] ('UPDATE "notification" SET "uuid" = %s, "kind_id" = %s, "target_id" = %s, "metadata_json" = %s, "created" = %s, "dismissed" = %s, "lookup_path" = %s WHERE ("notification"."id" = %s)', ['aa0bb5fc-c91d-4e44-a400-df94410d25f5', 12, 1, '{"repository": "build_test/pushno", "namespace": "build_test", "name": "pushno", "docker_url": "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno", "homepage": "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno", "vulnerable_index_report_created": "true", "vulnerability": {"id": "64181", "description": "", "link": "https://www.cve.org/CVERecord?id=CVE-2022-30065", "priority": "", "has_fix": true}}', datetime.datetime(2024, 4, 22, 4, 12, 33, 800443), True, None, 6])
gunicorn-web stdout | 2024-04-22 04:21:00,851 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:21:00,853 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:21:00,855 [279] [DEBUG] [app] Ending request: urn:request:b9187ed1-d529-4e2a-ba77-04ed52a6ec60 (/api/v1/user/notifications/aa0bb5fc-c91d-4e44-a400-df94410d25f5) {'endpoint': 'api.usernotification', 'request_id': 'urn:request:b9187ed1-d529-4e2a-ba77-04ed52a6ec60', 'remote_addr': '10.128.2.8', 'http_method': 'PUT', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/notifications/aa0bb5fc-c91d-4e44-a400-df94410d25f5', 'path': '/api/v1/user/notifications/aa0bb5fc-c91d-4e44-a400-df94410d25f5', 'parameters': {}, 'json_body': {'id': 'aa0bb5fc-c91d-4e44-a400-df94410d25f5', 'organization': None, 'kind': 'vulnerability_found', 'created': 'Mon, 22 Apr 2024 04:12:33 -0000', 'metadata': {'repository': 'build_test/pushno', 'namespace': 'build_test', 'name': 'pushno', 'docker_url': 'quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/build_test/pushno', 'homepage': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno', 'vulnerable_index_report_created': 'true', 'vulnerability': {'id': '64181', 'description': '', 'link': 'https://www.cve.org/CVERecord?id=CVE-2022-30065', 'priority': '', 'has_fix': True}}, 'dismissed': True}, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:21:00,856 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:21:00,856 [279] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:21:00 +0000] "PUT /api/v1/user/notifications/aa0bb5fc-c91d-4e44-a400-df94410d25f5 HTTP/1.0" 200 702 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:21:00 +0000] "PUT /api/v1/user/notifications/aa0bb5fc-c91d-4e44-a400-df94410d25f5 HTTP/1.1" 200 702 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.028 2384 0.027)
teamsyncworker stdout | 2024-04-22 04:21:01,005 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
quotatotalworker stdout | 2024-04-22 04:21:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:21:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:21:16.054492+00:00 (in 14.999476 seconds)
quotatotalworker stdout | 2024-04-22 04:21:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:21:16 UTC)" (scheduled at 2024-04-22 04:21:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:21:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:21:01,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:21:01,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:21:16 UTC)" executed successfully
chunkcleanupworker stdout | 2024-04-22 04:21:01,143 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:21:01,180 [281] [DEBUG] [app] Starting request: urn:request:f371687d-b22a-4845-9cb6-edaf93c99d70 (/api/v1/user/notifications) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:21:01,180 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:21:01,180 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:21:01,180 [279] [DEBUG] [app] Starting request: urn:request:aec4f500-f7c3-46b4-be1a-3d61665c1502 (/api/v1/user/apptoken) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:21:01,181 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:21:01,181 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:21:01,181 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:21:01,181 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:21:01,189 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:21:01,190 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:21:01,190 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:21:01,190 [279] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:21:01,190 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:21:01,190 [279] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:21:01,190 [279] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:21:01,190 [279] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:21:01,190 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:21:01,191 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:21:01,191 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."uuid", "t1"."title", "t1"."token_name", "t1"."token_secret", "t1"."created", "t1"."expiration", "t1"."last_accessed" FROM "appspecificauthtoken" AS "t1" WHERE ((("t1"."user_id" = %s) AND ("t1"."expiration" <= %s)) AND ("t1"."expiration" > %s))', [1, datetime.datetime(2024, 4, 24, 23, 33, 1, 190619), datetime.datetime(2024, 4, 22, 4, 21, 1, 190659)])
gunicorn-web stdout | 2024-04-22 04:21:01,191 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:21:01,191 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:21:01,191 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:21:01,191 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:21:01,191 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:21:01,191 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:21:01,192 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."dismissed" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."dismissed" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', [False, 1, False, 1, 'admin', 6])
gunicorn-web stdout | 2024-04-22 04:21:01,193 [279] [DEBUG] [app] Ending request: urn:request:aec4f500-f7c3-46b4-be1a-3d61665c1502 (/api/v1/user/apptoken) {'endpoint': 'api.apptokens', 'request_id': 'urn:request:aec4f500-f7c3-46b4-be1a-3d61665c1502', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/apptoken?expiring=true', 'path': '/api/v1/user/apptoken', 'parameters': {'expiring': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:21:01,193 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:21:01,194 [279] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:21:01 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:21:01 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.1" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.014 1520 0.014)
gunicorn-web stdout | 2024-04-22 04:21:01,198 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:21:01,200 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:21:01,202 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:21:01,204 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:21:01,207 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:21:01,209 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:21:01,211 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:21:01,213 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:21:01,215 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:21:01,217 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [10, 1, 0])
gunicorn-web stdout | 2024-04-22 04:21:01,219 [281] [DEBUG] [app] Ending request: urn:request:f371687d-b22a-4845-9cb6-edaf93c99d70 (/api/v1/user/notifications) {'endpoint': 'api.usernotificationlist', 'request_id': 'urn:request:f371687d-b22a-4845-9cb6-edaf93c99d70', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/notifications', 'path': '/api/v1/user/notifications', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:21:01,220 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:21:01 +0000] "GET /api/v1/user/notifications HTTP/1.1" 200 3386 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.041 1511 0.041)
gunicorn-web stdout | 2024-04-22 04:21:01,220 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:21:01 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 3386 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
quotaregistrysizeworker stdout | 2024-04-22 04:21:01,957 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:21:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:21:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:21:16.552337+00:00 (in 13.995661 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:21:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:22:02 UTC)" (scheduled at 2024-04-22 04:21:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:21:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:21:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:22:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:21:03,614 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:21:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:21:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:21:13.759375+00:00 (in 9.999530 seconds)
notificationworker stdout | 2024-04-22 04:21:03,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:21:13 UTC)" (scheduled at 2024-04-22 04:21:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:21:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:21:03,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 21, 3, 760154), True, datetime.datetime(2024, 4, 22, 4, 21, 3, 760154), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:21:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:21:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:21:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:21:13 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 04:21:04,946 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:21:04,949 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:21:04,952 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
buildlogsarchiver stdout | 2024-04-22 04:21:05,010 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:21:05,064 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:21:05,398 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:21:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:21:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:21:26.873109+00:00 (in 21.000781 seconds)
securityworker stdout | 2024-04-22 04:21:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:21:35 UTC)" (scheduled at 2024-04-22 04:21:05.871852+00:00)
securityworker stdout | 2024-04-22 04:21:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:21:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:21:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:21:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:21:05,885 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:21:05,885 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:21:35 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:21:06,445 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
repositorygcworker stdout | 2024-04-22 04:21:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:21:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:21:13.555667+00:00 (in 7.002699 seconds)
repositorygcworker stdout | 2024-04-22 04:21:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:22:06 UTC)" (scheduled at 2024-04-22 04:21:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:21:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:21:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 21, 6, 553358), True, datetime.datetime(2024, 4, 22, 4, 21, 6, 553358), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:21:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:21:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:21:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:22:06 UTC)" executed successfully
autopruneworker stdout | 2024-04-22 04:21:07,623 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:21:07,697 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:21:07,933 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:21:08,821 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:21:10,125 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
gunicorn-web stdout | 2024-04-22 04:21:10,202 [281] [DEBUG] [app] Starting request: urn:request:e50c6cb4-5622-4401-9b35-a45445528386 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:21:10,203 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:21:10,203 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:21:10,203 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
queuecleanupworker stdout | 2024-04-22 04:21:10,208 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
gunicorn-web stdout | 2024-04-22 04:21:10,212 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:21:10,212 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:21:10,213 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:21:10,213 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:21:10,213 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:21:10,213 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:21:10,213 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:21:10,213 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:21:10,215 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:21:10,222 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:21:10,223 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:21:10,227 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:21:10,231 [281] [DEBUG] [app] Ending request: urn:request:e50c6cb4-5622-4401-9b35-a45445528386 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:e50c6cb4-5622-4401-9b35-a45445528386', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:21:10,232 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:21:10,232 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:21:10 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:21:10 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.031 1536 0.031)
namespacegcworker stdout | 2024-04-22 04:21:10,555 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:21:10,576 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
autopruneworker stdout | 2024-04-22 04:21:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:21:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:21:41.264267+00:00 (in 29.999493 seconds)
autopruneworker stdout | 2024-04-22 04:21:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:21:41 UTC)" (scheduled at 2024-04-22 04:21:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:21:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759611271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:21:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:21:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:21:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:21:41 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:21:11,307 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:21:11,317 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:21:11,324 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:21:11,327 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:21:11,333 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:21:11,340 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:21:11,344 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:21:11,347 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:21:11,350 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
storagereplication stdout | 2024-04-22 04:21:12,010 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:21:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:21:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:21:51.555445+00:00 (in 37.999302 seconds)
repositorygcworker stdout | 2024-04-22 04:21:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:22:13 UTC)" (scheduled at 2024-04-22 04:21:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:21:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:21:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:22:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:21:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:21:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:21:19.762424+00:00 (in 6.002585 seconds)
notificationworker stdout | 2024-04-22 04:21:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:21:23 UTC)" (scheduled at 2024-04-22 04:21:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:21:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:21:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 21, 13, 760233), True, datetime.datetime(2024, 4, 22, 4, 21, 13, 760233), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:21:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:21:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:21:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:21:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:21:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:21:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:21:44.952062+00:00 (in 29.999492 seconds)
gcworker stdout | 2024-04-22 04:21:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:21:44 UTC)" (scheduled at 2024-04-22 04:21:14.952062+00:00)
gcworker stdout | 2024-04-22 04:21:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712550074952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:21:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:21:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:21:14,966 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:21:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:21:15,653 [278] [DEBUG] [app] Starting request: urn:request:b5907ad7-eda7-43ee-a9a1-daa428b7be1d (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:21:15,653 [281] [DEBUG] [app] Starting request: urn:request:f1355b8b-66b9-4574-9b3e-86e8dfd9fb5d (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:21:15,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:21:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:21:15,656 [284] [DEBUG] [app] Starting request: urn:request:057929d9-17da-47f8-9619-91e5a666d4b7 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:21:15,656 [291] [DEBUG] [app] Starting request: urn:request:ed702d0b-5a46-4ee4-8fcd-ea31e7cb5924 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:21:15,656 [284] [DEBUG] [app] Ending request: urn:request:057929d9-17da-47f8-9619-91e5a666d4b7 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:057929d9-17da-47f8-9619-91e5a666d4b7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:21:15,656 [291] [DEBUG] [app] Ending request: urn:request:ed702d0b-5a46-4ee4-8fcd-ea31e7cb5924 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:ed702d0b-5a46-4ee4-8fcd-ea31e7cb5924', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:21:15,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:21:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:21:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:21:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:21:15,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:21:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:21:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:21:15,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:21:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:21:15,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:21:15,660 [281] [DEBUG] [app] Starting request: urn:request:cc192977-8db4-4674-8dee-a1c558253acf (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:21:15,660 [279] [DEBUG] [app] Starting request: urn:request:d63ea487-3a6f-449e-9181-1e4de877e64b (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:21:15,660 [281] [DEBUG] [app] Ending request: urn:request:cc192977-8db4-4674-8dee-a1c558253acf (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:cc192977-8db4-4674-8dee-a1c558253acf', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:21:15,660 [279] [DEBUG] [app] Ending request: urn:request:d63ea487-3a6f-449e-9181-1e4de877e64b (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d63ea487-3a6f-449e-9181-1e4de877e64b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:21:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:21:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:21:15,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:21:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:21:15,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:21:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:21:15,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:21:15,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:21:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:21:15,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:21:15,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:21:15,668 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:21:15,675 [278] [DEBUG] [app] Ending request: urn:request:b5907ad7-eda7-43ee-a9a1-daa428b7be1d (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b5907ad7-eda7-43ee-a9a1-daa428b7be1d', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:21:15,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:21:15,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:21:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:21:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:21:15,675 [281] [DEBUG] [app] Ending request: urn:request:f1355b8b-66b9-4574-9b3e-86e8dfd9fb5d (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f1355b8b-66b9-4574-9b3e-86e8dfd9fb5d', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:21:15,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:21:15,676 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:21:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:21:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
quotatotalworker stdout | 2024-04-22 04:21:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:21:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:21:31.054492+00:00 (in 14.999476 seconds)
quotatotalworker stdout | 2024-04-22 04:21:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:21:31 UTC)" (scheduled at 2024-04-22 04:21:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:21:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:21:16,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:21:16,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:21:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:21:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:21:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:22:02.556208+00:00 (in 46.003327 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:21:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:22:16 UTC)" (scheduled at 2024-04-22 04:21:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:21:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:21:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 21, 16, 553262), True, datetime.datetime(2024, 4, 22, 4, 21, 16, 553262), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:21:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:21:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:21:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:22:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:21:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:21:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:21:47.052354+00:00 (in 29.999487 seconds)
buildlogsarchiver stdout | 2024-04-22 04:21:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:21:47 UTC)" (scheduled at 2024-04-22 04:21:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:21:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 21, 17, 53222), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:21:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:21:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:21:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:21:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:21:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:21:19,763 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:21:23.759375+00:00 (in 3.996387 seconds)
notificationworker stdout | 2024-04-22 04:21:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:22:19 UTC)" (scheduled at 2024-04-22 04:21:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:21:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:21:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:22:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:21:21,076 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
namespacegcworker stdout | 2024-04-22 04:21:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:21:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:21:43.057186+00:00 (in 20.997680 seconds)
namespacegcworker stdout | 2024-04-22 04:21:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:22:22 UTC)" (scheduled at 2024-04-22 04:21:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:21:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:21:22,060 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:22:22 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:21:22,319 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:21:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:21:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:21:33.759375+00:00 (in 9.999450 seconds)
notificationworker stdout | 2024-04-22 04:21:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:21:33 UTC)" (scheduled at 2024-04-22 04:21:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:21:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:21:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 21, 23, 760218), True, datetime.datetime(2024, 4, 22, 4, 21, 23, 760218), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:21:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:21:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:21:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:21:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:21:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:21:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:22:24.361582+00:00 (in 59.999450 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:21:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:22:24 UTC)" (scheduled at 2024-04-22 04:21:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:21:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:21:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:21:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:22:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:21:26,001 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:21:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:21:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:21:35.871852+00:00 (in 8.998248 seconds)
securityworker stdout | 2024-04-22 04:21:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:21:56 UTC)" (scheduled at 2024-04-22 04:21:26.873109+00:00)
securityworker stdout | 2024-04-22 04:21:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:21:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:21:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:21:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:21:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:21:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:21:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:21:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:21:26,882 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:21:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:21:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:21:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:21:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 16, 26, 882044), 1, 2])
securityworker stdout | 2024-04-22 04:21:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:21:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:21:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 16, 26, 882044), 1, 2])
securityworker stdout | 2024-04-22 04:21:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:21:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:21:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:21:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:21:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:21:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:21:26,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:21:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:21:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:21:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:21:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:21:27,773 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:21:29,043 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:21:29,067 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:21:30,375 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:21:30,403 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:21:30,435 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:21:30,470 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:21:30,474 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:21:30,653 [279] [DEBUG] [app] Starting request: urn:request:c7cfe2da-e911-475a-8b52-b4ab6a6e9942 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:21:30,653 [282] [DEBUG] [app] Starting request: urn:request:2d68bff9-6901-4062-aae1-3989a1cbb69a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:21:30,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:21:30,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:21:30,656 [284] [DEBUG] [app] Starting request: urn:request:5abe01a3-30db-402d-8e6f-71efbca86919 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:21:30,656 [292] [DEBUG] [app] Starting request: urn:request:95b91f15-9b0e-4d04-8bbf-761cdc354ed9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:21:30,656 [284] [DEBUG] [app] Ending request: urn:request:5abe01a3-30db-402d-8e6f-71efbca86919 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5abe01a3-30db-402d-8e6f-71efbca86919', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:21:30,656 [292] [DEBUG] [app] Ending request: urn:request:95b91f15-9b0e-4d04-8bbf-761cdc354ed9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:95b91f15-9b0e-4d04-8bbf-761cdc354ed9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:21:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:21:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:21:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:21:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:21:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:21:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:21:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:21:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:21:30,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:21:30,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:21:30,659 [279] [DEBUG] [app] Starting request: urn:request:dbcf167c-7f0d-42d0-8e69-fb4baefcd050 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:21:30,659 [279] [DEBUG] [app] Ending request: urn:request:dbcf167c-7f0d-42d0-8e69-fb4baefcd050 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:dbcf167c-7f0d-42d0-8e69-fb4baefcd050', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:21:30,660 [281] [DEBUG] [app] Starting request: urn:request:86ecefb8-8419-4459-b43f-244fa8c2334e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:21:30,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:21:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:21:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:21:30,660 [281] [DEBUG] [app] Ending request: urn:request:86ecefb8-8419-4459-b43f-244fa8c2334e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:86ecefb8-8419-4459-b43f-244fa8c2334e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:21:30,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:21:30,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:21:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:21:30,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:21:30,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:21:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:21:30,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:21:30,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:21:30,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:21:30,674 [279] [DEBUG] [app] Ending request: urn:request:c7cfe2da-e911-475a-8b52-b4ab6a6e9942 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:c7cfe2da-e911-475a-8b52-b4ab6a6e9942', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:21:30,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:21:30,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:21:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:21:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:21:30,678 [282] [DEBUG] [app] Ending request: urn:request:2d68bff9-6901-4062-aae1-3989a1cbb69a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2d68bff9-6901-4062-aae1-3989a1cbb69a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:21:30,679 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:21:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.027 118 0.027)
gunicorn-web stdout | 2024-04-22 04:21:30,679 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:21:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
teamsyncworker stdout | 2024-04-22 04:21:31,027 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
quotatotalworker stdout | 2024-04-22 04:21:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:21:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:21:46.054492+00:00 (in 14.999432 seconds)
quotatotalworker stdout | 2024-04-22 04:21:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:21:46 UTC)" (scheduled at 2024-04-22 04:21:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:21:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:21:31,067 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:21:31,067 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:21:46 UTC)" executed successfully
chunkcleanupworker stdout | 2024-04-22 04:21:31,169 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotaregistrysizeworker stdout | 2024-04-22 04:21:31,993 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:21:33,651 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:21:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:21:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:21:43.759375+00:00 (in 9.999539 seconds)
notificationworker stdout | 2024-04-22 04:21:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:21:43 UTC)" (scheduled at 2024-04-22 04:21:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:21:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:21:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 21, 33, 760293), True, datetime.datetime(2024, 4, 22, 4, 21, 33, 760293), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:21:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:21:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:21:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:21:43 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 04:21:34,954 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:21:34,958 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:21:34,960 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
buildlogsarchiver stdout | 2024-04-22 04:21:35,023 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:21:35,089 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:21:35,435 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:21:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:21:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:21:56.873109+00:00 (in 21.000743 seconds)
securityworker stdout | 2024-04-22 04:21:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:22:05 UTC)" (scheduled at 2024-04-22 04:21:35.871852+00:00)
securityworker stdout | 2024-04-22 04:21:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:21:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:21:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:21:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:21:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:21:35,888 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:21:35,890 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:21:35,890 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:21:35,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 16, 35, 876451), 1, 2])
securityworker stdout | 2024-04-22 04:21:35,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:21:35,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:21:35,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 16, 35, 876451), 1, 2])
securityworker stdout | 2024-04-22 04:21:35,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:21:35,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:21:35,896 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:21:35,897 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:22:05 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:21:36,481 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:21:37,660 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:21:37,733 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:21:37,969 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:21:38,858 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
exportactionlogsworker stdout | 2024-04-22 04:21:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:21:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:21:41.564959+00:00 (in 1.997495 seconds)
exportactionlogsworker stdout | 2024-04-22 04:21:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:22:39 UTC)" (scheduled at 2024-04-22 04:21:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:21:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:21:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:22:39 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:21:40,137 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:21:40,245 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:21:40,591 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:21:40,598 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
autopruneworker stdout | 2024-04-22 04:21:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:21:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:22:11.264267+00:00 (in 29.999497 seconds)
autopruneworker stdout | 2024-04-22 04:21:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:22:11 UTC)" (scheduled at 2024-04-22 04:21:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:21:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759641271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:21:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:21:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:21:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:22:11 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:21:41,317 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:21:41,326 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:21:41,334 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:21:41,337 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:21:41,340 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:21:41,348 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:21:41,352 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:21:41,355 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:21:41,359 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
exportactionlogsworker stdout | 2024-04-22 04:21:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:21:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:21:53.566665+00:00 (in 12.001127 seconds)
exportactionlogsworker stdout | 2024-04-22 04:21:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:22:41 UTC)" (scheduled at 2024-04-22 04:21:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:21:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:21:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 21, 41, 565897), True, datetime.datetime(2024, 4, 22, 4, 21, 41, 565897), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:21:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:21:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:21:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:22:41 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:21:42,021 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
namespacegcworker stdout | 2024-04-22 04:21:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:21:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:22:22.058978+00:00 (in 39.001280 seconds)
namespacegcworker stdout | 2024-04-22 04:21:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:22:43 UTC)" (scheduled at 2024-04-22 04:21:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:21:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:21:43,059 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 21, 43, 58139), True, datetime.datetime(2024, 4, 22, 4, 21, 43, 58139), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:21:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:21:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:21:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:22:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:21:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:21:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:21:53.759375+00:00 (in 9.999536 seconds)
notificationworker stdout | 2024-04-22 04:21:43,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:21:53 UTC)" (scheduled at 2024-04-22 04:21:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:21:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:21:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 21, 43, 760094), True, datetime.datetime(2024, 4, 22, 4, 21, 43, 760094), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:21:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:21:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:21:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:21:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:21:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:21:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:22:14.952062+00:00 (in 29.999498 seconds)
gcworker stdout | 2024-04-22 04:21:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:22:14 UTC)" (scheduled at 2024-04-22 04:21:44.952062+00:00)
gcworker stdout | 2024-04-22 04:21:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712550104952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:21:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:21:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:21:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:22:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:21:45,653 [279] [DEBUG] [app] Starting request: urn:request:57adf09d-2b56-426d-802c-e32f1f5be2c4 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:21:45,653 [278] [DEBUG] [app] Starting request: urn:request:1fb23dd4-4a28-4031-9edb-226e65aff368 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:21:45,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:21:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:21:45,656 [291] [DEBUG] [app] Starting request: urn:request:49db5eaa-6d61-471f-865d-ccdc7a583b00 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:21:45,656 [284] [DEBUG] [app] Starting request: urn:request:5016e078-39f2-4723-9c55-77b9a08daf27 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:21:45,657 [291] [DEBUG] [app] Ending request: urn:request:49db5eaa-6d61-471f-865d-ccdc7a583b00 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:49db5eaa-6d61-471f-865d-ccdc7a583b00', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:21:45,657 [284] [DEBUG] [app] Ending request: urn:request:5016e078-39f2-4723-9c55-77b9a08daf27 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5016e078-39f2-4723-9c55-77b9a08daf27', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:21:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:21:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:21:45,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:21:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:21:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:21:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:21:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:21:45,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:21:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:21:45,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:21:45,659 [278] [DEBUG] [app] Starting request: urn:request:2d0b4b21-4af6-4b7f-ad07-e66863aa9f34 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:21:45,660 [278] [DEBUG] [app] Ending request: urn:request:2d0b4b21-4af6-4b7f-ad07-e66863aa9f34 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:2d0b4b21-4af6-4b7f-ad07-e66863aa9f34', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:21:45,660 [282] [DEBUG] [app] Starting request: urn:request:1b59c0f5-71d8-44d6-ab11-f162ee9057a3 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:21:45,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:21:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:21:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:21:45,660 [282] [DEBUG] [app] Ending request: urn:request:1b59c0f5-71d8-44d6-ab11-f162ee9057a3 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1b59c0f5-71d8-44d6-ab11-f162ee9057a3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:21:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:21:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:21:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:21:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:21:45,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:21:45,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:21:45,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:21:45,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:21:45,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:21:45,675 [279] [DEBUG] [app] Ending request: urn:request:57adf09d-2b56-426d-802c-e32f1f5be2c4 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:57adf09d-2b56-426d-802c-e32f1f5be2c4', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:21:45,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:21:45,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:21:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:21:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:21:45,677 [278] [DEBUG] [app] Ending request: urn:request:1fb23dd4-4a28-4031-9edb-226e65aff368 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:1fb23dd4-4a28-4031-9edb-226e65aff368', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:21:45,677 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:21:45,677 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:21:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:21:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
quotatotalworker stdout | 2024-04-22 04:21:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:21:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:22:01.054492+00:00 (in 14.999503 seconds)
quotatotalworker stdout | 2024-04-22 04:21:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:22:01 UTC)" (scheduled at 2024-04-22 04:21:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:21:46,055 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:21:46,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:21:46,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:22:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:21:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:21:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:22:17.052354+00:00 (in 29.999457 seconds)
buildlogsarchiver stdout | 2024-04-22 04:21:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:22:17 UTC)" (scheduled at 2024-04-22 04:21:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:21:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 21, 47, 53236), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:21:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:21:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:21:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:22:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:21:51,113 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
repositorygcworker stdout | 2024-04-22 04:21:51,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:21:51,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:22:06.552482+00:00 (in 14.996485 seconds)
repositorygcworker stdout | 2024-04-22 04:21:51,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:26:51 UTC)" (scheduled at 2024-04-22 04:21:51.555445+00:00)
repositorygcworker stdout | 2024-04-22 04:21:51,556 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 21, 51, 556382), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 04:21:51,567 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 21, 51, 556382), True, datetime.datetime(2024, 4, 22, 4, 21, 51, 556382), 0, 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 04:21:51,569 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 21, 51, 556382), True, datetime.datetime(2024, 4, 22, 4, 21, 51, 556382), 0, 'repositorygc/%', False, datetime.datetime(2024, 4, 22, 4, 21, 51, 556382), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 04:21:51,572 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:21:51,572 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:26:51 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:21:52,328 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
exportactionlogsworker stdout | 2024-04-22 04:21:53,566 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:21:53,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:22:39.566970+00:00 (in 45.999725 seconds)
exportactionlogsworker stdout | 2024-04-22 04:21:53,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:26:53 UTC)" (scheduled at 2024-04-22 04:21:53.566665+00:00)
exportactionlogsworker stdout | 2024-04-22 04:21:53,568 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 21, 53, 567511), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 04:21:53,578 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 21, 53, 567511), True, datetime.datetime(2024, 4, 22, 4, 21, 53, 567511), 0, 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 04:21:53,580 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 21, 53, 567511), True, datetime.datetime(2024, 4, 22, 4, 21, 53, 567511), 0, 'exportactionlogs/%', False, datetime.datetime(2024, 4, 22, 4, 21, 53, 567511), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 04:21:53,583 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:21:53,583 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:26:53 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:21:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:21:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:22:03.759375+00:00 (in 9.999502 seconds)
notificationworker stdout | 2024-04-22 04:21:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:22:03 UTC)" (scheduled at 2024-04-22 04:21:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:21:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:21:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 21, 53, 760351), True, datetime.datetime(2024, 4, 22, 4, 21, 53, 760351), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:21:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:21:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:21:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:22:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:21:56,027 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:21:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:21:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:22:05.871852+00:00 (in 8.998216 seconds)
securityworker stdout | 2024-04-22 04:21:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:22:26 UTC)" (scheduled at 2024-04-22 04:21:56.873109+00:00)
securityworker stdout | 2024-04-22 04:21:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:21:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:21:56,875 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:21:56,875 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:21:56,875 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:21:56,876 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:21:56,876 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:21:56,878 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:21:56,879 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:21:56,889 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:21:56,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:21:56,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:21:56,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 16, 56, 879631), 1, 2])
securityworker stdout | 2024-04-22 04:21:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:21:56,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:21:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 16, 56, 879631), 1, 2])
securityworker stdout | 2024-04-22 04:21:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:21:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:21:56,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:21:56,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:21:56,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:21:56,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:21:56,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:21:56,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:21:56,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:21:56,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:22:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:21:57,809 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:21:59,080 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:21:59,082 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:22:00,383 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:22:00,413 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:22:00,446 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:22:00,482 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:22:00,484 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:22:00,653 [279] [DEBUG] [app] Starting request: urn:request:f078e62e-5999-4459-b9e1-dedf6204622b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:22:00,653 [282] [DEBUG] [app] Starting request: urn:request:9bb089f7-46bb-4d86-a373-fa4fe40b22c9 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:22:00,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:22:00,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:22:00,656 [284] [DEBUG] [app] Starting request: urn:request:c85bc3fb-4570-41aa-9696-d241de02e648 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:22:00,656 [292] [DEBUG] [app] Starting request: urn:request:68ffeaed-0e48-47b0-9578-e485aa7ae868 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:22:00,656 [284] [DEBUG] [app] Ending request: urn:request:c85bc3fb-4570-41aa-9696-d241de02e648 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:c85bc3fb-4570-41aa-9696-d241de02e648', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:22:00,657 [292] [DEBUG] [app] Ending request: urn:request:68ffeaed-0e48-47b0-9578-e485aa7ae868 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:68ffeaed-0e48-47b0-9578-e485aa7ae868', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:22:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:22:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:22:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:22:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:22:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:22:00,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:22:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
gunicorn-web stdout | 2024-04-22 04:22:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:22:00,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:22:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:22:00,659 [279] [DEBUG] [app] Starting request: urn:request:2d2b284c-6398-4cf5-800a-cb376a8645cf (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:22:00,659 [279] [DEBUG] [app] Ending request: urn:request:2d2b284c-6398-4cf5-800a-cb376a8645cf (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:2d2b284c-6398-4cf5-800a-cb376a8645cf', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:22:00,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:22:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:22:00,660 [278] [DEBUG] [app] Starting request: urn:request:3567da55-7be7-4ab8-b3db-69a2b01cd101 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:22:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:22:00,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:22:00,660 [278] [DEBUG] [app] Ending request: urn:request:3567da55-7be7-4ab8-b3db-69a2b01cd101 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3567da55-7be7-4ab8-b3db-69a2b01cd101', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:22:00,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:22:00,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:22:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:22:00,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:22:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 04:22:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:22:00,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:22:00,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:22:00,674 [279] [DEBUG] [app] Ending request: urn:request:f078e62e-5999-4459-b9e1-dedf6204622b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f078e62e-5999-4459-b9e1-dedf6204622b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:22:00,674 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:22:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:22:00,674 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:22:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:22:00,675 [282] [DEBUG] [app] Ending request: urn:request:9bb089f7-46bb-4d86-a373-fa4fe40b22c9 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:9bb089f7-46bb-4d86-a373-fa4fe40b22c9', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:22:00,675 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:22:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:22:00,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:22:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:22:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:22:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:22:16.054492+00:00 (in 14.999498 seconds)
quotatotalworker stdout | 2024-04-22 04:22:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:22:16 UTC)" (scheduled at 2024-04-22 04:22:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:22:01,055 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
teamsyncworker stdout | 2024-04-22 04:22:01,064 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
quotatotalworker stdout | 2024-04-22 04:22:01,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:22:01,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:22:16 UTC)" executed successfully
chunkcleanupworker stdout | 2024-04-22 04:22:01,200 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotaregistrysizeworker stdout | 2024-04-22 04:22:02,008 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:22:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:22:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:22:16.552337+00:00 (in 13.995638 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:22:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:23:02 UTC)" (scheduled at 2024-04-22 04:22:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:22:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:22:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:23:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:22:03,688 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:22:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:22:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:22:13.759375+00:00 (in 9.999577 seconds)
notificationworker stdout | 2024-04-22 04:22:03,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:22:13 UTC)" (scheduled at 2024-04-22 04:22:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:22:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:22:03,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 22, 3, 760079), True, datetime.datetime(2024, 4, 22, 4, 22, 3, 760079), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:22:03,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:22:03,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:22:03,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:22:13 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:22:04,267 [282] [DEBUG] [app] Starting request: urn:request:2ee61e37-a9e9-4434-aa7c-202245157b08 (/api/v1/user/notifications) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:22:04,267 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:22:04,267 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:22:04,268 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:22:04,278 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:22:04,278 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:22:04,278 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:22:04,278 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:22:04,278 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:22:04,278 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:22:04,278 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:22:04,278 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:22:04,280 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."dismissed" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."dismissed" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', [False, 1, False, 1, 'admin', 6])
gunicorn-web stdout | 2024-04-22 04:22:04,281 [278] [DEBUG] [app] Starting request: urn:request:0a9e02d7-3494-4fdd-a630-4ab9b4290159 (/api/v1/user/apptoken) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:22:04,282 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:22:04,282 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:22:04,282 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:22:04,285 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:22:04,287 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:22:04,289 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:22:04,291 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:22:04,291 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:22:04,291 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:22:04,291 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:22:04,291 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:22:04,291 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:22:04,292 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:22:04,292 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:22:04,292 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:22:04,292 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."uuid", "t1"."title", "t1"."token_name", "t1"."token_secret", "t1"."created", "t1"."expiration", "t1"."last_accessed" FROM "appspecificauthtoken" AS "t1" WHERE ((("t1"."user_id" = %s) AND ("t1"."expiration" <= %s)) AND ("t1"."expiration" > %s))', [1, datetime.datetime(2024, 4, 24, 23, 34, 4, 292353), datetime.datetime(2024, 4, 22, 4, 22, 4, 292402)])
gunicorn-web stdout | 2024-04-22 04:22:04,293 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:22:04,295 [278] [DEBUG] [app] Ending request: urn:request:0a9e02d7-3494-4fdd-a630-4ab9b4290159 (/api/v1/user/apptoken) {'endpoint': 'api.apptokens', 'request_id': 'urn:request:0a9e02d7-3494-4fdd-a630-4ab9b4290159', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/apptoken?expiring=true', 'path': '/api/v1/user/apptoken', 'parameters': {'expiring': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:22:04,295 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:22:04,295 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:22:04 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.1" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.016 1520 0.015)
gunicorn-web stdout | 2024-04-22 04:22:04,296 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:22:04 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:22:04,298 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:22:04,300 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:22:04,302 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:22:04,304 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [10, 1, 0])
gunicorn-web stdout | 2024-04-22 04:22:04,306 [282] [DEBUG] [app] Ending request: urn:request:2ee61e37-a9e9-4434-aa7c-202245157b08 (/api/v1/user/notifications) {'endpoint': 'api.usernotificationlist', 'request_id': 'urn:request:2ee61e37-a9e9-4434-aa7c-202245157b08', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/notifications', 'path': '/api/v1/user/notifications', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:22:04,306 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:22:04,307 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:22:04 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 3386 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:22:04 +0000] "GET /api/v1/user/notifications HTTP/1.1" 200 3386 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.041 1511 0.041)
gunicorn-secscan stdout | 2024-04-22 04:22:04,962 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:22:04,965 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:22:04,968 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
buildlogsarchiver stdout | 2024-04-22 04:22:05,057 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:22:05,105 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:22:05,472 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:22:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:22:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:22:26.873109+00:00 (in 21.000728 seconds)
securityworker stdout | 2024-04-22 04:22:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:22:35 UTC)" (scheduled at 2024-04-22 04:22:05.871852+00:00)
securityworker stdout | 2024-04-22 04:22:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:22:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:22:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:22:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:22:05,885 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:22:05,885 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:22:35 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:22:06,517 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
repositorygcworker stdout | 2024-04-22 04:22:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:22:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:22:13.555667+00:00 (in 7.002676 seconds)
repositorygcworker stdout | 2024-04-22 04:22:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:23:06 UTC)" (scheduled at 2024-04-22 04:22:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:22:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:22:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 22, 6, 553400), True, datetime.datetime(2024, 4, 22, 4, 22, 6, 553400), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:22:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:22:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:22:06,565 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:23:06 UTC)" executed successfully
autopruneworker stdout | 2024-04-22 04:22:07,696 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:22:07,770 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:22:08,005 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:22:08,895 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:22:10,174 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:22:10,251 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:22:10,614 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:22:10,634 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
autopruneworker stdout | 2024-04-22 04:22:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:22:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:22:41.264267+00:00 (in 29.999430 seconds)
autopruneworker stdout | 2024-04-22 04:22:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:22:41 UTC)" (scheduled at 2024-04-22 04:22:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:22:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759671272, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:22:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:22:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:22:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:22:41 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:22:11,326 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:22:11,336 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:22:11,345 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:22:11,347 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:22:11,350 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:22:11,355 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:22:11,360 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:22:11,363 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:22:11,368 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
storagereplication stdout | 2024-04-22 04:22:12,058 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:22:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:22:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:23:06.552482+00:00 (in 52.996332 seconds)
repositorygcworker stdout | 2024-04-22 04:22:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:23:13 UTC)" (scheduled at 2024-04-22 04:22:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:22:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:22:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:23:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:22:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:22:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:22:19.762424+00:00 (in 6.002464 seconds)
notificationworker stdout | 2024-04-22 04:22:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:22:23 UTC)" (scheduled at 2024-04-22 04:22:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:22:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:22:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 22, 13, 760239), True, datetime.datetime(2024, 4, 22, 4, 22, 13, 760239), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:22:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:22:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:22:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:22:23 UTC)" executed successfully
nginx stdout | 2024/04/22 04:22:14 [error] 112#0: *2733 open() "/quay-registry/static/img/icons/tags.png" failed (2: No such file or directory), client: 10.131.0.9, server: , request: "GET /static/img/icons/tags.png HTTP/1.1", host: "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com", referrer: "https://hw.mail.163.com/"
gunicorn-web stdout | 2024-04-22 04:22:14,865 [281] [DEBUG] [app] Starting request: urn:request:c2257da4-e707-4a2a-828a-c9df40a78957 (/404) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:22:14,873 [281] [DEBUG] [endpoints.api.discovery] Unable to find method for POST in class <class 'endpoints.api.repository.RepositoryTrust'>
gunicorn-web stdout | 2024-04-22 04:22:14,895 [281] [DEBUG] [app] Ending request: urn:request:c2257da4-e707-4a2a-828a-c9df40a78957 (/404) {'endpoint': 'web.not_found_error_display', 'request_id': 'urn:request:c2257da4-e707-4a2a-828a-c9df40a78957', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/404', 'path': '/404', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:22:14,896 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:22:14 +0000] "GET /404 HTTP/1.0" 404 93294 "https://hw.mail.163.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:22:14 +0000] "GET /static/img/icons/tags.png HTTP/1.1" 404 14283 "https://hw.mail.163.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.032 764 0.032)
gcworker stdout | 2024-04-22 04:22:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:22:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:22:44.952062+00:00 (in 29.999494 seconds)
gcworker stdout | 2024-04-22 04:22:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:22:44 UTC)" (scheduled at 2024-04-22 04:22:14.952062+00:00)
gcworker stdout | 2024-04-22 04:22:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712550134952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:22:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:22:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:22:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:22:44 UTC)" executed successfully
nginx stdout | 2024/04/22 04:22:15 [error] 112#0: *2735 open() "/quay-registry/static/img/icons/tags.png" failed (2: No such file or directory), client: 10.128.2.8, server: , request: "GET /static/img/icons/tags.png HTTP/1.1", host: "quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com", referrer: "https://hw.mail.163.com/"
gunicorn-web stdout | 2024-04-22 04:22:15,223 [279] [DEBUG] [app] Starting request: urn:request:6d28fd77-ea74-469d-8c5b-3ee017327757 (/404) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:22:15,226 [279] [DEBUG] [app] Ending request: urn:request:6d28fd77-ea74-469d-8c5b-3ee017327757 (/404) {'endpoint': 'web.not_found_error_display', 'request_id': 'urn:request:6d28fd77-ea74-469d-8c5b-3ee017327757', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/404', 'path': '/404', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:22:15,227 [279] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:22:15 +0000] "GET /404 HTTP/1.0" 404 93294 "https://hw.mail.163.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:22:15 +0000] "GET /static/img/icons/tags.png HTTP/1.1" 404 14284 "https://hw.mail.163.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.005 764 0.005)
gunicorn-web stdout | 2024-04-22 04:22:15,653 [281] [DEBUG] [app] Starting request: urn:request:6cfbd1a9-b165-4ead-abf4-12649e2532ed (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:22:15,653 [278] [DEBUG] [app] Starting request: urn:request:dc0ed2fe-dfd6-46f1-a214-614b8c3248b0 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:22:15,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:22:15,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:22:15,656 [284] [DEBUG] [app] Starting request: urn:request:105719b4-2945-4377-8d73-2ca376f9e6b4 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:22:15,656 [285] [DEBUG] [app] Starting request: urn:request:3b741d2f-dcd4-4f71-8daf-a8e8107a213f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:22:15,657 [284] [DEBUG] [app] Ending request: urn:request:105719b4-2945-4377-8d73-2ca376f9e6b4 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:105719b4-2945-4377-8d73-2ca376f9e6b4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:22:15,657 [285] [DEBUG] [app] Ending request: urn:request:3b741d2f-dcd4-4f71-8daf-a8e8107a213f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:3b741d2f-dcd4-4f71-8daf-a8e8107a213f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:22:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:22:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:22:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:22:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:22:15,657 [285] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:22:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:22:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:22:15,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:22:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:22:15,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:22:15,660 [278] [DEBUG] [app] Starting request: urn:request:64096f9c-6352-4cf6-8165-2117d224dcbc (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:22:15,660 [281] [DEBUG] [app] Starting request: urn:request:0e97b8b2-184c-421d-a78b-6e5bef00ac5e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:22:15,660 [278] [DEBUG] [app] Ending request: urn:request:64096f9c-6352-4cf6-8165-2117d224dcbc (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:64096f9c-6352-4cf6-8165-2117d224dcbc', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:22:15,660 [281] [DEBUG] [app] Ending request: urn:request:0e97b8b2-184c-421d-a78b-6e5bef00ac5e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:0e97b8b2-184c-421d-a78b-6e5bef00ac5e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:22:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:22:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:22:15,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:22:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:22:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:22:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:22:15,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:22:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:22:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:22:15,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:22:15,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:22:15,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:22:15,674 [278] [DEBUG] [app] Ending request: urn:request:dc0ed2fe-dfd6-46f1-a214-614b8c3248b0 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:dc0ed2fe-dfd6-46f1-a214-614b8c3248b0', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:22:15,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:22:15,674 [281] [DEBUG] [app] Ending request: urn:request:6cfbd1a9-b165-4ead-abf4-12649e2532ed (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:6cfbd1a9-b165-4ead-abf4-12649e2532ed', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:22:15,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:22:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:22:15,674 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:22:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.021)
gunicorn-web stdout | 2024-04-22 04:22:15,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:22:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:22:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.023)
quotatotalworker stdout | 2024-04-22 04:22:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:22:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:22:31.054492+00:00 (in 14.999469 seconds)
quotatotalworker stdout | 2024-04-22 04:22:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:22:31 UTC)" (scheduled at 2024-04-22 04:22:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:22:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:22:16,071 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:22:16,071 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:22:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:22:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:22:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:22:21.555879+00:00 (in 5.002951 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:22:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:23:16 UTC)" (scheduled at 2024-04-22 04:22:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:22:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:22:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 22, 16, 553311), True, datetime.datetime(2024, 4, 22, 4, 22, 16, 553311), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:22:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:22:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:22:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:23:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:22:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:22:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:22:47.052354+00:00 (in 29.999447 seconds)
buildlogsarchiver stdout | 2024-04-22 04:22:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:22:47 UTC)" (scheduled at 2024-04-22 04:22:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:22:17,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 22, 17, 53307), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:22:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:22:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:22:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:22:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:22:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:22:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:22:23.759375+00:00 (in 3.996401 seconds)
notificationworker stdout | 2024-04-22 04:22:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:23:19 UTC)" (scheduled at 2024-04-22 04:22:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:22:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:22:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:23:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:22:21,150 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:22:21,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:22:21,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:23:02.556208+00:00 (in 40.999829 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:22:21,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:27:21 UTC)" (scheduled at 2024-04-22 04:22:21.555879+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:22:21,557 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 22, 21, 556767), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 04:22:21,570 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 22, 21, 556767), True, datetime.datetime(2024, 4, 22, 4, 22, 21, 556767), 0, 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 04:22:21,572 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 22, 21, 556767), True, datetime.datetime(2024, 4, 22, 4, 22, 21, 556767), 0, 'secscanv4/%', False, datetime.datetime(2024, 4, 22, 4, 22, 21, 556767), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 04:22:21,574 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:22:21,574 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:27:21 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:22:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:22:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:22:38.058708+00:00 (in 15.999141 seconds)
namespacegcworker stdout | 2024-04-22 04:22:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:23:22 UTC)" (scheduled at 2024-04-22 04:22:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:22:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:22:22,060 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:23:22 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:22:22,364 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:22:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:22:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:22:33.759375+00:00 (in 9.999474 seconds)
notificationworker stdout | 2024-04-22 04:22:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:22:33 UTC)" (scheduled at 2024-04-22 04:22:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:22:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:22:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 22, 23, 760382), True, datetime.datetime(2024, 4, 22, 4, 22, 23, 760382), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:22:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:22:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:22:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:22:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:22:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:22:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:23:24.361582+00:00 (in 59.999436 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:22:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:23:24 UTC)" (scheduled at 2024-04-22 04:22:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:22:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:22:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:22:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:23:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:22:26,038 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:22:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:22:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:22:35.871852+00:00 (in 8.998228 seconds)
securityworker stdout | 2024-04-22 04:22:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:22:56 UTC)" (scheduled at 2024-04-22 04:22:26.873109+00:00)
securityworker stdout | 2024-04-22 04:22:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:22:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:22:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:22:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:22:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:22:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:22:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:22:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:22:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:22:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:22:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:22:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:22:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 17, 26, 881364), 1, 2])
securityworker stdout | 2024-04-22 04:22:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:22:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:22:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 17, 26, 881364), 1, 2])
securityworker stdout | 2024-04-22 04:22:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:22:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:22:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:22:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:22:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:22:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:22:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:22:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:22:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:22:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:22:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:22:27,817 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:22:29,115 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:22:29,117 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:22:30,391 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:22:30,426 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:22:30,458 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:22:30,496 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:22:30,499 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:22:30,653 [279] [DEBUG] [app] Starting request: urn:request:8143fa97-0c83-4bf9-a613-a6aba08d059b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:22:30,653 [278] [DEBUG] [app] Starting request: urn:request:60c714bb-82f5-4057-8009-b59104320e10 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:22:30,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:22:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:22:30,656 [292] [DEBUG] [app] Starting request: urn:request:e08b0631-e516-431d-8a97-ac8675d5d3c9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:22:30,656 [284] [DEBUG] [app] Starting request: urn:request:52fb8733-9fe4-4a67-81a5-0a5b13dc4a21 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:22:30,656 [292] [DEBUG] [app] Ending request: urn:request:e08b0631-e516-431d-8a97-ac8675d5d3c9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:e08b0631-e516-431d-8a97-ac8675d5d3c9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:22:30,657 [284] [DEBUG] [app] Ending request: urn:request:52fb8733-9fe4-4a67-81a5-0a5b13dc4a21 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:52fb8733-9fe4-4a67-81a5-0a5b13dc4a21', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:22:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:22:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:22:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:22:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:22:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:22:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:22:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:22:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:22:30,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:22:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:22:30,659 [279] [DEBUG] [app] Starting request: urn:request:d2237e0c-e599-49d6-96ca-f505185ff0e6 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:22:30,659 [278] [DEBUG] [app] Starting request: urn:request:3c2caa02-e0d8-47a2-842d-7e4683568d25 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:22:30,659 [279] [DEBUG] [app] Ending request: urn:request:d2237e0c-e599-49d6-96ca-f505185ff0e6 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d2237e0c-e599-49d6-96ca-f505185ff0e6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:22:30,660 [278] [DEBUG] [app] Ending request: urn:request:3c2caa02-e0d8-47a2-842d-7e4683568d25 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3c2caa02-e0d8-47a2-842d-7e4683568d25', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:22:30,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:22:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:22:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:22:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:22:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:22:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:22:30,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:22:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:22:30,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:22:30,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:22:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:22:30,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:22:30,674 [279] [DEBUG] [app] Ending request: urn:request:8143fa97-0c83-4bf9-a613-a6aba08d059b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:8143fa97-0c83-4bf9-a613-a6aba08d059b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:22:30,675 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:22:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:22:30,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:22:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:22:30,675 [278] [DEBUG] [app] Ending request: urn:request:60c714bb-82f5-4057-8009-b59104320e10 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:60c714bb-82f5-4057-8009-b59104320e10', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:22:30,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:22:30,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:22:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:22:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotatotalworker stdout | 2024-04-22 04:22:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:22:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:22:46.054492+00:00 (in 14.999439 seconds)
quotatotalworker stdout | 2024-04-22 04:22:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:22:46 UTC)" (scheduled at 2024-04-22 04:22:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:22:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:22:31,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:22:31,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:22:46 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:22:31,089 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:22:31,217 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotaregistrysizeworker stdout | 2024-04-22 04:22:32,025 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:22:33,726 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:22:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:22:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:22:43.759375+00:00 (in 9.999558 seconds)
notificationworker stdout | 2024-04-22 04:22:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:22:43 UTC)" (scheduled at 2024-04-22 04:22:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:22:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:22:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 22, 33, 760264), True, datetime.datetime(2024, 4, 22, 4, 22, 33, 760264), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:22:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:22:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:22:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:22:43 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 04:22:34,971 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:22:34,973 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:22:34,976 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
buildlogsarchiver stdout | 2024-04-22 04:22:35,094 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:22:35,130 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:22:35,509 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:22:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:22:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:22:56.873109+00:00 (in 21.000731 seconds)
securityworker stdout | 2024-04-22 04:22:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:23:05 UTC)" (scheduled at 2024-04-22 04:22:35.871852+00:00)
securityworker stdout | 2024-04-22 04:22:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:22:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:22:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:22:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:22:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:22:35,888 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:22:35,891 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:22:35,891 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:22:35,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 17, 35, 876351), 1, 2])
securityworker stdout | 2024-04-22 04:22:35,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:22:35,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:22:35,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 17, 35, 876351), 1, 2])
securityworker stdout | 2024-04-22 04:22:35,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:22:35,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:22:35,896 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:22:35,897 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:23:05 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:22:36,540 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:22:37,724 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:22:37,794 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:22:38,028 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
namespacegcworker stdout | 2024-04-22 04:22:38,058 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:22:38,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:22:43.057186+00:00 (in 4.998045 seconds)
namespacegcworker stdout | 2024-04-22 04:22:38,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:27:38 UTC)" (scheduled at 2024-04-22 04:22:38.058708+00:00)
namespacegcworker stdout | 2024-04-22 04:22:38,060 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 22, 38, 59523), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 04:22:38,070 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 22, 38, 59523), True, datetime.datetime(2024, 4, 22, 4, 22, 38, 59523), 0, 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 04:22:38,073 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 22, 38, 59523), True, datetime.datetime(2024, 4, 22, 4, 22, 38, 59523), 0, 'namespacegc/%', False, datetime.datetime(2024, 4, 22, 4, 22, 38, 59523), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 04:22:38,075 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:22:38,075 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:27:38 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 04:22:38,932 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
exportactionlogsworker stdout | 2024-04-22 04:22:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:22:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:22:41.564959+00:00 (in 1.997426 seconds)
exportactionlogsworker stdout | 2024-04-22 04:22:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:23:39 UTC)" (scheduled at 2024-04-22 04:22:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:22:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:22:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:23:39 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:22:40,211 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:22:40,269 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:22:40,652 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:22:40,669 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
autopruneworker stdout | 2024-04-22 04:22:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:22:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:23:11.264267+00:00 (in 29.999530 seconds)
autopruneworker stdout | 2024-04-22 04:22:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:23:11 UTC)" (scheduled at 2024-04-22 04:22:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:22:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759701271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:22:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:22:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:22:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:23:11 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:22:41,334 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:22:41,343 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:22:41,356 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:22:41,358 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:22:41,361 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:22:41,365 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:22:41,372 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:22:41,375 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:22:41,377 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
exportactionlogsworker stdout | 2024-04-22 04:22:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:22:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:23:39.566970+00:00 (in 58.001473 seconds)
exportactionlogsworker stdout | 2024-04-22 04:22:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:23:41 UTC)" (scheduled at 2024-04-22 04:22:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:22:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:22:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 22, 41, 565815), True, datetime.datetime(2024, 4, 22, 4, 22, 41, 565815), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:22:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:22:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:22:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:23:41 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:22:42,095 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
namespacegcworker stdout | 2024-04-22 04:22:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:22:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:23:22.058978+00:00 (in 39.001332 seconds)
namespacegcworker stdout | 2024-04-22 04:22:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:23:43 UTC)" (scheduled at 2024-04-22 04:22:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:22:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:22:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 22, 43, 58017), True, datetime.datetime(2024, 4, 22, 4, 22, 43, 58017), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:22:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:22:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:22:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:23:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:22:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:22:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:22:53.759375+00:00 (in 9.999460 seconds)
notificationworker stdout | 2024-04-22 04:22:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:22:53 UTC)" (scheduled at 2024-04-22 04:22:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:22:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:22:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 22, 43, 760313), True, datetime.datetime(2024, 4, 22, 4, 22, 43, 760313), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:22:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:22:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:22:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:22:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:22:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:22:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:23:14.952062+00:00 (in 29.999469 seconds)
gcworker stdout | 2024-04-22 04:22:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:23:14 UTC)" (scheduled at 2024-04-22 04:22:44.952062+00:00)
gcworker stdout | 2024-04-22 04:22:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712550164953, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:22:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:22:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:22:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:23:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:22:45,653 [279] [DEBUG] [app] Starting request: urn:request:4820ca6e-5447-4a82-b96e-822cca897ff2 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:22:45,653 [281] [DEBUG] [app] Starting request: urn:request:f1f8fb33-7055-412c-bc62-495f5b94202d (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:22:45,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:22:45,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:22:45,656 [292] [DEBUG] [app] Starting request: urn:request:829eca7a-1b24-4969-8b19-99aed9fb10d0 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:22:45,656 [291] [DEBUG] [app] Starting request: urn:request:02b4512e-9afa-4915-82d4-a9176d23a62e (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:22:45,657 [291] [DEBUG] [app] Ending request: urn:request:02b4512e-9afa-4915-82d4-a9176d23a62e (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:02b4512e-9afa-4915-82d4-a9176d23a62e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:22:45,657 [292] [DEBUG] [app] Ending request: urn:request:829eca7a-1b24-4969-8b19-99aed9fb10d0 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:829eca7a-1b24-4969-8b19-99aed9fb10d0', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:22:45,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:22:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:22:45,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:22:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:22:45,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:22:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:22:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:22:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:22:45,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:22:45,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:22:45,660 [278] [DEBUG] [app] Starting request: urn:request:fe183e54-78b3-4d86-96db-403d34ca4cae (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:22:45,660 [282] [DEBUG] [app] Starting request: urn:request:6ceb2da9-91ef-47d9-9f56-b77c89202124 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:22:45,660 [278] [DEBUG] [app] Ending request: urn:request:fe183e54-78b3-4d86-96db-403d34ca4cae (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:fe183e54-78b3-4d86-96db-403d34ca4cae', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:22:45,660 [282] [DEBUG] [app] Ending request: urn:request:6ceb2da9-91ef-47d9-9f56-b77c89202124 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:6ceb2da9-91ef-47d9-9f56-b77c89202124', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:22:45,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:22:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:22:45,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:22:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:22:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:22:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:22:45,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:22:45,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:22:45,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:22:45,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:22:45,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:22:45,668 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:22:45,675 [279] [DEBUG] [app] Ending request: urn:request:4820ca6e-5447-4a82-b96e-822cca897ff2 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:4820ca6e-5447-4a82-b96e-822cca897ff2', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:22:45,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:22:45,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:22:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:22:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:22:45,676 [281] [DEBUG] [app] Ending request: urn:request:f1f8fb33-7055-412c-bc62-495f5b94202d (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f1f8fb33-7055-412c-bc62-495f5b94202d', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:22:45,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:22:45,676 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:22:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:22:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.023)
quotatotalworker stdout | 2024-04-22 04:22:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:22:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:23:01.054492+00:00 (in 14.999450 seconds)
quotatotalworker stdout | 2024-04-22 04:22:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:23:01 UTC)" (scheduled at 2024-04-22 04:22:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:22:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:22:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:22:46,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:23:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:22:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:22:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:23:17.052354+00:00 (in 29.999497 seconds)
buildlogsarchiver stdout | 2024-04-22 04:22:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:23:17 UTC)" (scheduled at 2024-04-22 04:22:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:22:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 22, 47, 53198), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:22:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:22:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:22:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:23:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:22:51,186 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:22:52,378 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:22:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:22:53,760 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:23:03.759375+00:00 (in 9.999365 seconds)
notificationworker stdout | 2024-04-22 04:22:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:23:03 UTC)" (scheduled at 2024-04-22 04:22:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:22:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:22:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 22, 53, 760486), True, datetime.datetime(2024, 4, 22, 4, 22, 53, 760486), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:22:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:22:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:22:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:23:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:22:56,069 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:22:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:22:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:23:05.871852+00:00 (in 8.998234 seconds)
securityworker stdout | 2024-04-22 04:22:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:23:26 UTC)" (scheduled at 2024-04-22 04:22:56.873109+00:00)
securityworker stdout | 2024-04-22 04:22:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:22:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:22:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:22:56,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:22:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:22:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:22:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:22:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:22:56,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:22:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:22:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:22:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:22:56,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 17, 56, 880683), 1, 2])
securityworker stdout | 2024-04-22 04:22:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:22:56,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:22:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 17, 56, 880683), 1, 2])
securityworker stdout | 2024-04-22 04:22:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:22:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:22:56,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:22:56,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:22:56,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:22:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:22:56,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:22:56,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:22:56,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:22:56,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:23:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:22:57,840 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:22:59,150 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:22:59,154 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:23:00,400 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:23:00,436 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:23:00,469 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:23:00,509 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:23:00,512 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:23:00,653 [281] [DEBUG] [app] Starting request: urn:request:b3abc706-a05a-4e8f-baa6-c534669dfbe5 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:23:00,653 [279] [DEBUG] [app] Starting request: urn:request:2134772d-2565-4b58-9797-e2775cb62be5 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:23:00,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:23:00,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:23:00,656 [284] [DEBUG] [app] Starting request: urn:request:0a938aab-ba92-432f-9488-a7f521da1fa3 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:23:00,656 [286] [DEBUG] [app] Starting request: urn:request:f506cd89-0485-465f-b071-4e300ebe8475 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:23:00,656 [284] [DEBUG] [app] Ending request: urn:request:0a938aab-ba92-432f-9488-a7f521da1fa3 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:0a938aab-ba92-432f-9488-a7f521da1fa3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:23:00,656 [286] [DEBUG] [app] Ending request: urn:request:f506cd89-0485-465f-b071-4e300ebe8475 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f506cd89-0485-465f-b071-4e300ebe8475', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:23:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:23:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:23:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:23:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:23:00,657 [286] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:23:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:23:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:23:00,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:23:00,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:23:00,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:23:00,659 [278] [DEBUG] [app] Starting request: urn:request:89e4eaa7-7c9b-49d8-8f42-b98c0e73543f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:23:00,660 [278] [DEBUG] [app] Ending request: urn:request:89e4eaa7-7c9b-49d8-8f42-b98c0e73543f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:89e4eaa7-7c9b-49d8-8f42-b98c0e73543f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:23:00,660 [282] [DEBUG] [app] Starting request: urn:request:6dab788f-5e39-432b-a3f6-b7f02fe80e99 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:23:00,660 [282] [DEBUG] [app] Ending request: urn:request:6dab788f-5e39-432b-a3f6-b7f02fe80e99 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:6dab788f-5e39-432b-a3f6-b7f02fe80e99', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:23:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:23:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:23:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:23:00,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:23:00,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:23:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:23:00,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:23:00,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:23:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 04:23:00,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:23:00,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:23:00,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:23:00,675 [281] [DEBUG] [app] Ending request: urn:request:b3abc706-a05a-4e8f-baa6-c534669dfbe5 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b3abc706-a05a-4e8f-baa6-c534669dfbe5', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:23:00,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:23:00,675 [279] [DEBUG] [app] Ending request: urn:request:2134772d-2565-4b58-9797-e2775cb62be5 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2134772d-2565-4b58-9797-e2775cb62be5', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:23:00,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:23:00,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:23:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:23:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:23:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.024)
gunicorn-web stdout | 2024-04-22 04:23:00,676 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:23:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:23:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:23:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:23:16.054492+00:00 (in 14.999445 seconds)
quotatotalworker stdout | 2024-04-22 04:23:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:23:16 UTC)" (scheduled at 2024-04-22 04:23:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:23:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:23:01,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:23:01,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:23:16 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:23:01,097 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:23:01,246 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotaregistrysizeworker stdout | 2024-04-22 04:23:02,037 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:23:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:23:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:23:16.552337+00:00 (in 13.995654 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:23:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:24:02 UTC)" (scheduled at 2024-04-22 04:23:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:23:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:23:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:24:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:23:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:23:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:23:13.759375+00:00 (in 9.999545 seconds)
notificationworker stdout | 2024-04-22 04:23:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:23:13 UTC)" (scheduled at 2024-04-22 04:23:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:23:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:23:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 23, 3, 760287), True, datetime.datetime(2024, 4, 22, 4, 23, 3, 760287), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:23:03,764 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
notificationworker stdout | 2024-04-22 04:23:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:23:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:23:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:23:13 UTC)" executed successfully
gunicorn-secscan stdout | 2024-04-22 04:23:04,979 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:23:04,982 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:23:04,985 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
buildlogsarchiver stdout | 2024-04-22 04:23:05,129 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:23:05,166 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:23:05,519 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:23:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:23:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:23:26.873109+00:00 (in 21.000687 seconds)
securityworker stdout | 2024-04-22 04:23:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:23:35 UTC)" (scheduled at 2024-04-22 04:23:05.871852+00:00)
securityworker stdout | 2024-04-22 04:23:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:23:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:23:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:23:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:23:05,885 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:23:05,885 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:23:35 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:23:06,550 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
repositorygcworker stdout | 2024-04-22 04:23:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:23:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:23:13.555667+00:00 (in 7.002683 seconds)
repositorygcworker stdout | 2024-04-22 04:23:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:24:06 UTC)" (scheduled at 2024-04-22 04:23:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:23:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:23:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 23, 6, 553314), True, datetime.datetime(2024, 4, 22, 4, 23, 6, 553314), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:23:06,563 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:23:06,563 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:23:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:24:06 UTC)" executed successfully
autopruneworker stdout | 2024-04-22 04:23:07,761 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:23:07,830 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:23:08,043 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:23:08,969 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:23:10,247 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:23:10,286 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:23:10,689 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:23:10,692 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
autopruneworker stdout | 2024-04-22 04:23:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:23:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:23:41.264267+00:00 (in 29.999453 seconds)
autopruneworker stdout | 2024-04-22 04:23:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:23:41 UTC)" (scheduled at 2024-04-22 04:23:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:23:11,273 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759731272, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:23:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:23:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:23:11,277 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:23:41 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:23:11,348 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:23:11,355 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:23:11,366 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:23:11,369 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:23:11,372 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:23:11,376 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:23:11,384 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:23:11,387 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:23:11,389 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
storagereplication stdout | 2024-04-22 04:23:12,130 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:23:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:23:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:24:06.552482+00:00 (in 52.996362 seconds)
repositorygcworker stdout | 2024-04-22 04:23:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:24:13 UTC)" (scheduled at 2024-04-22 04:23:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:23:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:23:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:24:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:23:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:23:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:23:19.762160+00:00 (in 6.002219 seconds)
notificationworker stdout | 2024-04-22 04:23:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:23:23 UTC)" (scheduled at 2024-04-22 04:23:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:23:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:23:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 23, 13, 760338), True, datetime.datetime(2024, 4, 22, 4, 23, 13, 760338), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:23:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:23:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:23:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:23:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:23:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:23:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:23:44.952062+00:00 (in 29.999498 seconds)
gcworker stdout | 2024-04-22 04:23:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:23:44 UTC)" (scheduled at 2024-04-22 04:23:14.952062+00:00)
gcworker stdout | 2024-04-22 04:23:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712550194952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:23:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:23:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:23:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:23:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:23:15,654 [281] [DEBUG] [app] Starting request: urn:request:3238a0cb-3672-43aa-b255-f08d838b12f0 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:23:15,654 [279] [DEBUG] [app] Starting request: urn:request:df14c258-682f-4251-9bff-3ff718497c49 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:23:15,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:23:15,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:23:15,657 [290] [DEBUG] [app] Starting request: urn:request:82b83192-564d-431d-9339-0bc70a5620d6 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:23:15,657 [289] [DEBUG] [app] Starting request: urn:request:01443766-fb5c-4c51-a6ae-d2bc27dffe71 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:23:15,657 [290] [DEBUG] [app] Ending request: urn:request:82b83192-564d-431d-9339-0bc70a5620d6 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:82b83192-564d-431d-9339-0bc70a5620d6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:23:15,657 [289] [DEBUG] [app] Ending request: urn:request:01443766-fb5c-4c51-a6ae-d2bc27dffe71 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:01443766-fb5c-4c51-a6ae-d2bc27dffe71', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:23:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:23:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:23:15,658 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:23:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:23:15,658 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:23:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:23:15,658 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:23:15,658 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:23:15,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:23:15,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:23:15,660 [279] [DEBUG] [app] Starting request: urn:request:57ede4fc-c54d-4bca-9b59-ce20c3096104 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:23:15,661 [279] [DEBUG] [app] Ending request: urn:request:57ede4fc-c54d-4bca-9b59-ce20c3096104 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:57ede4fc-c54d-4bca-9b59-ce20c3096104', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:23:15,661 [278] [DEBUG] [app] Starting request: urn:request:c029fd4c-6b7d-4516-9648-6ace8e0ccca8 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:23:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:23:15,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:23:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:23:15,661 [278] [DEBUG] [app] Ending request: urn:request:c029fd4c-6b7d-4516-9648-6ace8e0ccca8 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:c029fd4c-6b7d-4516-9648-6ace8e0ccca8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:23:15,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:23:15,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:23:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:23:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:23:15,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:23:15,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:23:15,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:23:15,668 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:23:15,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:23:15,676 [279] [DEBUG] [app] Ending request: urn:request:df14c258-682f-4251-9bff-3ff718497c49 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:df14c258-682f-4251-9bff-3ff718497c49', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:23:15,676 [281] [DEBUG] [app] Ending request: urn:request:3238a0cb-3672-43aa-b255-f08d838b12f0 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:3238a0cb-3672-43aa-b255-f08d838b12f0', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:23:15,676 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:23:15,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:23:15,676 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:23:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:23:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:23:15,677 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:23:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:23:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
quotatotalworker stdout | 2024-04-22 04:23:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:23:16,054 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:23:31.054492+00:00 (in 14.999516 seconds)
quotatotalworker stdout | 2024-04-22 04:23:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:23:31 UTC)" (scheduled at 2024-04-22 04:23:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:23:16,055 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:23:16,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:23:16,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:23:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:23:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:23:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:24:02.556208+00:00 (in 46.003313 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:23:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:24:16 UTC)" (scheduled at 2024-04-22 04:23:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:23:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:23:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 23, 16, 553283), True, datetime.datetime(2024, 4, 22, 4, 23, 16, 553283), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:23:16,565 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:23:16,565 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:23:16,565 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:24:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:23:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:23:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:23:47.052354+00:00 (in 29.999448 seconds)
buildlogsarchiver stdout | 2024-04-22 04:23:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:23:47 UTC)" (scheduled at 2024-04-22 04:23:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:23:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 23, 17, 53271), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:23:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:23:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:23:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:23:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:23:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:23:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:23:23.759375+00:00 (in 3.996554 seconds)
notificationworker stdout | 2024-04-22 04:23:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:28:19 UTC)" (scheduled at 2024-04-22 04:23:19.762160+00:00)
notificationworker stdout | 2024-04-22 04:23:19,763 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 23, 19, 763098), 'notification/%'])
notificationworker stdout | 2024-04-22 04:23:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:24:19 UTC)" (scheduled at 2024-04-22 04:23:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:23:19,764 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:23:19,764 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:24:19 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:23:19,774 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 23, 19, 763098), True, datetime.datetime(2024, 4, 22, 4, 23, 19, 763098), 0, 'notification/%'])
notificationworker stdout | 2024-04-22 04:23:19,777 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 23, 19, 763098), True, datetime.datetime(2024, 4, 22, 4, 23, 19, 763098), 0, 'notification/%', False, datetime.datetime(2024, 4, 22, 4, 23, 19, 763098), 'notification/%'])
notificationworker stdout | 2024-04-22 04:23:19,779 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:23:19,779 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:28:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:23:21,223 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
namespacegcworker stdout | 2024-04-22 04:23:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:23:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:23:43.057186+00:00 (in 20.997655 seconds)
namespacegcworker stdout | 2024-04-22 04:23:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:24:22 UTC)" (scheduled at 2024-04-22 04:23:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:23:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:23:22,060 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:24:22 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:23:22,416 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:23:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:23:23,760 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:23:33.759375+00:00 (in 9.999384 seconds)
notificationworker stdout | 2024-04-22 04:23:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:23:33 UTC)" (scheduled at 2024-04-22 04:23:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:23:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:23:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 23, 23, 760462), True, datetime.datetime(2024, 4, 22, 4, 23, 23, 760462), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:23:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:23:23,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:23:23,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:23:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:23:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:23:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:24:24.361582+00:00 (in 59.999450 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:23:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:24:24 UTC)" (scheduled at 2024-04-22 04:23:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:23:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:23:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:23:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:24:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:23:26,097 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:23:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:23:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:23:35.871852+00:00 (in 8.998227 seconds)
securityworker stdout | 2024-04-22 04:23:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:23:56 UTC)" (scheduled at 2024-04-22 04:23:26.873109+00:00)
securityworker stdout | 2024-04-22 04:23:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:23:26,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:23:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:23:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:23:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:23:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:23:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:23:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:23:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:23:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:23:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:23:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:23:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 18, 26, 881042), 1, 2])
securityworker stdout | 2024-04-22 04:23:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:23:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:23:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 18, 26, 881042), 1, 2])
securityworker stdout | 2024-04-22 04:23:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:23:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:23:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:23:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:23:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:23:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:23:26,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:23:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:23:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:23:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:23:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:23:27,856 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:23:29,182 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:23:29,190 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:23:30,410 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:23:30,447 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:23:30,480 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:23:30,524 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:23:30,527 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:23:30,654 [278] [DEBUG] [app] Starting request: urn:request:d48fc50d-c189-48c1-957c-339dc98dbd89 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:23:30,654 [281] [DEBUG] [app] Starting request: urn:request:1e9a9f91-3d2e-4b56-9eed-768376d64fb7 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:23:30,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:23:30,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:23:30,657 [290] [DEBUG] [app] Starting request: urn:request:ed8c8a13-cc49-481d-b55d-8e0ad266777d (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:23:30,657 [284] [DEBUG] [app] Starting request: urn:request:0344214f-c28a-4954-a800-f26acf66475b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:23:30,657 [290] [DEBUG] [app] Ending request: urn:request:ed8c8a13-cc49-481d-b55d-8e0ad266777d (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:ed8c8a13-cc49-481d-b55d-8e0ad266777d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:23:30,657 [284] [DEBUG] [app] Ending request: urn:request:0344214f-c28a-4954-a800-f26acf66475b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:0344214f-c28a-4954-a800-f26acf66475b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:23:30,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:23:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:23:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:23:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:23:30,658 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:23:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:23:30,658 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:23:30,658 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:23:30,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:23:30,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:23:30,660 [278] [DEBUG] [app] Starting request: urn:request:45b5740b-a065-4a44-bcba-e0ef8fefeeb6 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:23:30,660 [279] [DEBUG] [app] Starting request: urn:request:f7469aa9-f52a-4f9d-9f91-d0a18637de04 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:23:30,660 [278] [DEBUG] [app] Ending request: urn:request:45b5740b-a065-4a44-bcba-e0ef8fefeeb6 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:45b5740b-a065-4a44-bcba-e0ef8fefeeb6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:23:30,660 [279] [DEBUG] [app] Ending request: urn:request:f7469aa9-f52a-4f9d-9f91-d0a18637de04 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:f7469aa9-f52a-4f9d-9f91-d0a18637de04', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:23:30,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:23:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:23:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:23:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:23:30,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:23:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:23:30,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:23:30,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:23:30,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:23:30,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:23:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:23:30,668 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:23:30,675 [278] [DEBUG] [app] Ending request: urn:request:d48fc50d-c189-48c1-957c-339dc98dbd89 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:d48fc50d-c189-48c1-957c-339dc98dbd89', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:23:30,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:23:30,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:23:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:23:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:23:30,675 [281] [DEBUG] [app] Ending request: urn:request:1e9a9f91-3d2e-4b56-9eed-768376d64fb7 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:1e9a9f91-3d2e-4b56-9eed-768376d64fb7', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:23:30,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:23:30,676 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:23:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:23:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotatotalworker stdout | 2024-04-22 04:23:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:23:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:23:46.054492+00:00 (in 14.999463 seconds)
quotatotalworker stdout | 2024-04-22 04:23:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:23:46 UTC)" (scheduled at 2024-04-22 04:23:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:23:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:23:31,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:23:31,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:23:46 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:23:31,133 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:23:31,282 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotaregistrysizeworker stdout | 2024-04-22 04:23:32,068 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:23:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:23:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:23:43.759375+00:00 (in 9.999413 seconds)
notificationworker stdout | 2024-04-22 04:23:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:23:43 UTC)" (scheduled at 2024-04-22 04:23:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:23:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:23:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 23, 33, 760451), True, datetime.datetime(2024, 4, 22, 4, 23, 33, 760451), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:23:33,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:23:33,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:23:33,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:23:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:23:33,797 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:23:34,988 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:23:34,992 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:23:34,995 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
buildlogsarchiver stdout | 2024-04-22 04:23:35,156 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:23:35,202 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:23:35,550 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:23:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:23:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:23:56.873109+00:00 (in 21.000724 seconds)
securityworker stdout | 2024-04-22 04:23:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:24:05 UTC)" (scheduled at 2024-04-22 04:23:35.871852+00:00)
securityworker stdout | 2024-04-22 04:23:35,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:23:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:23:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:23:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:23:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:23:35,888 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:23:35,890 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:23:35,890 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:23:35,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 18, 35, 876468), 1, 2])
securityworker stdout | 2024-04-22 04:23:35,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:23:35,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:23:35,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 18, 35, 876468), 1, 2])
securityworker stdout | 2024-04-22 04:23:35,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:23:35,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:23:35,896 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:23:35,896 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:24:05 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:23:36,569 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:23:37,792 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:23:37,840 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:23:38,079 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:23:39,005 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
exportactionlogsworker stdout | 2024-04-22 04:23:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:23:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:23:41.564959+00:00 (in 1.997469 seconds)
exportactionlogsworker stdout | 2024-04-22 04:23:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:24:39 UTC)" (scheduled at 2024-04-22 04:23:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:23:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:23:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:24:39 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:23:40,284 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:23:40,316 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 04:23:40,711 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:23:40,724 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
autopruneworker stdout | 2024-04-22 04:23:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:23:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:24:11.264267+00:00 (in 29.999458 seconds)
autopruneworker stdout | 2024-04-22 04:23:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:24:11 UTC)" (scheduled at 2024-04-22 04:23:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:23:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759761271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:23:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:23:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:23:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:24:11 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:23:41,358 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:23:41,366 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:23:41,374 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:23:41,381 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:23:41,385 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:23:41,388 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:23:41,394 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:23:41,397 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:23:41,399 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
exportactionlogsworker stdout | 2024-04-22 04:23:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:23:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:24:39.566970+00:00 (in 58.001519 seconds)
exportactionlogsworker stdout | 2024-04-22 04:23:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:24:41 UTC)" (scheduled at 2024-04-22 04:23:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:23:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:23:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 23, 41, 565722), True, datetime.datetime(2024, 4, 22, 4, 23, 41, 565722), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:23:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:23:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:23:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:24:41 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:23:42,139 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
namespacegcworker stdout | 2024-04-22 04:23:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:23:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:24:22.058978+00:00 (in 39.001306 seconds)
namespacegcworker stdout | 2024-04-22 04:23:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:24:43 UTC)" (scheduled at 2024-04-22 04:23:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:23:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:23:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 23, 43, 58083), True, datetime.datetime(2024, 4, 22, 4, 23, 43, 58083), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:23:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:23:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:23:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:24:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:23:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:23:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:23:53.759375+00:00 (in 9.999401 seconds)
notificationworker stdout | 2024-04-22 04:23:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:23:53 UTC)" (scheduled at 2024-04-22 04:23:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:23:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:23:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 23, 43, 760390), True, datetime.datetime(2024, 4, 22, 4, 23, 43, 760390), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:23:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:23:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:23:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:23:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:23:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:23:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:24:14.952062+00:00 (in 29.999528 seconds)
gcworker stdout | 2024-04-22 04:23:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:24:14 UTC)" (scheduled at 2024-04-22 04:23:44.952062+00:00)
gcworker stdout | 2024-04-22 04:23:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712550224952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:23:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:23:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:23:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:24:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:23:45,653 [279] [DEBUG] [app] Starting request: urn:request:6ff9ab74-b915-4bb0-8a23-6ef045cf467d (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:23:45,653 [281] [DEBUG] [app] Starting request: urn:request:1749891a-0b13-4c9c-bb5e-8d8466d695a9 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:23:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:23:45,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:23:45,656 [292] [DEBUG] [app] Starting request: urn:request:c005db5e-3221-4d55-8e39-d7f1f90d2e00 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:23:45,656 [284] [DEBUG] [app] Starting request: urn:request:9b0f9991-b2d6-41c5-a518-3742a89b4882 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:23:45,656 [292] [DEBUG] [app] Ending request: urn:request:c005db5e-3221-4d55-8e39-d7f1f90d2e00 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:c005db5e-3221-4d55-8e39-d7f1f90d2e00', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:23:45,656 [284] [DEBUG] [app] Ending request: urn:request:9b0f9991-b2d6-41c5-a518-3742a89b4882 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:9b0f9991-b2d6-41c5-a518-3742a89b4882', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:23:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:23:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:23:45,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:23:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:23:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:23:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:23:45,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:23:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:23:45,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:23:45,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:23:45,659 [279] [DEBUG] [app] Starting request: urn:request:28bff617-c883-47f1-aab3-baef7a1521bd (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:23:45,659 [282] [DEBUG] [app] Starting request: urn:request:e530c1c4-bf2a-48f3-b28a-895044673cef (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:23:45,660 [279] [DEBUG] [app] Ending request: urn:request:28bff617-c883-47f1-aab3-baef7a1521bd (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:28bff617-c883-47f1-aab3-baef7a1521bd', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:23:45,660 [282] [DEBUG] [app] Ending request: urn:request:e530c1c4-bf2a-48f3-b28a-895044673cef (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e530c1c4-bf2a-48f3-b28a-895044673cef', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:23:45,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:23:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:23:45,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:23:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:23:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:23:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:23:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:23:45,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:23:45,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:23:45,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:23:45,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:23:45,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:23:45,674 [281] [DEBUG] [app] Ending request: urn:request:1749891a-0b13-4c9c-bb5e-8d8466d695a9 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:1749891a-0b13-4c9c-bb5e-8d8466d695a9', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:23:45,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:23:45,674 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:23:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:23:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:23:45,675 [279] [DEBUG] [app] Ending request: urn:request:6ff9ab74-b915-4bb0-8a23-6ef045cf467d (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:6ff9ab74-b915-4bb0-8a23-6ef045cf467d', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:23:45,675 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:23:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:23:45,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:23:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:23:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:23:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:24:01.054492+00:00 (in 14.999414 seconds)
quotatotalworker stdout | 2024-04-22 04:23:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:24:01 UTC)" (scheduled at 2024-04-22 04:23:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:23:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:23:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:23:46,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:24:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:23:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:23:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:24:17.052354+00:00 (in 29.999497 seconds)
buildlogsarchiver stdout | 2024-04-22 04:23:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:24:17 UTC)" (scheduled at 2024-04-22 04:23:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:23:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 23, 47, 53199), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:23:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:23:47,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:23:47,063 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:24:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:23:51,259 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:23:52,442 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:23:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:23:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:24:03.759375+00:00 (in 9.999464 seconds)
notificationworker stdout | 2024-04-22 04:23:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:24:03 UTC)" (scheduled at 2024-04-22 04:23:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:23:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:23:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 23, 53, 760358), True, datetime.datetime(2024, 4, 22, 4, 23, 53, 760358), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:23:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:23:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:23:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:24:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:23:56,112 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:23:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:23:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:24:05.871852+00:00 (in 8.998246 seconds)
securityworker stdout | 2024-04-22 04:23:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:24:26 UTC)" (scheduled at 2024-04-22 04:23:56.873109+00:00)
securityworker stdout | 2024-04-22 04:23:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:23:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:23:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:23:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:23:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:23:56,878 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:23:56,878 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:23:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:23:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:23:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:23:56,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:23:56,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:23:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 18, 56, 881698), 1, 2])
securityworker stdout | 2024-04-22 04:23:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:23:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:23:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 18, 56, 881698), 1, 2])
securityworker stdout | 2024-04-22 04:23:56,900 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:23:56,900 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:23:56,900 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:23:56,900 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:23:56,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:23:56,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:23:56,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:23:56,901 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:23:56,901 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:23:56,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:24:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:23:57,863 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:23:59,214 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:23:59,226 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:24:00,419 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:24:00,458 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:24:00,490 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:24:00,537 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:24:00,540 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:24:00,652 [282] [DEBUG] [app] Starting request: urn:request:b42f7a26-cf7b-4ae6-b826-19cb0fc7b901 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:24:00,653 [281] [DEBUG] [app] Starting request: urn:request:bb37d743-5a72-45ee-b6a0-13a401d643d3 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:24:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:24:00,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:24:00,655 [292] [DEBUG] [app] Starting request: urn:request:cbfcf142-b306-4228-b83b-09059997d087 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:24:00,656 [292] [DEBUG] [app] Ending request: urn:request:cbfcf142-b306-4228-b83b-09059997d087 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:cbfcf142-b306-4228-b83b-09059997d087', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:24:00,656 [286] [DEBUG] [app] Starting request: urn:request:cbe5eedf-f413-4b82-a622-5d2444970a79 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:24:00,656 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:24:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:24:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:24:00,656 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 04:24:00,656 [286] [DEBUG] [app] Ending request: urn:request:cbe5eedf-f413-4b82-a622-5d2444970a79 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:cbe5eedf-f413-4b82-a622-5d2444970a79', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:24:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:24:00,657 [286] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:24:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:24:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:24:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:24:00,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:24:00,659 [278] [DEBUG] [app] Starting request: urn:request:e74fb426-e0b5-43e1-ab16-a611ec1b590a (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:24:00,659 [278] [DEBUG] [app] Ending request: urn:request:e74fb426-e0b5-43e1-ab16-a611ec1b590a (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e74fb426-e0b5-43e1-ab16-a611ec1b590a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:24:00,659 [282] [DEBUG] [app] Starting request: urn:request:d345d8ca-95e2-4ba9-b057-936654768238 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:24:00,660 [282] [DEBUG] [app] Ending request: urn:request:d345d8ca-95e2-4ba9-b057-936654768238 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d345d8ca-95e2-4ba9-b057-936654768238', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:24:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:24:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:24:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:24:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:24:00,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:24:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:24:00,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:24:00,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:24:00,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:24:00,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:24:00,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:24:00,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:24:00,675 [281] [DEBUG] [app] Ending request: urn:request:bb37d743-5a72-45ee-b6a0-13a401d643d3 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:bb37d743-5a72-45ee-b6a0-13a401d643d3', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:24:00,675 [282] [DEBUG] [app] Ending request: urn:request:b42f7a26-cf7b-4ae6-b826-19cb0fc7b901 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b42f7a26-cf7b-4ae6-b826-19cb0fc7b901', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:24:00,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:24:00,675 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:24:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:24:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:24:00,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:24:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:24:00,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:24:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:24:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:24:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:24:16.054492+00:00 (in 14.999418 seconds)
quotatotalworker stdout | 2024-04-22 04:24:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:24:16 UTC)" (scheduled at 2024-04-22 04:24:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:24:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:24:01,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:24:01,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:24:16 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:24:01,144 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:24:01,305 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotaregistrysizeworker stdout | 2024-04-22 04:24:02,105 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:24:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:24:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:24:16.552337+00:00 (in 13.995620 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:24:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:25:02 UTC)" (scheduled at 2024-04-22 04:24:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:24:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:24:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:25:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:24:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:24:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:24:13.759375+00:00 (in 9.999498 seconds)
notificationworker stdout | 2024-04-22 04:24:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:24:13 UTC)" (scheduled at 2024-04-22 04:24:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:24:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:24:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 24, 3, 760271), True, datetime.datetime(2024, 4, 22, 4, 24, 3, 760271), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:24:03,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:24:03,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:24:03,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:24:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:24:03,834 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:24:04,998 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:24:05,002 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:24:05,005 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
buildlogsarchiver stdout | 2024-04-22 04:24:05,163 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:24:05,229 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:24:05,569 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:24:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:24:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:24:26.873109+00:00 (in 21.000704 seconds)
securityworker stdout | 2024-04-22 04:24:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:24:35 UTC)" (scheduled at 2024-04-22 04:24:05.871852+00:00)
securityworker stdout | 2024-04-22 04:24:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:24:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:24:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:24:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:24:05,885 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:24:05,885 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:24:35 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:24:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:24:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:24:13.555667+00:00 (in 7.002611 seconds)
repositorygcworker stdout | 2024-04-22 04:24:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:25:06 UTC)" (scheduled at 2024-04-22 04:24:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:24:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:24:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 24, 6, 553475), True, datetime.datetime(2024, 4, 22, 4, 24, 6, 553475), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:24:06,565 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:24:06,565 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:24:06,565 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:25:06 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:24:06,606 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:24:07,800 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:24:07,853 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:24:08,116 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:24:09,042 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:24:10,297 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:24:10,348 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 04:24:10,737 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:24:10,757 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
autopruneworker stdout | 2024-04-22 04:24:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:24:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:24:41.264267+00:00 (in 29.999494 seconds)
autopruneworker stdout | 2024-04-22 04:24:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:24:41 UTC)" (scheduled at 2024-04-22 04:24:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:24:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759791271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:24:11,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:24:11,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:24:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:24:41 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:24:11,369 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:24:11,377 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:24:11,382 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:24:11,391 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:24:11,395 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:24:11,398 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:24:11,403 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:24:11,406 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:24:11,408 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
storagereplication stdout | 2024-04-22 04:24:12,174 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:24:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:24:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:25:06.552482+00:00 (in 52.996285 seconds)
repositorygcworker stdout | 2024-04-22 04:24:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:25:13 UTC)" (scheduled at 2024-04-22 04:24:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:24:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:24:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:25:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:24:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:24:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:24:19.762424+00:00 (in 6.002559 seconds)
notificationworker stdout | 2024-04-22 04:24:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:24:23 UTC)" (scheduled at 2024-04-22 04:24:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:24:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:24:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 24, 13, 760265), True, datetime.datetime(2024, 4, 22, 4, 24, 13, 760265), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:24:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:24:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:24:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:24:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:24:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:24:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:24:44.952062+00:00 (in 29.999508 seconds)
gcworker stdout | 2024-04-22 04:24:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:24:44 UTC)" (scheduled at 2024-04-22 04:24:14.952062+00:00)
gcworker stdout | 2024-04-22 04:24:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712550254952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:24:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:24:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:24:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:24:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:24:15,653 [282] [DEBUG] [app] Starting request: urn:request:1e6c694a-612d-4dd6-abe4-088d311241b8 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:24:15,653 [281] [DEBUG] [app] Starting request: urn:request:d9da38ed-59db-41e1-9f17-1612c0c15fbf (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:24:15,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:24:15,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:24:15,657 [284] [DEBUG] [app] Starting request: urn:request:675f89f0-533c-434c-a10f-e0bc5896e68b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:24:15,657 [291] [DEBUG] [app] Starting request: urn:request:53fd9494-1364-4531-a8af-ab368db467be (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:24:15,657 [284] [DEBUG] [app] Ending request: urn:request:675f89f0-533c-434c-a10f-e0bc5896e68b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:675f89f0-533c-434c-a10f-e0bc5896e68b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:24:15,657 [291] [DEBUG] [app] Ending request: urn:request:53fd9494-1364-4531-a8af-ab368db467be (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:53fd9494-1364-4531-a8af-ab368db467be', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:24:15,658 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:24:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:24:15,658 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:24:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:24:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:24:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:24:15,658 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:24:15,658 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:24:15,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:24:15,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:24:15,661 [279] [DEBUG] [app] Starting request: urn:request:23f79aef-d326-4960-a65e-9e55e04651b0 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:24:15,661 [282] [DEBUG] [app] Starting request: urn:request:84423dd3-45e6-4463-813b-577f3582a3d7 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:24:15,661 [282] [DEBUG] [app] Ending request: urn:request:84423dd3-45e6-4463-813b-577f3582a3d7 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:84423dd3-45e6-4463-813b-577f3582a3d7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:24:15,661 [279] [DEBUG] [app] Ending request: urn:request:23f79aef-d326-4960-a65e-9e55e04651b0 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:23f79aef-d326-4960-a65e-9e55e04651b0', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:24:15,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:24:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:24:15,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:24:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:24:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:24:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:24:15,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:24:15,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:24:15,662 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:24:15,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:24:15,668 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:24:15,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:24:15,675 [282] [DEBUG] [app] Ending request: urn:request:1e6c694a-612d-4dd6-abe4-088d311241b8 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:1e6c694a-612d-4dd6-abe4-088d311241b8', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:24:15,675 [281] [DEBUG] [app] Ending request: urn:request:d9da38ed-59db-41e1-9f17-1612c0c15fbf (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:d9da38ed-59db-41e1-9f17-1612c0c15fbf', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:24:15,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:24:15,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:24:15,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:24:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:24:15,676 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:24:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:24:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:24:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
quotatotalworker stdout | 2024-04-22 04:24:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:24:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:24:31.054492+00:00 (in 14.999407 seconds)
quotatotalworker stdout | 2024-04-22 04:24:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:24:31 UTC)" (scheduled at 2024-04-22 04:24:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:24:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:24:16,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:24:16,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:24:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:24:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:24:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:25:02.556208+00:00 (in 46.003318 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:24:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:25:16 UTC)" (scheduled at 2024-04-22 04:24:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:24:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:24:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 24, 16, 553282), True, datetime.datetime(2024, 4, 22, 4, 24, 16, 553282), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:24:16,565 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:24:16,565 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:24:16,565 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:25:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:24:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:24:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:24:47.052354+00:00 (in 29.999449 seconds)
buildlogsarchiver stdout | 2024-04-22 04:24:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:24:47 UTC)" (scheduled at 2024-04-22 04:24:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:24:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 24, 17, 53288), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:24:17,065 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:24:17,065 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:24:17,065 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:24:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:24:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:24:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:24:23.759375+00:00 (in 3.996489 seconds)
notificationworker stdout | 2024-04-22 04:24:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:25:19 UTC)" (scheduled at 2024-04-22 04:24:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:24:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:24:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:25:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:24:21,270 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
namespacegcworker stdout | 2024-04-22 04:24:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:24:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:24:43.057186+00:00 (in 20.997678 seconds)
namespacegcworker stdout | 2024-04-22 04:24:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:25:22 UTC)" (scheduled at 2024-04-22 04:24:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:24:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:24:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:25:22 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:24:22,478 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:24:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:24:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:24:33.759375+00:00 (in 9.999475 seconds)
notificationworker stdout | 2024-04-22 04:24:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:24:33 UTC)" (scheduled at 2024-04-22 04:24:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:24:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:24:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 24, 23, 760350), True, datetime.datetime(2024, 4, 22, 4, 24, 23, 760350), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:24:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:24:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:24:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:24:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:24:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:24:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:25:24.361582+00:00 (in 59.999425 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:24:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:25:24 UTC)" (scheduled at 2024-04-22 04:24:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:24:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:24:24,373 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:24:24,373 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:25:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:24:26,148 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:24:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:24:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:24:35.871852+00:00 (in 8.998270 seconds)
securityworker stdout | 2024-04-22 04:24:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:24:56 UTC)" (scheduled at 2024-04-22 04:24:26.873109+00:00)
securityworker stdout | 2024-04-22 04:24:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:24:26,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:24:26,875 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:24:26,875 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:24:26,875 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:24:26,875 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:24:26,876 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:24:26,878 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:24:26,879 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:24:26,889 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:24:26,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:24:26,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:24:26,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 19, 26, 879459), 1, 2])
securityworker stdout | 2024-04-22 04:24:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:24:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:24:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 19, 26, 879459), 1, 2])
securityworker stdout | 2024-04-22 04:24:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:24:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:24:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:24:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:24:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:24:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:24:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:24:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:24:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:24:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:24:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:24:27,890 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:24:29,250 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:24:29,263 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:24:30,428 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:24:30,468 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:24:30,501 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:24:30,550 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:24:30,553 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:24:30,653 [282] [DEBUG] [app] Starting request: urn:request:8c0cfb85-2a94-4a7e-8a60-02abfb25d33d (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:24:30,653 [278] [DEBUG] [app] Starting request: urn:request:62acfd6f-70eb-4b4e-87f1-c04de3856d05 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:24:30,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:24:30,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:24:30,656 [291] [DEBUG] [app] Starting request: urn:request:24b6b2db-dd5a-4657-b1cb-73d750dfcbe1 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:24:30,656 [291] [DEBUG] [app] Ending request: urn:request:24b6b2db-dd5a-4657-b1cb-73d750dfcbe1 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:24b6b2db-dd5a-4657-b1cb-73d750dfcbe1', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:24:30,656 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:24:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:24:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:24:30,657 [284] [DEBUG] [app] Starting request: urn:request:285df801-0f3f-47ff-97ec-249104f715fb (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:24:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 04:24:30,657 [284] [DEBUG] [app] Ending request: urn:request:285df801-0f3f-47ff-97ec-249104f715fb (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:285df801-0f3f-47ff-97ec-249104f715fb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:24:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:24:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:24:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:24:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:24:30,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:24:30,659 [281] [DEBUG] [app] Starting request: urn:request:f240c7f1-66d6-4436-b973-568ce1e232e0 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:24:30,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:24:30,659 [281] [DEBUG] [app] Ending request: urn:request:f240c7f1-66d6-4436-b973-568ce1e232e0 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:f240c7f1-66d6-4436-b973-568ce1e232e0', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:24:30,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:24:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:24:30,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:24:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.001)
gunicorn-web stdout | 2024-04-22 04:24:30,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:24:30,661 [279] [DEBUG] [app] Starting request: urn:request:5784cf66-f6a5-4b52-b01f-58f52adf8056 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:24:30,661 [279] [DEBUG] [app] Ending request: urn:request:5784cf66-f6a5-4b52-b01f-58f52adf8056 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:5784cf66-f6a5-4b52-b01f-58f52adf8056', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:24:30,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:24:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:24:30,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:24:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:24:30,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:24:30,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:24:30,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:24:30,674 [282] [DEBUG] [app] Ending request: urn:request:8c0cfb85-2a94-4a7e-8a60-02abfb25d33d (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:8c0cfb85-2a94-4a7e-8a60-02abfb25d33d', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:24:30,674 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:24:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:24:30,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:24:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:24:30,676 [278] [DEBUG] [app] Ending request: urn:request:62acfd6f-70eb-4b4e-87f1-c04de3856d05 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:62acfd6f-70eb-4b4e-87f1-c04de3856d05', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:24:30,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:24:30,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:24:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:24:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
quotatotalworker stdout | 2024-04-22 04:24:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:24:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:24:46.054492+00:00 (in 14.999426 seconds)
quotatotalworker stdout | 2024-04-22 04:24:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:24:46 UTC)" (scheduled at 2024-04-22 04:24:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:24:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:24:31,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:24:31,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:24:46 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:24:31,167 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:24:31,339 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotaregistrysizeworker stdout | 2024-04-22 04:24:32,113 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:24:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:24:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:24:43.759375+00:00 (in 9.999449 seconds)
notificationworker stdout | 2024-04-22 04:24:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:24:43 UTC)" (scheduled at 2024-04-22 04:24:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:24:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:24:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 24, 33, 760293), True, datetime.datetime(2024, 4, 22, 4, 24, 33, 760293), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:24:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:24:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:24:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:24:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:24:33,865 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:24:35,006 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:24:35,010 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:24:35,013 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
buildlogsarchiver stdout | 2024-04-22 04:24:35,200 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:24:35,265 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:24:35,606 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:24:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:24:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:24:56.873109+00:00 (in 21.000736 seconds)
securityworker stdout | 2024-04-22 04:24:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:25:05 UTC)" (scheduled at 2024-04-22 04:24:35.871852+00:00)
securityworker stdout | 2024-04-22 04:24:35,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:24:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:24:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:24:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:24:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:24:35,888 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:24:35,891 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:24:35,891 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:24:35,892 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 19, 35, 876552), 1, 2])
securityworker stdout | 2024-04-22 04:24:35,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:24:35,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:24:35,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 19, 35, 876552), 1, 2])
securityworker stdout | 2024-04-22 04:24:35,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:24:35,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:24:35,897 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:24:35,897 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:25:05 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:24:36,634 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:24:37,815 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:24:37,890 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:24:38,150 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:24:39,070 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
exportactionlogsworker stdout | 2024-04-22 04:24:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:24:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:24:41.564959+00:00 (in 1.997466 seconds)
exportactionlogsworker stdout | 2024-04-22 04:24:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:25:39 UTC)" (scheduled at 2024-04-22 04:24:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:24:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:24:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:25:39 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:24:40,305 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:24:40,361 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 04:24:40,753 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:24:40,795 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
autopruneworker stdout | 2024-04-22 04:24:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:24:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:25:11.264267+00:00 (in 29.999445 seconds)
autopruneworker stdout | 2024-04-22 04:24:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:25:11 UTC)" (scheduled at 2024-04-22 04:24:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:24:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759821271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:24:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:24:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:24:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:25:11 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:24:41,379 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:24:41,385 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:24:41,394 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:24:41,402 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:24:41,407 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:24:41,410 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:24:41,413 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:24:41,416 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:24:41,419 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
exportactionlogsworker stdout | 2024-04-22 04:24:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:24:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:25:39.566970+00:00 (in 58.001468 seconds)
exportactionlogsworker stdout | 2024-04-22 04:24:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:25:41 UTC)" (scheduled at 2024-04-22 04:24:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:24:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:24:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 24, 41, 565815), True, datetime.datetime(2024, 4, 22, 4, 24, 41, 565815), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:24:41,580 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:24:41,580 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:24:41,580 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:25:41 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:24:42,197 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
namespacegcworker stdout | 2024-04-22 04:24:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:24:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:25:22.058978+00:00 (in 39.001311 seconds)
namespacegcworker stdout | 2024-04-22 04:24:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:25:43 UTC)" (scheduled at 2024-04-22 04:24:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:24:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:24:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 24, 43, 57962), True, datetime.datetime(2024, 4, 22, 4, 24, 43, 57962), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:24:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:24:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:24:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:25:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:24:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:24:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:24:53.759375+00:00 (in 9.999482 seconds)
notificationworker stdout | 2024-04-22 04:24:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:24:53 UTC)" (scheduled at 2024-04-22 04:24:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:24:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:24:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 24, 43, 760356), True, datetime.datetime(2024, 4, 22, 4, 24, 43, 760356), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:24:43,779 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:24:43,779 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:24:43,779 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:24:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:24:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:24:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:25:14.952062+00:00 (in 29.999492 seconds)
gcworker stdout | 2024-04-22 04:24:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:25:14 UTC)" (scheduled at 2024-04-22 04:24:44.952062+00:00)
gcworker stdout | 2024-04-22 04:24:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712550284953, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:24:44,966 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:24:44,966 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:24:44,966 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:25:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:24:45,653 [279] [DEBUG] [app] Starting request: urn:request:c0568b3f-eecb-4057-8253-b992583b60b8 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:24:45,653 [278] [DEBUG] [app] Starting request: urn:request:a10bf540-03b1-4b3e-a2fe-a9aaae366ae7 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:24:45,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:24:45,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:24:45,656 [284] [DEBUG] [app] Starting request: urn:request:b8e04c26-abe1-48c3-9bc5-38708609d700 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:24:45,656 [288] [DEBUG] [app] Starting request: urn:request:0342e70d-03b5-4db2-91e7-1b9fd54dce01 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:24:45,657 [284] [DEBUG] [app] Ending request: urn:request:b8e04c26-abe1-48c3-9bc5-38708609d700 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b8e04c26-abe1-48c3-9bc5-38708609d700', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:24:45,657 [288] [DEBUG] [app] Ending request: urn:request:0342e70d-03b5-4db2-91e7-1b9fd54dce01 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:0342e70d-03b5-4db2-91e7-1b9fd54dce01', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:24:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:24:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:24:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:24:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:24:45,657 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:24:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:24:45,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:24:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:24:45,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:24:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:24:45,660 [282] [DEBUG] [app] Starting request: urn:request:05d4a24f-e0b5-4410-909b-f1588f76de33 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:24:45,660 [281] [DEBUG] [app] Starting request: urn:request:fd1442c0-fc6f-4a74-9c5e-b93bb10d6b13 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:24:45,660 [281] [DEBUG] [app] Ending request: urn:request:fd1442c0-fc6f-4a74-9c5e-b93bb10d6b13 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:fd1442c0-fc6f-4a74-9c5e-b93bb10d6b13', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:24:45,660 [282] [DEBUG] [app] Ending request: urn:request:05d4a24f-e0b5-4410-909b-f1588f76de33 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:05d4a24f-e0b5-4410-909b-f1588f76de33', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:24:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:24:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 04:24:45,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:24:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:24:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:24:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:24:45,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:24:45,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:24:45,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:24:45,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:24:45,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:24:45,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:24:45,675 [279] [DEBUG] [app] Ending request: urn:request:c0568b3f-eecb-4057-8253-b992583b60b8 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:c0568b3f-eecb-4057-8253-b992583b60b8', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:24:45,675 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:24:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:24:45,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:24:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:24:45,675 [278] [DEBUG] [app] Ending request: urn:request:a10bf540-03b1-4b3e-a2fe-a9aaae366ae7 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a10bf540-03b1-4b3e-a2fe-a9aaae366ae7', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:24:45,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:24:45,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:24:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:24:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
quotatotalworker stdout | 2024-04-22 04:24:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:24:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:25:01.054492+00:00 (in 14.999458 seconds)
quotatotalworker stdout | 2024-04-22 04:24:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:25:01 UTC)" (scheduled at 2024-04-22 04:24:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:24:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:24:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:24:46,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:25:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:24:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:24:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:25:17.052354+00:00 (in 29.999422 seconds)
buildlogsarchiver stdout | 2024-04-22 04:24:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:25:17 UTC)" (scheduled at 2024-04-22 04:24:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:24:47,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 24, 47, 53346), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:24:47,068 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:24:47,068 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:24:47,068 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:25:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:24:51,306 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:24:52,508 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:24:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:24:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:25:03.759375+00:00 (in 9.999452 seconds)
notificationworker stdout | 2024-04-22 04:24:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:25:03 UTC)" (scheduled at 2024-04-22 04:24:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:24:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:24:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 24, 53, 760244), True, datetime.datetime(2024, 4, 22, 4, 24, 53, 760244), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:24:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:24:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:24:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:25:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:24:56,164 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:24:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:24:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:25:05.871852+00:00 (in 8.998219 seconds)
securityworker stdout | 2024-04-22 04:24:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:25:26 UTC)" (scheduled at 2024-04-22 04:24:56.873109+00:00)
securityworker stdout | 2024-04-22 04:24:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:24:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:24:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:24:56,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:24:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:24:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:24:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:24:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:24:56,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:24:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:24:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:24:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:24:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 19, 56, 880722), 1, 2])
securityworker stdout | 2024-04-22 04:24:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:24:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:24:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 19, 56, 880722), 1, 2])
securityworker stdout | 2024-04-22 04:24:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:24:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:24:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:24:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:24:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:24:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:24:56,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:24:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:24:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:24:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:25:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:24:57,927 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:24:59,286 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:24:59,290 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:25:00,438 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:25:00,478 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:25:00,511 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:25:00,561 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:25:00,565 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:25:00,653 [278] [DEBUG] [app] Starting request: urn:request:391b062e-97b7-460d-a7ef-0ab734e00809 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:25:00,653 [279] [DEBUG] [app] Starting request: urn:request:5ee9a2b6-b01b-4f6b-bc26-94e18f0b0e5b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:25:00,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:25:00,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:25:00,656 [284] [DEBUG] [app] Starting request: urn:request:61d4492c-7c35-4f39-8cef-5e9cb829b1c4 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:25:00,656 [292] [DEBUG] [app] Starting request: urn:request:0a1f3d28-14ae-48e0-bc7a-f77f17ded4f7 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:25:00,656 [284] [DEBUG] [app] Ending request: urn:request:61d4492c-7c35-4f39-8cef-5e9cb829b1c4 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:61d4492c-7c35-4f39-8cef-5e9cb829b1c4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:25:00,656 [292] [DEBUG] [app] Ending request: urn:request:0a1f3d28-14ae-48e0-bc7a-f77f17ded4f7 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:0a1f3d28-14ae-48e0-bc7a-f77f17ded4f7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:25:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:25:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:25:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:25:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:25:00,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:25:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:25:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:25:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:25:00,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:25:00,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:25:00,659 [278] [DEBUG] [app] Starting request: urn:request:83e2ff4b-87ea-45f1-a494-a269601a9750 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:25:00,659 [281] [DEBUG] [app] Starting request: urn:request:bdb345bd-953f-4b8a-a59f-f7428ae3dd7b (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:25:00,659 [278] [DEBUG] [app] Ending request: urn:request:83e2ff4b-87ea-45f1-a494-a269601a9750 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:83e2ff4b-87ea-45f1-a494-a269601a9750', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:25:00,660 [281] [DEBUG] [app] Ending request: urn:request:bdb345bd-953f-4b8a-a59f-f7428ae3dd7b (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:bdb345bd-953f-4b8a-a59f-f7428ae3dd7b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:25:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:25:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:25:00,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:25:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:25:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:25:00,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:25:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:25:00,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:25:00,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:25:00,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:25:00,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:25:00,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:25:00,674 [279] [DEBUG] [app] Ending request: urn:request:5ee9a2b6-b01b-4f6b-bc26-94e18f0b0e5b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:5ee9a2b6-b01b-4f6b-bc26-94e18f0b0e5b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:25:00,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:25:00,674 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:25:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:25:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:25:00,675 [278] [DEBUG] [app] Ending request: urn:request:391b062e-97b7-460d-a7ef-0ab734e00809 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:391b062e-97b7-460d-a7ef-0ab734e00809', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:25:00,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:25:00,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:25:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:25:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotatotalworker stdout | 2024-04-22 04:25:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:25:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:25:16.054492+00:00 (in 14.999395 seconds)
quotatotalworker stdout | 2024-04-22 04:25:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:25:16 UTC)" (scheduled at 2024-04-22 04:25:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:25:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:25:01,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:25:01,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:25:16 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:25:01,203 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:25:01,353 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotaregistrysizeworker stdout | 2024-04-22 04:25:02,149 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:25:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:25:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:25:16.552337+00:00 (in 13.995620 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:25:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:26:02 UTC)" (scheduled at 2024-04-22 04:25:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:25:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:25:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:26:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:25:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:25:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:25:13.759375+00:00 (in 9.999453 seconds)
notificationworker stdout | 2024-04-22 04:25:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:25:13 UTC)" (scheduled at 2024-04-22 04:25:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:25:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:25:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 25, 3, 760383), True, datetime.datetime(2024, 4, 22, 4, 25, 3, 760383), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:25:03,772 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:25:03,772 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:25:03,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:25:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:25:03,878 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:25:05,014 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:25:05,019 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:25:05,022 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
buildlogsarchiver stdout | 2024-04-22 04:25:05,219 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:25:05,295 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:25:05,623 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:25:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:25:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:25:26.873109+00:00 (in 21.000735 seconds)
securityworker stdout | 2024-04-22 04:25:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:25:35 UTC)" (scheduled at 2024-04-22 04:25:05.871852+00:00)
securityworker stdout | 2024-04-22 04:25:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:25:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:25:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:25:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:25:05,886 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:25:05,886 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:25:35 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:25:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:25:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:25:13.555667+00:00 (in 7.002656 seconds)
repositorygcworker stdout | 2024-04-22 04:25:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:26:06 UTC)" (scheduled at 2024-04-22 04:25:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:25:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:25:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 25, 6, 553372), True, datetime.datetime(2024, 4, 22, 4, 25, 6, 553372), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:25:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:25:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:25:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:26:06 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:25:06,670 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:25:07,838 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:25:07,896 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:25:08,187 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:25:09,101 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
gunicorn-web stdout | 2024-04-22 04:25:09,977 [278] [DEBUG] [app] Starting request: urn:request:063724d9-d148-4cba-b7a4-9c253d95931c (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:25:09,977 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:09,977 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:09,978 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:09,989 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:25:09,989 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:25:09,989 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:09,989 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:25:09,989 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:09,989 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:09,989 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:09,989 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:09,991 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:25:09,998 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:09,999 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:10,004 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:25:10,008 [278] [DEBUG] [app] Ending request: urn:request:063724d9-d148-4cba-b7a4-9c253d95931c (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:063724d9-d148-4cba-b7a4-9c253d95931c', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:25:10,008 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:25:10,009 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:25:10 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:25:10 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.033 1536 0.033)
securityworker stdout | 2024-04-22 04:25:10,341 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:25:10,384 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
gunicorn-web stdout | 2024-04-22 04:25:10,596 [278] [DEBUG] [app] Starting request: urn:request:6e637071-8a27-436b-8e38-ff9ae6b20d74 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:25:10,596 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:10,597 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:10,597 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:10,606 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:25:10,607 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:25:10,607 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:10,607 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:25:10,607 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:10,607 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:10,607 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:10,607 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:10,609 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:25:10,616 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:10,617 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:10,621 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:25:10,625 [278] [DEBUG] [app] Ending request: urn:request:6e637071-8a27-436b-8e38-ff9ae6b20d74 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:6e637071-8a27-436b-8e38-ff9ae6b20d74', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:25:10,626 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:25:10,626 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:25:10 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:25:10 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.031 1536 0.031)
manifestbackfillworker stdout | 2024-04-22 04:25:10,770 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:25:10,823 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
autopruneworker stdout | 2024-04-22 04:25:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:25:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:25:41.264267+00:00 (in 29.999539 seconds)
autopruneworker stdout | 2024-04-22 04:25:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:25:41 UTC)" (scheduled at 2024-04-22 04:25:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:25:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759851271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:25:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:25:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:25:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:25:41 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:25:11,388 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:25:11,393 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:25:11,406 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:25:11,412 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:25:11,418 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:25:11,420 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:25:11,423 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:25:11,426 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:25:11,429 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
storagereplication stdout | 2024-04-22 04:25:12,235 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:25:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:25:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:06.552482+00:00 (in 52.996352 seconds)
repositorygcworker stdout | 2024-04-22 04:25:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:26:13 UTC)" (scheduled at 2024-04-22 04:25:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:25:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:25:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:26:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:25:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:25:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:25:19.762424+00:00 (in 6.002600 seconds)
notificationworker stdout | 2024-04-22 04:25:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:25:23 UTC)" (scheduled at 2024-04-22 04:25:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:25:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:25:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 25, 13, 760077), True, datetime.datetime(2024, 4, 22, 4, 25, 13, 760077), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:25:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:25:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:25:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:25:23 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:25:14,332 [279] [DEBUG] [app] Starting request: urn:request:46777952-6fb2-46e4-b2d8-4ce566ae383d (/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:25:14,333 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:14,335 [279] [DEBUG] [app] Ending request: urn:request:46777952-6fb2-46e4-b2d8-4ce566ae383d (/repository/build_test/pushno) {'endpoint': 'web.repository', 'request_id': 'urn:request:46777952-6fb2-46e4-b2d8-4ce566ae383d', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings', 'path': '/repository/build_test/pushno', 'parameters': {'tab': 'settings'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:25:14,336 [279] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:25:14 +0000] "GET /repository/build_test/pushno?tab=settings HTTP/1.0" 200 93195 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:25:14 +0000] "GET /repository/build_test/pushno?tab=settings HTTP/1.1" 200 14252 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.005 1371 0.005)
gcworker stdout | 2024-04-22 04:25:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:25:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:25:44.952062+00:00 (in 29.999458 seconds)
gcworker stdout | 2024-04-22 04:25:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:25:44 UTC)" (scheduled at 2024-04-22 04:25:14.952062+00:00)
gcworker stdout | 2024-04-22 04:25:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712550314953, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:25:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:25:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:25:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:25:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:25:15,121 [278] [DEBUG] [app] Starting request: urn:request:23c18d1c-1fd8-4a7f-9bb0-765c4d374178 (/api/v1/user/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:25:15,121 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:15,121 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:15,122 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:15,131 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:25:15,131 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:25:15,131 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:15,131 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:15,132 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:15,132 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:15,132 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:15,132 [278] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" INNER JOIN "team" AS "t2" ON ("t2"."organization_id" = "t1"."id") INNER JOIN "teammember" AS "t3" ON ("t3"."team_id" = "t2"."id") INNER JOIN "user" AS "t4" ON ("t4"."id" = "t3"."user_id") WHERE (("t1"."organization" = %s) AND ("t4"."username" = %s))', [True, 'whuquay'])
gunicorn-web stdout | 2024-04-22 04:25:15,136 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:15,136 [278] [DEBUG] [peewee] ('SELECT "t1"."service_ident", "t2"."name", "t1"."metadata_json" FROM "federatedlogin" AS "t1" INNER JOIN "loginservice" AS "t2" ON ("t1"."service_id" = "t2"."id") WHERE (("t2"."name" != %s) AND ("t1"."user_id" = %s))', ['quayrobot', 1])
gunicorn-web stdout | 2024-04-22 04:25:15,139 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."kind_id" FROM "userprompt" AS "t1" INNER JOIN "userpromptkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE ("t1"."user_id" = %s)', [1])
gunicorn-web stdout | 2024-04-22 04:25:15,141 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['whuquay', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:15,143 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['whuquay'])
gunicorn-web stdout | 2024-04-22 04:25:15,146 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['whuquay', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:15,148 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."limit_bytes" FROM "userorganizationquota" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_id" = "t2"."id") WHERE ("t2"."username" = %s)', ['whuquay'])
gunicorn-web stdout | 2024-04-22 04:25:15,150 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."size_bytes", "t1"."backfill_start_ms", "t1"."backfill_complete" FROM "quotanamespacesize" AS "t1" WHERE ("t1"."namespace_user_id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:15,152 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:15,152 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:15,154 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."organization_id", "t1"."role_id", "t1"."description", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name" FROM "team" AS "t1" INNER JOIN "teamrole" AS "t3" ON ("t1"."role_id" = "t3"."id") INNER JOIN "user" AS "t2" ON ("t1"."organization_id" = "t2"."id") INNER JOIN "teammember" AS "t4" ON ("t4"."team_id" = "t1"."id") INNER JOIN "user" AS "t5" ON ("t4"."user_id" = "t5"."id") WHERE (("t5"."id" = %s) AND ("t2"."organization" = %s))', [1, True])
gunicorn-web stdout | 2024-04-22 04:25:15,157 [278] [DEBUG] [auth.permissions] Organization team added permission: _NamespaceWideNeed(type='organization', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:15,157 [278] [DEBUG] [auth.permissions] Organization team added repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='build_test', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:15,157 [278] [DEBUG] [auth.permissions] Team added permission: _TeamTypeNeed(type='orgteam', orgname='build_test', teamname='owners', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:15,157 [278] [DEBUG] [auth.permissions] Adding superuser to user: whuquay
gunicorn-web stdout | 2024-04-22 04:25:15,157 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:15,157 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:15,157 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:15,158 [278] [DEBUG] [app] Ending request: urn:request:23c18d1c-1fd8-4a7f-9bb0-765c4d374178 (/api/v1/user/) {'endpoint': 'api.user', 'request_id': 'urn:request:23c18d1c-1fd8-4a7f-9bb0-765c4d374178', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/', 'path': '/api/v1/user/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:25:15,158 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:25:15,158 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:25:15 +0000] "GET /api/v1/user/ HTTP/1.0" 200 989 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:25:15 +0000] "GET /api/v1/user/ HTTP/1.1" 200 989 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.038 1498 0.038)
gunicorn-web stdout | 2024-04-22 04:25:15,653 [278] [DEBUG] [app] Starting request: urn:request:a89dea65-a7cc-4be0-bf9e-c29ba497147a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:25:15,653 [281] [DEBUG] [app] Starting request: urn:request:2d9c3159-e517-49d1-8df7-406967da6bf4 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:25:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:25:15,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:25:15,656 [284] [DEBUG] [app] Starting request: urn:request:b5f74995-131e-46d3-9d25-770f1d2c04c2 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:25:15,656 [291] [DEBUG] [app] Starting request: urn:request:0398aa8e-00cc-4a34-ad79-9f2fa8594118 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:25:15,656 [291] [DEBUG] [app] Ending request: urn:request:0398aa8e-00cc-4a34-ad79-9f2fa8594118 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:0398aa8e-00cc-4a34-ad79-9f2fa8594118', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:25:15,656 [284] [DEBUG] [app] Ending request: urn:request:b5f74995-131e-46d3-9d25-770f1d2c04c2 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b5f74995-131e-46d3-9d25-770f1d2c04c2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:25:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:25:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:25:15,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:25:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:25:15,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:25:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:25:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:25:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:25:15,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:25:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:25:15,659 [279] [DEBUG] [app] Starting request: urn:request:49a20704-d3d4-4559-85b0-82f08edb8a92 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:25:15,659 [282] [DEBUG] [app] Starting request: urn:request:40fb6651-73b1-4436-8b1c-1e147d216815 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:25:15,660 [279] [DEBUG] [app] Ending request: urn:request:49a20704-d3d4-4559-85b0-82f08edb8a92 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:49a20704-d3d4-4559-85b0-82f08edb8a92', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:25:15,660 [282] [DEBUG] [app] Ending request: urn:request:40fb6651-73b1-4436-8b1c-1e147d216815 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:40fb6651-73b1-4436-8b1c-1e147d216815', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:25:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:25:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:25:15,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:25:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:25:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:25:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:25:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:25:15,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:25:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:25:15,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:25:15,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:25:15,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:25:15,674 [281] [DEBUG] [app] Ending request: urn:request:2d9c3159-e517-49d1-8df7-406967da6bf4 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2d9c3159-e517-49d1-8df7-406967da6bf4', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:25:15,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:25:15,674 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:25:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:25:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:25:15,675 [278] [DEBUG] [app] Ending request: urn:request:a89dea65-a7cc-4be0-bf9e-c29ba497147a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a89dea65-a7cc-4be0-bf9e-c29ba497147a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:25:15,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:25:15,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:25:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:25:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:25:15,755 [278] [DEBUG] [app] Starting request: urn:request:34145bad-14d3-4575-b684-5f3db431695e (/api/v1/user/notifications) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:25:15,756 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:15,756 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:15,756 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:15,765 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:25:15,765 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:25:15,765 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:15,765 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:25:15,765 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:15,766 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:15,766 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:15,766 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:15,767 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."dismissed" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."dismissed" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', [False, 1, False, 1, 'admin', 6])
gunicorn-web stdout | 2024-04-22 04:25:15,773 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:15,775 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:15,777 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:15,779 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:15,781 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:15,783 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:15,786 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:15,788 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:15,790 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:15,792 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [10, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:15,794 [278] [DEBUG] [app] Ending request: urn:request:34145bad-14d3-4575-b684-5f3db431695e (/api/v1/user/notifications) {'endpoint': 'api.usernotificationlist', 'request_id': 'urn:request:34145bad-14d3-4575-b684-5f3db431695e', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/notifications', 'path': '/api/v1/user/notifications', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:25:15,795 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:25:15,795 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:25:15 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 3386 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:25:15 +0000] "GET /api/v1/user/notifications HTTP/1.1" 200 3386 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.040 1511 0.040)
gunicorn-web stdout | 2024-04-22 04:25:15,853 [278] [DEBUG] [app] Starting request: urn:request:df4262dd-ae44-438c-b5ff-8a29426d4fd2 (/api/v1/messages) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:25:15,853 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:15,853 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:15,854 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:15,864 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:25:15,864 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:25:15,864 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:15,864 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."content", "t1"."uuid", "t1"."severity", "t1"."media_type_id", "t2"."id", "t2"."name" FROM "messages" AS "t1" INNER JOIN "mediatype" AS "t2" ON ("t1"."media_type_id" = "t2"."id")', [])
gunicorn-web stdout | 2024-04-22 04:25:15,867 [278] [DEBUG] [app] Ending request: urn:request:df4262dd-ae44-438c-b5ff-8a29426d4fd2 (/api/v1/messages) {'endpoint': 'api.globalusermessages', 'request_id': 'urn:request:df4262dd-ae44-438c-b5ff-8a29426d4fd2', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/messages', 'path': '/api/v1/messages', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:25:15,867 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:25:15,868 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:25:15 +0000] "GET /api/v1/messages HTTP/1.0" 200 17 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:25:15 +0000] "GET /api/v1/messages HTTP/1.1" 200 17 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.015 1501 0.015)
gunicorn-web stdout | 2024-04-22 04:25:15,869 [278] [DEBUG] [app] Starting request: urn:request:c6e7dd68-a3b8-4c4c-a6b5-8beb6c68afdb (/api/v1/repository/build_test/pushno/tag/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:25:15,869 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:15,869 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:15,870 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:15,879 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:25:15,879 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:25:15,879 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:15,879 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:25:15,879 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:15,879 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:15,879 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:15,879 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:15,882 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:25:15,882 [282] [DEBUG] [app] Starting request: urn:request:00171c8a-84cc-4e89-b01d-16603170bca1 (/api/v1/repository/build_test/pushno) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:25:15,882 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:15,882 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:15,883 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:15,888 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:15,889 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:15,891 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:25:15,891 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:25:15,891 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:15,892 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:25:15,892 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:15,892 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:15,892 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:15,892 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:15,893 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:15,894 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:25:15,895 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [2, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:15,897 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:15,900 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:15,900 [282] [DEBUG] [endpoints.api.repository] Get repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:25:15,900 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."repository_id", "t1"."manifest_id", "t1"."lifetime_start_ms", "t1"."lifetime_end_ms", "t1"."hidden", "t1"."reversion", "t1"."tag_kind_id", "t1"."linked_tag_id", "t2"."id", "t2"."digest", "t2"."media_type_id", "t2"."layers_compressed_size", "t2"."config_media_type" FROM "tag" AS "t1" INNER JOIN "manifest" AS "t2" ON ("t1"."manifest_id" = "t2"."id") WHERE ((("t1"."repository_id" = %s) AND (("t1"."lifetime_end_ms" IS %s) OR ("t1"."lifetime_end_ms" > %s))) AND ("t1"."hidden" = %s)) ORDER BY "t1"."lifetime_start_ms" DESC, "t1"."name" LIMIT %s OFFSET %s', [1, None, 1713759915900, False, 101, 0])
gunicorn-web stdout | 2024-04-22 04:25:15,901 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:15,903 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:15,903 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "mediatype" AS "t1"', [])
gunicorn-web stdout | 2024-04-22 04:25:15,905 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2024, 1, 21)])
gunicorn-web stdout | 2024-04-22 04:25:15,906 [278] [DEBUG] [app] Ending request: urn:request:c6e7dd68-a3b8-4c4c-a6b5-8beb6c68afdb (/api/v1/repository/build_test/pushno/tag/) {'endpoint': 'api.listrepositorytags', 'request_id': 'urn:request:c6e7dd68-a3b8-4c4c-a6b5-8beb6c68afdb', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true', 'path': '/api/v1/repository/build_test/pushno/tag/', 'parameters': {'limit': '100', 'page': '1', 'onlyActiveTags': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:25:15,906 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:25:15,907 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:25:15 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 300 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:25:15 +0000] "GET /api/v1/repository/build_test/pushno/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.1" 200 300 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.038 1563 0.038)
gunicorn-web stdout | 2024-04-22 04:25:15,907 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:15,907 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:15,908 [282] [DEBUG] [app] Ending request: urn:request:00171c8a-84cc-4e89-b01d-16603170bca1 (/api/v1/repository/build_test/pushno) {'endpoint': 'api.repository', 'request_id': 'urn:request:00171c8a-84cc-4e89-b01d-16603170bca1', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno?includeStats=true&includeTags=false', 'path': '/api/v1/repository/build_test/pushno', 'parameters': {'includeStats': 'true', 'includeTags': 'false'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:25:15,909 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:25:15,909 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:25:15 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.0" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:25:15 +0000] "GET /api/v1/repository/build_test/pushno?includeStats=true&includeTags=false HTTP/1.1" 200 3626 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.028 1557 0.028)
quotatotalworker stdout | 2024-04-22 04:25:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:25:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:25:31.054492+00:00 (in 14.999444 seconds)
quotatotalworker stdout | 2024-04-22 04:25:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:25:31 UTC)" (scheduled at 2024-04-22 04:25:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:25:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:25:16,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:25:16,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:25:31 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:25:16,343 [278] [DEBUG] [app] Starting request: urn:request:6397e058-30e5-4af0-ad98-d4b443f1bfdc (/api/v1/repository/build_test/pushno/permissions/team/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:25:16,343 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:16,343 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:16,344 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:16,348 [281] [DEBUG] [app] Starting request: urn:request:ac4e02ef-1e98-4eee-bd56-b667bb4789e4 (/api/v1/repository/build_test/pushno/permissions/user/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:25:16,348 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:16,348 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:16,349 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:16,350 [279] [DEBUG] [app] Starting request: urn:request:4413b4ec-3ede-4fd1-b205-a07f39fe664f (/api/v1/user/apptoken) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:25:16,350 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:16,350 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:16,351 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:16,353 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:25:16,353 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:25:16,353 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:16,353 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:25:16,353 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:16,353 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:16,353 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:16,353 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:16,355 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:25:16,359 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:25:16,360 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:25:16,360 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:16,360 [279] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:25:16,360 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:16,360 [279] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:16,360 [279] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:16,360 [279] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:16,361 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."uuid", "t1"."title", "t1"."token_name", "t1"."token_secret", "t1"."created", "t1"."expiration", "t1"."last_accessed" FROM "appspecificauthtoken" AS "t1" WHERE ((("t1"."user_id" = %s) AND ("t1"."expiration" <= %s)) AND ("t1"."expiration" > %s))', [1, datetime.datetime(2024, 4, 24, 23, 37, 16, 360635), datetime.datetime(2024, 4, 22, 4, 25, 16, 360675)])
gunicorn-web stdout | 2024-04-22 04:25:16,362 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:16,363 [278] [DEBUG] [peewee] ('SELECT "t1"."name", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "team" AS "t1" ON ("t3"."team_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:25:16,363 [279] [DEBUG] [app] Ending request: urn:request:4413b4ec-3ede-4fd1-b205-a07f39fe664f (/api/v1/user/apptoken) {'endpoint': 'api.apptokens', 'request_id': 'urn:request:4413b4ec-3ede-4fd1-b205-a07f39fe664f', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/apptoken?expiring=true', 'path': '/api/v1/user/apptoken', 'parameters': {'expiring': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:25:16,363 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:25:16,364 [279] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:25:16 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:25:16 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.1" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.015 1520 0.015)
gunicorn-web stdout | 2024-04-22 04:25:16,365 [278] [DEBUG] [app] Ending request: urn:request:6397e058-30e5-4af0-ad98-d4b443f1bfdc (/api/v1/repository/build_test/pushno/permissions/team/) {'endpoint': 'api.repositoryteampermissionlist', 'request_id': 'urn:request:6397e058-30e5-4af0-ad98-d4b443f1bfdc', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/team/', 'path': '/api/v1/repository/build_test/pushno/permissions/team/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:25:16,366 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:25:16,366 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:25:16 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.0" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:25:16 +0000] "GET /api/v1/repository/build_test/pushno/permissions/team/ HTTP/1.1" 200 20 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.024 1539 0.024)
gunicorn-web stdout | 2024-04-22 04:25:16,367 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:25:16,367 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:25:16,367 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:16,368 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:25:16,368 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:16,368 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:16,368 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:16,368 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:16,370 [278] [DEBUG] [app] Starting request: urn:request:29e2bd95-72a5-4e62-a279-b763b7cfed39 (/api/v1/repository/build_test/pushno/notification/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:25:16,370 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:16,370 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:16,370 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:25:16,370 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:16,377 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:16,377 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."organization" = %s) AND ("t1"."username" = %s)) LIMIT %s OFFSET %s', [True, 'build_test', 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:16,379 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:25:16,379 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:25:16,379 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:16,379 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.AdministerRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:25:16,379 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:16,379 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:16,379 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:16,379 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:16,380 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed", "t2"."id", "t2"."name", "t3"."id", "t3"."team_id", "t3"."user_id", "t3"."repository_id", "t3"."role_id" FROM "repositorypermission" AS "t3" INNER JOIN "user" AS "t1" ON ("t3"."user_id" = "t1"."id") INNER JOIN "role" AS "t2" ON ("t3"."role_id" = "t2"."id") INNER JOIN "repository" AS "t4" ON ("t3"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") WHERE (("t5"."username" = %s) AND ("t4"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:25:16,381 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:25:16,383 [281] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."username" FROM "user" AS "t1" INNER JOIN "teammember" AS "t2" ON ("t2"."user_id" = "t1"."id") INNER JOIN "team" AS "t3" ON ("t2"."team_id" = "t3"."id") WHERE ((("t3"."organization_id" = %s) AND ("t1"."robot" = %s)) AND ("t1"."id" IN (%s)))', [2, False, 1])
gunicorn-web stdout | 2024-04-22 04:25:16,386 [281] [DEBUG] [app] Ending request: urn:request:ac4e02ef-1e98-4eee-bd56-b667bb4789e4 (/api/v1/repository/build_test/pushno/permissions/user/) {'endpoint': 'api.repositoryuserpermissionlist', 'request_id': 'urn:request:ac4e02ef-1e98-4eee-bd56-b667bb4789e4', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/permissions/user/', 'path': '/api/v1/repository/build_test/pushno/permissions/user/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:25:16,386 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:25:16 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.1" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.040 1539 0.040)
gunicorn-web stdout | 2024-04-22 04:25:16,387 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:25:16 +0000] "GET /api/v1/repository/build_test/pushno/permissions/user/ HTTP/1.0" 200 252 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-web stdout | 2024-04-22 04:25:16,388 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:16,389 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:16,392 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE (("t3"."username" = %s) AND ("t2"."name" = %s))', ['build_test', 'pushno'])
gunicorn-web stdout | 2024-04-22 04:25:16,395 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:16,397 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [4, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:16,399 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:16,401 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:16,403 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:16,405 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:16,407 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:16,409 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:16,411 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:16,413 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [4, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:16,415 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:16,417 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:16,418 [281] [DEBUG] [app] Starting request: urn:request:5aecb011-a29b-450a-a35c-8cf2cfde96a7 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:25:16,418 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:16,418 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:16,419 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:16,419 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:16,421 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:16,423 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationevent" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [6, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:16,425 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "externalnotificationmethod" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [5, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:16,427 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:25:16,427 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:25:16,427 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:16,428 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:25:16,428 [278] [DEBUG] [app] Ending request: urn:request:29e2bd95-72a5-4e62-a279-b763b7cfed39 (/api/v1/repository/build_test/pushno/notification/) {'endpoint': 'api.repositorynotificationlist', 'request_id': 'urn:request:29e2bd95-72a5-4e62-a279-b763b7cfed39', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/notification/', 'path': '/api/v1/repository/build_test/pushno/notification/', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:25:16,428 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:16,428 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:16,428 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:16,428 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:16,428 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:25:16,428 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:25:16 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.0" 200 2340 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:25:16 +0000] "GET /api/v1/repository/build_test/pushno/notification/ HTTP/1.1" 200 2340 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.059 1535 0.059)
gunicorn-web stdout | 2024-04-22 04:25:16,430 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:25:16,436 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:16,437 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:16,442 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:25:16,446 [281] [DEBUG] [app] Ending request: urn:request:5aecb011-a29b-450a-a35c-8cf2cfde96a7 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:5aecb011-a29b-450a-a35c-8cf2cfde96a7', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:25:16,446 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:25:16,447 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:25:16 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:25:16 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1536 0.030)
securityscanningnotificationworker stdout | 2024-04-22 04:25:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:25:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:02.556208+00:00 (in 46.003265 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:25:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:26:16 UTC)" (scheduled at 2024-04-22 04:25:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:25:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:25:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 25, 16, 553329), True, datetime.datetime(2024, 4, 22, 4, 25, 16, 553329), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:25:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:25:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:25:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:26:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:25:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:25:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:25:47.052354+00:00 (in 29.999444 seconds)
buildlogsarchiver stdout | 2024-04-22 04:25:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:25:47 UTC)" (scheduled at 2024-04-22 04:25:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:25:17,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 25, 17, 53294), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:25:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:25:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:25:17,065 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:25:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:25:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:25:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:25:23.759375+00:00 (in 3.996440 seconds)
notificationworker stdout | 2024-04-22 04:25:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:26:19 UTC)" (scheduled at 2024-04-22 04:25:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:25:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:25:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:26:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:25:21,323 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
namespacegcworker stdout | 2024-04-22 04:25:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:25:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:25:43.057186+00:00 (in 20.997687 seconds)
namespacegcworker stdout | 2024-04-22 04:25:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:26:22 UTC)" (scheduled at 2024-04-22 04:25:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:25:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:25:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:26:22 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:25:22,538 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:25:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:25:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:25:33.759375+00:00 (in 9.999470 seconds)
notificationworker stdout | 2024-04-22 04:25:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:25:33 UTC)" (scheduled at 2024-04-22 04:25:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:25:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:25:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 25, 23, 760342), True, datetime.datetime(2024, 4, 22, 4, 25, 23, 760342), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:25:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:25:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:25:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:25:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:25:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:25:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:24.361582+00:00 (in 59.999563 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:25:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:26:24 UTC)" (scheduled at 2024-04-22 04:25:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:25:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:25:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:25:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:26:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:25:26,193 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:25:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:25:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:25:35.871852+00:00 (in 8.998278 seconds)
securityworker stdout | 2024-04-22 04:25:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:25:56 UTC)" (scheduled at 2024-04-22 04:25:26.873109+00:00)
securityworker stdout | 2024-04-22 04:25:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:25:26,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:25:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:25:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:25:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:25:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:25:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:25:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:25:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:25:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:25:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:25:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:25:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 20, 26, 880797), 1, 2])
securityworker stdout | 2024-04-22 04:25:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:25:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:25:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 20, 26, 880797), 1, 2])
securityworker stdout | 2024-04-22 04:25:26,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:25:26,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:25:26,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:25:26,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:25:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:25:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:25:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:25:26,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:25:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:25:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:25:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:25:27,964 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:25:29,301 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:25:29,327 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:25:30,447 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:25:30,488 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:25:30,521 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:25:30,574 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:25:30,577 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:25:30,653 [278] [DEBUG] [app] Starting request: urn:request:88c52209-b547-4dc1-8c74-b633505f57a2 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:25:30,653 [281] [DEBUG] [app] Starting request: urn:request:cbe2aad5-0e1f-4a97-aaf8-7b3ec10c3f46 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:25:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:25:30,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:25:30,656 [290] [DEBUG] [app] Starting request: urn:request:cf30d350-2da7-4f31-9455-d636aa935e32 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:25:30,656 [284] [DEBUG] [app] Starting request: urn:request:4dce8321-da0c-471a-8ca5-7cdeed9be530 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:25:30,656 [290] [DEBUG] [app] Ending request: urn:request:cf30d350-2da7-4f31-9455-d636aa935e32 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:cf30d350-2da7-4f31-9455-d636aa935e32', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:25:30,656 [284] [DEBUG] [app] Ending request: urn:request:4dce8321-da0c-471a-8ca5-7cdeed9be530 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:4dce8321-da0c-471a-8ca5-7cdeed9be530', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:25:30,656 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:25:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:25:30,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:25:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:25:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:25:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:25:30,656 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:25:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:25:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:25:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:25:30,659 [282] [DEBUG] [app] Starting request: urn:request:c7c2817f-d949-43c1-8234-6b013fec2518 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:25:30,659 [282] [DEBUG] [app] Ending request: urn:request:c7c2817f-d949-43c1-8234-6b013fec2518 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:c7c2817f-d949-43c1-8234-6b013fec2518', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:25:30,659 [278] [DEBUG] [app] Starting request: urn:request:a5998771-3069-40ab-a8da-b6169c067608 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:25:30,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:25:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:25:30,660 [278] [DEBUG] [app] Ending request: urn:request:a5998771-3069-40ab-a8da-b6169c067608 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a5998771-3069-40ab-a8da-b6169c067608', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:25:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:25:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:25:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:25:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:25:30,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:25:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:25:30,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:25:30,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:25:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:25:30,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:25:30,674 [278] [DEBUG] [app] Ending request: urn:request:88c52209-b547-4dc1-8c74-b633505f57a2 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:88c52209-b547-4dc1-8c74-b633505f57a2', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:25:30,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:25:30,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:25:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:25:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:25:30,675 [281] [DEBUG] [app] Ending request: urn:request:cbe2aad5-0e1f-4a97-aaf8-7b3ec10c3f46 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:cbe2aad5-0e1f-4a97-aaf8-7b3ec10c3f46', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:25:30,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:25:30,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:25:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:25:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotatotalworker stdout | 2024-04-22 04:25:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:25:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:25:46.054492+00:00 (in 14.999473 seconds)
quotatotalworker stdout | 2024-04-22 04:25:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:25:46 UTC)" (scheduled at 2024-04-22 04:25:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:25:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:25:31,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:25:31,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:25:46 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:25:31,213 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:25:31,376 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotaregistrysizeworker stdout | 2024-04-22 04:25:32,186 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:25:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:25:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:25:43.759375+00:00 (in 9.999451 seconds)
notificationworker stdout | 2024-04-22 04:25:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:25:43 UTC)" (scheduled at 2024-04-22 04:25:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:25:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:25:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 25, 33, 760238), True, datetime.datetime(2024, 4, 22, 4, 25, 33, 760238), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:25:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:25:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:25:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:25:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:25:33,904 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:25:35,023 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:25:35,027 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:25:35,030 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
buildlogsarchiver stdout | 2024-04-22 04:25:35,254 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:25:35,330 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:25:35,653 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:25:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:25:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:25:56.873109+00:00 (in 21.000746 seconds)
securityworker stdout | 2024-04-22 04:25:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:26:05 UTC)" (scheduled at 2024-04-22 04:25:35.871852+00:00)
securityworker stdout | 2024-04-22 04:25:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:25:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:25:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:25:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:25:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:25:35,888 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:25:35,890 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:25:35,890 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:25:35,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 20, 35, 876193), 1, 2])
securityworker stdout | 2024-04-22 04:25:35,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:25:35,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:25:35,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 20, 35, 876193), 1, 2])
securityworker stdout | 2024-04-22 04:25:35,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:25:35,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:25:35,895 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:25:35,896 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:26:05 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:25:36,708 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:25:37,875 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:25:37,933 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:25:38,222 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:25:39,124 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
exportactionlogsworker stdout | 2024-04-22 04:25:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:25:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:25:41.564959+00:00 (in 1.997465 seconds)
exportactionlogsworker stdout | 2024-04-22 04:25:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:26:39 UTC)" (scheduled at 2024-04-22 04:25:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:25:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:25:39,568 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:26:39 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:25:40,378 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:25:40,408 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 04:25:40,786 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:25:40,860 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
autopruneworker stdout | 2024-04-22 04:25:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:25:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:11.264267+00:00 (in 29.999461 seconds)
autopruneworker stdout | 2024-04-22 04:25:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:26:11 UTC)" (scheduled at 2024-04-22 04:25:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:25:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759881272, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:25:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:25:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:25:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:26:11 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:25:41,397 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:25:41,401 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:25:41,417 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:25:41,422 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:25:41,426 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:25:41,429 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:25:41,432 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:25:41,435 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:25:41,438 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
exportactionlogsworker stdout | 2024-04-22 04:25:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:25:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:39.566970+00:00 (in 58.001479 seconds)
exportactionlogsworker stdout | 2024-04-22 04:25:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:26:41 UTC)" (scheduled at 2024-04-22 04:25:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:25:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:25:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 25, 41, 565924), True, datetime.datetime(2024, 4, 22, 4, 25, 41, 565924), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:25:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:25:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:25:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:26:41 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:25:42,250 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
namespacegcworker stdout | 2024-04-22 04:25:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:25:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:22.058978+00:00 (in 39.001267 seconds)
namespacegcworker stdout | 2024-04-22 04:25:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:26:43 UTC)" (scheduled at 2024-04-22 04:25:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:25:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:25:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 25, 43, 58124), True, datetime.datetime(2024, 4, 22, 4, 25, 43, 58124), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:25:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:25:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:25:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:26:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:25:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:25:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:25:53.759375+00:00 (in 9.999428 seconds)
notificationworker stdout | 2024-04-22 04:25:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:25:53 UTC)" (scheduled at 2024-04-22 04:25:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:25:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:25:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 25, 43, 760370), True, datetime.datetime(2024, 4, 22, 4, 25, 43, 760370), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:25:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:25:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:25:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:25:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:25:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:25:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:14.952062+00:00 (in 29.999560 seconds)
gcworker stdout | 2024-04-22 04:25:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:26:14 UTC)" (scheduled at 2024-04-22 04:25:44.952062+00:00)
gcworker stdout | 2024-04-22 04:25:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712550344952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:25:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:25:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:25:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:26:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:25:45,653 [278] [DEBUG] [app] Starting request: urn:request:c6970f2d-2a9c-406e-8343-cc45eaacd05f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:25:45,653 [281] [DEBUG] [app] Starting request: urn:request:52d71cfe-7b11-40a9-81d1-d35c96820e15 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:25:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:25:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:25:45,656 [290] [DEBUG] [app] Starting request: urn:request:b188465a-b910-4789-9743-444acc7dba5e (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:25:45,656 [284] [DEBUG] [app] Starting request: urn:request:a16f0d69-52f8-419f-8c0e-689821f29d1b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:25:45,657 [290] [DEBUG] [app] Ending request: urn:request:b188465a-b910-4789-9743-444acc7dba5e (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b188465a-b910-4789-9743-444acc7dba5e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:25:45,657 [284] [DEBUG] [app] Ending request: urn:request:a16f0d69-52f8-419f-8c0e-689821f29d1b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:a16f0d69-52f8-419f-8c0e-689821f29d1b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:25:45,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:25:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:25:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:25:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:25:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:25:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:25:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:25:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:25:45,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:25:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:25:45,659 [281] [DEBUG] [app] Starting request: urn:request:b18766c3-f529-433d-a5a3-5a414d5227a4 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:25:45,660 [282] [DEBUG] [app] Starting request: urn:request:c7ba6df4-e448-4c79-b756-67616ece62da (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:25:45,660 [281] [DEBUG] [app] Ending request: urn:request:b18766c3-f529-433d-a5a3-5a414d5227a4 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b18766c3-f529-433d-a5a3-5a414d5227a4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:25:45,660 [282] [DEBUG] [app] Ending request: urn:request:c7ba6df4-e448-4c79-b756-67616ece62da (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:c7ba6df4-e448-4c79-b756-67616ece62da', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:25:45,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:25:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:25:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:25:45,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:25:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:25:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:25:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:25:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:25:45,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:25:45,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:25:45,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:25:45,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:25:45,674 [281] [DEBUG] [app] Ending request: urn:request:52d71cfe-7b11-40a9-81d1-d35c96820e15 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:52d71cfe-7b11-40a9-81d1-d35c96820e15', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:25:45,674 [278] [DEBUG] [app] Ending request: urn:request:c6970f2d-2a9c-406e-8343-cc45eaacd05f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:c6970f2d-2a9c-406e-8343-cc45eaacd05f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:25:45,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:25:45,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:25:45,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:25:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:25:45,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:25:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:25:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:25:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotatotalworker stdout | 2024-04-22 04:25:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:25:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:01.054492+00:00 (in 14.999474 seconds)
quotatotalworker stdout | 2024-04-22 04:25:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:26:01 UTC)" (scheduled at 2024-04-22 04:25:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:25:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:25:46,070 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:25:46,070 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:26:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:25:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:25:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:17.052354+00:00 (in 29.999504 seconds)
buildlogsarchiver stdout | 2024-04-22 04:25:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:26:17 UTC)" (scheduled at 2024-04-22 04:25:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:25:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 25, 47, 53220), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:25:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:25:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:25:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:26:17 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:25:47,527 [282] [DEBUG] [app] Starting request: urn:request:290ceeb0-e281-4d9a-b9a3-ebd201abe9ac (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:25:47,528 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:47,528 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:47,528 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:47,538 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:25:47,538 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:25:47,538 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:47,538 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:25:47,538 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:25:47,538 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:47,539 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:47,539 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:47,541 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:25:47,548 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:25:47,549 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:25:47,553 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:25:47,558 [282] [DEBUG] [app] Ending request: urn:request:290ceeb0-e281-4d9a-b9a3-ebd201abe9ac (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:290ceeb0-e281-4d9a-b9a3-ebd201abe9ac', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:25:47,558 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:25:47,558 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:25:47 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:25:47 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.032 1536 0.032)
expiredappspecifictokenworker stdout | 2024-04-22 04:25:51,359 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:25:52,549 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:25:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:25:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:03.759375+00:00 (in 9.999420 seconds)
notificationworker stdout | 2024-04-22 04:25:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:26:03 UTC)" (scheduled at 2024-04-22 04:25:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:25:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:25:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 25, 53, 760290), True, datetime.datetime(2024, 4, 22, 4, 25, 53, 760290), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:25:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:25:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:25:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:26:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:25:56,207 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:25:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:25:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:05.871852+00:00 (in 8.998188 seconds)
securityworker stdout | 2024-04-22 04:25:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:26:26 UTC)" (scheduled at 2024-04-22 04:25:56.873109+00:00)
securityworker stdout | 2024-04-22 04:25:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:25:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:25:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:25:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:25:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:25:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:25:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:25:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:25:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:25:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:25:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:25:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:25:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 20, 56, 881095), 1, 2])
securityworker stdout | 2024-04-22 04:25:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:25:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:25:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 20, 56, 881095), 1, 2])
securityworker stdout | 2024-04-22 04:25:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:25:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:25:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:25:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:25:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:25:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:25:56,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:25:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:25:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:25:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:26:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:25:57,971 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:25:59,316 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:25:59,344 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:26:00,456 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:26:00,497 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:26:00,531 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:26:00,586 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:26:00,588 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:26:00,653 [278] [DEBUG] [app] Starting request: urn:request:e93a2bc5-5935-4808-830f-e400c5bd951b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:26:00,653 [281] [DEBUG] [app] Starting request: urn:request:556fdaaf-2d7e-4e2b-af85-b83e38332335 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:26:00,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:26:00,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:26:00,656 [285] [DEBUG] [app] Starting request: urn:request:eb2f6c70-fbbb-45cf-bede-bafa1a42c71d (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:26:00,656 [284] [DEBUG] [app] Starting request: urn:request:3fab8437-f7b2-4748-a177-ef4b7893e6ac (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:26:00,657 [285] [DEBUG] [app] Ending request: urn:request:eb2f6c70-fbbb-45cf-bede-bafa1a42c71d (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:eb2f6c70-fbbb-45cf-bede-bafa1a42c71d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:26:00,657 [284] [DEBUG] [app] Ending request: urn:request:3fab8437-f7b2-4748-a177-ef4b7893e6ac (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:3fab8437-f7b2-4748-a177-ef4b7893e6ac', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:26:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:26:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:26:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:26:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:26:00,657 [285] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:26:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:26:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:26:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:26:00,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:26:00,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:26:00,660 [282] [DEBUG] [app] Starting request: urn:request:5dc8e6e9-d0dc-4ec9-a721-1ac6eaece755 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:26:00,660 [278] [DEBUG] [app] Starting request: urn:request:17b3528e-bd63-4974-b6e5-019b4726a90e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:26:00,660 [282] [DEBUG] [app] Ending request: urn:request:5dc8e6e9-d0dc-4ec9-a721-1ac6eaece755 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:5dc8e6e9-d0dc-4ec9-a721-1ac6eaece755', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:26:00,660 [278] [DEBUG] [app] Ending request: urn:request:17b3528e-bd63-4974-b6e5-019b4726a90e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:17b3528e-bd63-4974-b6e5-019b4726a90e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:26:00,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:26:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:26:00,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:26:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:26:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:26:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:26:00,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:26:00,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:26:00,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:26:00,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:26:00,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:26:00,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:26:00,675 [281] [DEBUG] [app] Ending request: urn:request:556fdaaf-2d7e-4e2b-af85-b83e38332335 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:556fdaaf-2d7e-4e2b-af85-b83e38332335', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:26:00,675 [278] [DEBUG] [app] Ending request: urn:request:e93a2bc5-5935-4808-830f-e400c5bd951b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e93a2bc5-5935-4808-830f-e400c5bd951b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:26:00,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:26:00,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:26:00,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:26:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:26:00,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:26:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:26:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:26:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotatotalworker stdout | 2024-04-22 04:26:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:26:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:16.054492+00:00 (in 14.999489 seconds)
quotatotalworker stdout | 2024-04-22 04:26:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:26:16 UTC)" (scheduled at 2024-04-22 04:26:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:26:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:26:01,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:26:01,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:26:16 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:26:01,234 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:26:01,404 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotaregistrysizeworker stdout | 2024-04-22 04:26:02,222 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:26:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:26:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:16.552337+00:00 (in 13.995612 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:26:02,557 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:27:02 UTC)" (scheduled at 2024-04-22 04:26:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:26:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:26:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:27:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:26:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:26:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:13.759375+00:00 (in 9.999478 seconds)
notificationworker stdout | 2024-04-22 04:26:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:26:13 UTC)" (scheduled at 2024-04-22 04:26:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:26:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:26:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 26, 3, 760298), True, datetime.datetime(2024, 4, 22, 4, 26, 3, 760298), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:26:03,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:26:03,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:26:03,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:26:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:26:03,932 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:26:05,032 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:26:05,035 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:26:05,037 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
buildlogsarchiver stdout | 2024-04-22 04:26:05,271 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:26:05,350 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:26:05,689 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:26:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:26:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:26.873109+00:00 (in 21.000726 seconds)
securityworker stdout | 2024-04-22 04:26:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:26:35 UTC)" (scheduled at 2024-04-22 04:26:05.871852+00:00)
securityworker stdout | 2024-04-22 04:26:05,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:26:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:26:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:26:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:26:05,885 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:26:05,885 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:26:35 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:26:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:26:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:13.555667+00:00 (in 7.002710 seconds)
repositorygcworker stdout | 2024-04-22 04:26:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:27:06 UTC)" (scheduled at 2024-04-22 04:26:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:26:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:26:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 26, 6, 553326), True, datetime.datetime(2024, 4, 22, 4, 26, 6, 553326), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:26:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:26:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:26:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:27:06 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:26:06,721 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:26:07,912 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:26:07,964 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:26:08,254 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:26:09,147 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:26:10,414 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:26:10,445 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 04:26:10,801 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:26:10,883 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
autopruneworker stdout | 2024-04-22 04:26:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:26:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:41.264267+00:00 (in 29.999515 seconds)
autopruneworker stdout | 2024-04-22 04:26:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:26:41 UTC)" (scheduled at 2024-04-22 04:26:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:26:11,271 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759911271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:26:11,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:26:11,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:26:11,275 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:26:41 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:26:11,406 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:26:11,409 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:26:11,428 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:26:11,431 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:26:11,436 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:26:11,438 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:26:11,443 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:26:11,446 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:26:11,449 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
storagereplication stdout | 2024-04-22 04:26:12,272 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:26:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:26:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:51.555445+00:00 (in 37.999246 seconds)
repositorygcworker stdout | 2024-04-22 04:26:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:27:13 UTC)" (scheduled at 2024-04-22 04:26:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:26:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:26:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:27:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:26:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:26:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:19.762424+00:00 (in 6.002602 seconds)
notificationworker stdout | 2024-04-22 04:26:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:26:23 UTC)" (scheduled at 2024-04-22 04:26:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:26:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:26:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 26, 13, 760119), True, datetime.datetime(2024, 4, 22, 4, 26, 13, 760119), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:26:13,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:26:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:26:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:26:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:26:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:26:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:44.952062+00:00 (in 29.999475 seconds)
gcworker stdout | 2024-04-22 04:26:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:26:44 UTC)" (scheduled at 2024-04-22 04:26:14.952062+00:00)
gcworker stdout | 2024-04-22 04:26:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712550374953, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:26:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:26:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:26:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:26:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:26:15,653 [278] [DEBUG] [app] Starting request: urn:request:2f7ebe0c-c121-454a-ace3-c52cef4835ac (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:26:15,653 [281] [DEBUG] [app] Starting request: urn:request:0353ac53-ed11-4fae-8d7e-51b1d2545f13 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:26:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:26:15,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:26:15,656 [292] [DEBUG] [app] Starting request: urn:request:9aa6e495-263d-4909-9fc0-b51c6a22f70b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:26:15,656 [291] [DEBUG] [app] Starting request: urn:request:918479ab-ec1f-4270-993e-4157d319145c (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:26:15,656 [292] [DEBUG] [app] Ending request: urn:request:9aa6e495-263d-4909-9fc0-b51c6a22f70b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:9aa6e495-263d-4909-9fc0-b51c6a22f70b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:26:15,656 [291] [DEBUG] [app] Ending request: urn:request:918479ab-ec1f-4270-993e-4157d319145c (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:918479ab-ec1f-4270-993e-4157d319145c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:26:15,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:26:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:26:15,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:26:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:26:15,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:26:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:26:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:26:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:26:15,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:26:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:26:15,659 [281] [DEBUG] [app] Starting request: urn:request:4caa3891-3c88-4e7d-a4ab-441bde867c6c (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:26:15,659 [282] [DEBUG] [app] Starting request: urn:request:84bc6068-5bdd-4608-8a3a-c3457302d5d8 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:26:15,659 [281] [DEBUG] [app] Ending request: urn:request:4caa3891-3c88-4e7d-a4ab-441bde867c6c (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:4caa3891-3c88-4e7d-a4ab-441bde867c6c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:26:15,660 [282] [DEBUG] [app] Ending request: urn:request:84bc6068-5bdd-4608-8a3a-c3457302d5d8 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:84bc6068-5bdd-4608-8a3a-c3457302d5d8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:26:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:26:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:26:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:26:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:26:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:26:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:26:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:26:15,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:26:15,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:26:15,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:26:15,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:26:15,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:26:15,674 [281] [DEBUG] [app] Ending request: urn:request:0353ac53-ed11-4fae-8d7e-51b1d2545f13 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:0353ac53-ed11-4fae-8d7e-51b1d2545f13', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:26:15,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:26:15,674 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:26:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:26:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:26:15,674 [278] [DEBUG] [app] Ending request: urn:request:2f7ebe0c-c121-454a-ace3-c52cef4835ac (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2f7ebe0c-c121-454a-ace3-c52cef4835ac', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:26:15,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:26:15,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:26:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:26:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotatotalworker stdout | 2024-04-22 04:26:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:26:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:31.054492+00:00 (in 14.999456 seconds)
quotatotalworker stdout | 2024-04-22 04:26:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:26:31 UTC)" (scheduled at 2024-04-22 04:26:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:26:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:26:16,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:26:16,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:26:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:26:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:26:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:27:02.556208+00:00 (in 46.003337 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:26:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:27:16 UTC)" (scheduled at 2024-04-22 04:26:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:26:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:26:16,553 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 26, 16, 553256), True, datetime.datetime(2024, 4, 22, 4, 26, 16, 553256), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:26:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:26:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:26:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:27:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:26:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:26:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:47.052354+00:00 (in 29.999522 seconds)
buildlogsarchiver stdout | 2024-04-22 04:26:17,052 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:26:47 UTC)" (scheduled at 2024-04-22 04:26:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:26:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 26, 17, 53152), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:26:17,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:26:17,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:26:17,063 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:26:47 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:26:17,930 [278] [DEBUG] [app] Starting request: urn:request:999d0ca9-0753-4cfc-a650-9db74156a399 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:26:17,930 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:26:17,931 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:26:17,931 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:26:17,941 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:26:17,941 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:26:17,941 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:26:17,941 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:26:17,941 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:26:17,941 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:26:17,941 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:26:17,942 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:26:17,944 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:26:17,950 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:26:17,951 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:26:17,955 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:26:17,959 [278] [DEBUG] [app] Ending request: urn:request:999d0ca9-0753-4cfc-a650-9db74156a399 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:999d0ca9-0753-4cfc-a650-9db74156a399', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:26:17,959 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:26:17,959 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:26:17 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:26:17 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1555 0.030)
notificationworker stdout | 2024-04-22 04:26:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:26:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:23.759375+00:00 (in 3.996415 seconds)
notificationworker stdout | 2024-04-22 04:26:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:27:19 UTC)" (scheduled at 2024-04-22 04:26:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:26:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:26:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:27:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:26:21,395 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
namespacegcworker stdout | 2024-04-22 04:26:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:26:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:43.057186+00:00 (in 20.997635 seconds)
namespacegcworker stdout | 2024-04-22 04:26:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:27:22 UTC)" (scheduled at 2024-04-22 04:26:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:26:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:26:22,060 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:27:22 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:26:22,583 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:26:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:26:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:33.759375+00:00 (in 9.999433 seconds)
notificationworker stdout | 2024-04-22 04:26:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:26:33 UTC)" (scheduled at 2024-04-22 04:26:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:26:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:26:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 26, 23, 760394), True, datetime.datetime(2024, 4, 22, 4, 26, 23, 760394), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:26:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:26:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:26:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:26:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:26:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:26:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:27:24.361582+00:00 (in 59.999518 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:26:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:27:24 UTC)" (scheduled at 2024-04-22 04:26:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:26:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:26:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:26:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:27:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:26:26,224 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:26:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:26:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:35.871852+00:00 (in 8.998199 seconds)
securityworker stdout | 2024-04-22 04:26:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:26:56 UTC)" (scheduled at 2024-04-22 04:26:26.873109+00:00)
securityworker stdout | 2024-04-22 04:26:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:26:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:26:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:26:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:26:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:26:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:26:26,878 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:26:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:26:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:26:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:26:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:26:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:26:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 21, 26, 881405), 1, 2])
securityworker stdout | 2024-04-22 04:26:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:26:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:26:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 21, 26, 881405), 1, 2])
securityworker stdout | 2024-04-22 04:26:26,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:26:26,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:26:26,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:26:26,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:26:26,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:26:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:26:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:26:26,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:26:26,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:26:26,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:26:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:26:28,003 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:26:29,353 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:26:29,375 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:26:30,464 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:26:30,506 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:26:30,542 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:26:30,599 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:26:30,602 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:26:30,652 [278] [DEBUG] [app] Starting request: urn:request:5b9cc813-4cd1-4dba-b0b0-08c89275b3d7 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:26:30,653 [282] [DEBUG] [app] Starting request: urn:request:c672743a-6620-4ec4-a306-817ba353b986 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:26:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:26:30,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:26:30,655 [284] [DEBUG] [app] Starting request: urn:request:04b473e2-4f51-44d1-b25a-402d1c40c1dd (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:26:30,656 [289] [DEBUG] [app] Starting request: urn:request:18b77120-df7f-4793-bb6d-79ea26f45e2a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:26:30,656 [284] [DEBUG] [app] Ending request: urn:request:04b473e2-4f51-44d1-b25a-402d1c40c1dd (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:04b473e2-4f51-44d1-b25a-402d1c40c1dd', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:26:30,656 [289] [DEBUG] [app] Ending request: urn:request:18b77120-df7f-4793-bb6d-79ea26f45e2a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:18b77120-df7f-4793-bb6d-79ea26f45e2a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:26:30,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:26:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:26:30,656 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:26:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:26:30,656 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:26:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:26:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:26:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:26:30,657 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:26:30,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:26:30,659 [278] [DEBUG] [app] Starting request: urn:request:c060d631-f63d-4238-846a-703049f521d1 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:26:30,659 [281] [DEBUG] [app] Starting request: urn:request:914bb167-41cb-4646-9046-de0ea62f11ff (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:26:30,659 [278] [DEBUG] [app] Ending request: urn:request:c060d631-f63d-4238-846a-703049f521d1 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:c060d631-f63d-4238-846a-703049f521d1', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:26:30,659 [281] [DEBUG] [app] Ending request: urn:request:914bb167-41cb-4646-9046-de0ea62f11ff (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:914bb167-41cb-4646-9046-de0ea62f11ff', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:26:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:26:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:26:30,659 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:26:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:26:30,659 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:26:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:26:30,659 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:26:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:26:30,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:26:30,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:26:30,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:26:30,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:26:30,674 [278] [DEBUG] [app] Ending request: urn:request:5b9cc813-4cd1-4dba-b0b0-08c89275b3d7 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:5b9cc813-4cd1-4dba-b0b0-08c89275b3d7', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:26:30,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:26:30,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:26:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:26:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:26:30,674 [282] [DEBUG] [app] Ending request: urn:request:c672743a-6620-4ec4-a306-817ba353b986 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:c672743a-6620-4ec4-a306-817ba353b986', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:26:30,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:26:30,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:26:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:26:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.023)
quotatotalworker stdout | 2024-04-22 04:26:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:26:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:46.054492+00:00 (in 14.999468 seconds)
quotatotalworker stdout | 2024-04-22 04:26:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:26:46 UTC)" (scheduled at 2024-04-22 04:26:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:26:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:26:31,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:26:31,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:26:46 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:26:31,247 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:26:31,436 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotaregistrysizeworker stdout | 2024-04-22 04:26:32,244 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:26:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:26:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:43.759375+00:00 (in 9.999450 seconds)
notificationworker stdout | 2024-04-22 04:26:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:26:43 UTC)" (scheduled at 2024-04-22 04:26:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:26:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:26:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 26, 33, 760429), True, datetime.datetime(2024, 4, 22, 4, 26, 33, 760429), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:26:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:26:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:26:33,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:26:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:26:33,968 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:26:35,040 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:26:35,043 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:26:35,046 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
buildlogsarchiver stdout | 2024-04-22 04:26:35,286 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:26:35,387 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:26:35,725 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:26:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:26:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:56.873109+00:00 (in 21.000773 seconds)
securityworker stdout | 2024-04-22 04:26:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:27:05 UTC)" (scheduled at 2024-04-22 04:26:35.871852+00:00)
securityworker stdout | 2024-04-22 04:26:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:26:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:26:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:26:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:26:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:26:35,888 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:26:35,890 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:26:35,890 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:26:35,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 21, 35, 876422), 1, 2])
securityworker stdout | 2024-04-22 04:26:35,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:26:35,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:26:35,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 21, 35, 876422), 1, 2])
securityworker stdout | 2024-04-22 04:26:35,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:26:35,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:26:35,896 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:26:35,896 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:27:05 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:26:36,757 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:26:37,927 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:26:38,001 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:26:38,263 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:26:39,183 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
exportactionlogsworker stdout | 2024-04-22 04:26:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:26:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:41.564959+00:00 (in 1.997488 seconds)
exportactionlogsworker stdout | 2024-04-22 04:26:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:27:39 UTC)" (scheduled at 2024-04-22 04:26:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:26:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:26:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:27:39 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:26:40,424 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:26:40,451 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 04:26:40,837 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:26:40,898 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
autopruneworker stdout | 2024-04-22 04:26:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:26:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:27:11.264267+00:00 (in 29.999523 seconds)
autopruneworker stdout | 2024-04-22 04:26:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:27:11 UTC)" (scheduled at 2024-04-22 04:26:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:26:41,271 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759941271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:26:41,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:26:41,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:26:41,275 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:27:11 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:26:41,415 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:26:41,418 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:26:41,438 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:26:41,441 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:26:41,444 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:26:41,448 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:26:41,454 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:26:41,457 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:26:41,460 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
exportactionlogsworker stdout | 2024-04-22 04:26:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:26:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:53.566665+00:00 (in 12.001203 seconds)
exportactionlogsworker stdout | 2024-04-22 04:26:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:27:41 UTC)" (scheduled at 2024-04-22 04:26:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:26:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:26:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 26, 41, 565878), True, datetime.datetime(2024, 4, 22, 4, 26, 41, 565878), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:26:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:26:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:26:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:27:41 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:26:42,308 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
namespacegcworker stdout | 2024-04-22 04:26:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:26:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:27:22.058978+00:00 (in 39.001322 seconds)
namespacegcworker stdout | 2024-04-22 04:26:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:27:43 UTC)" (scheduled at 2024-04-22 04:26:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:26:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:26:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 26, 43, 58082), True, datetime.datetime(2024, 4, 22, 4, 26, 43, 58082), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:26:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:26:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:26:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:27:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:26:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:26:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:26:53.759375+00:00 (in 9.999516 seconds)
notificationworker stdout | 2024-04-22 04:26:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:26:53 UTC)" (scheduled at 2024-04-22 04:26:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:26:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:26:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 26, 43, 760243), True, datetime.datetime(2024, 4, 22, 4, 26, 43, 760243), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:26:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:26:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:26:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:26:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:26:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:26:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:27:14.952062+00:00 (in 29.999477 seconds)
gcworker stdout | 2024-04-22 04:26:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:27:14 UTC)" (scheduled at 2024-04-22 04:26:44.952062+00:00)
gcworker stdout | 2024-04-22 04:26:44,953 [68] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."removed_tag_expiration_s" FROM "user" AS "t1" LIMIT %s', [100])
gcworker stdout | 2024-04-22 04:26:44,963 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712550404962, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:26:44,966 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:26:44,967 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:26:44,967 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:27:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:26:45,652 [278] [DEBUG] [app] Starting request: urn:request:ef95f985-05e8-4794-9bf6-abd82d41385d (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:26:45,652 [282] [DEBUG] [app] Starting request: urn:request:5803a692-34c6-42e4-8078-b20b509e306a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:26:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:26:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:26:45,655 [285] [DEBUG] [app] Starting request: urn:request:7bedfc04-6f22-49f2-baa8-b901b49039e8 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:26:45,655 [291] [DEBUG] [app] Starting request: urn:request:3ffc9196-ca87-4835-88b4-a7fd78768875 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:26:45,656 [285] [DEBUG] [app] Ending request: urn:request:7bedfc04-6f22-49f2-baa8-b901b49039e8 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7bedfc04-6f22-49f2-baa8-b901b49039e8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:26:45,656 [291] [DEBUG] [app] Ending request: urn:request:3ffc9196-ca87-4835-88b4-a7fd78768875 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:3ffc9196-ca87-4835-88b4-a7fd78768875', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:26:45,656 [285] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:26:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:26:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:26:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:26:45,656 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:26:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:26:45,656 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:26:45,656 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:26:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:26:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:26:45,659 [282] [DEBUG] [app] Starting request: urn:request:3cb0a4f7-848c-4f5e-a358-43597fc2e553 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:26:45,659 [278] [DEBUG] [app] Starting request: urn:request:1af74479-4a2f-4f97-9884-dd3c5b3b578f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:26:45,659 [282] [DEBUG] [app] Ending request: urn:request:3cb0a4f7-848c-4f5e-a358-43597fc2e553 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3cb0a4f7-848c-4f5e-a358-43597fc2e553', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:26:45,659 [278] [DEBUG] [app] Ending request: urn:request:1af74479-4a2f-4f97-9884-dd3c5b3b578f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1af74479-4a2f-4f97-9884-dd3c5b3b578f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:26:45,659 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:26:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:26:45,659 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:26:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:26:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:26:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:26:45,659 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:26:45,659 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:26:45,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:26:45,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:26:45,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:26:45,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:26:45,673 [278] [DEBUG] [app] Ending request: urn:request:ef95f985-05e8-4794-9bf6-abd82d41385d (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:ef95f985-05e8-4794-9bf6-abd82d41385d', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:26:45,673 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:26:45,673 [282] [DEBUG] [app] Ending request: urn:request:5803a692-34c6-42e4-8078-b20b509e306a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:5803a692-34c6-42e4-8078-b20b509e306a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:26:45,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:26:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:26:45,674 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:26:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.023)
gunicorn-web stdout | 2024-04-22 04:26:45,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:26:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:26:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotatotalworker stdout | 2024-04-22 04:26:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:26:46,054 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:27:01.054492+00:00 (in 14.999509 seconds)
quotatotalworker stdout | 2024-04-22 04:26:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:27:01 UTC)" (scheduled at 2024-04-22 04:26:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:26:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:26:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:26:46,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:27:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:26:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:26:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:27:17.052354+00:00 (in 29.999479 seconds)
buildlogsarchiver stdout | 2024-04-22 04:26:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:27:17 UTC)" (scheduled at 2024-04-22 04:26:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:26:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 26, 47, 53240), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:26:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:26:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:26:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:27:17 UTC)" executed successfully
manifestbackfillworker stdout | 2024-04-22 04:26:47,070 [74] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
manifestbackfillworker stdout | 2024-04-22 04:26:47,071 [74] [INFO] [apscheduler.executors.default] Running job "ManifestBackfillWorker._backfill_manifests (trigger: interval[1:00:00], next run at: 2024-04-22 04:26:47 UTC)" (scheduled at 2024-04-22 04:26:47.070659+00:00)
manifestbackfillworker stdout | 2024-04-22 04:26:47,071 [74] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size" FROM "manifest" AS "t1" WHERE ("t1"."layers_compressed_size" IS %s) LIMIT %s OFFSET %s', [None, 1, 0])
manifestbackfillworker stdout | 2024-04-22 04:26:47,072 [74] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 05:26:47.070659+00:00 (in 3599.998637 seconds)
manifestbackfillworker stdout | 2024-04-22 04:26:47,080 [74] [DEBUG] [__main__] Manifest backfill worker has completed; skipping
manifestbackfillworker stdout | 2024-04-22 04:26:47,080 [74] [DEBUG] [data.database] Disconnecting from database.
manifestbackfillworker stdout | 2024-04-22 04:26:47,080 [74] [INFO] [apscheduler.executors.default] Job "ManifestBackfillWorker._backfill_manifests (trigger: interval[1:00:00], next run at: 2024-04-22 05:26:47 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:26:49,104 [278] [DEBUG] [app] Starting request: urn:request:360e837b-70f8-4b4d-ae08-9176408d853b (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:26:49,104 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:26:49,105 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:26:49,105 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:26:49,114 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:26:49,114 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:26:49,114 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:26:49,115 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:26:49,115 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:26:49,115 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:26:49,115 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:26:49,115 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:26:49,117 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:26:49,124 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:26:49,125 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:26:49,129 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:26:49,134 [278] [DEBUG] [app] Ending request: urn:request:360e837b-70f8-4b4d-ae08-9176408d853b (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:360e837b-70f8-4b4d-ae08-9176408d853b', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:26:49,134 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:26:49,134 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:26:49 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:26:49 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.031 1536 0.031)
expiredappspecifictokenworker stdout | 2024-04-22 04:26:51,432 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
repositorygcworker stdout | 2024-04-22 04:26:51,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:26:51,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:27:06.552482+00:00 (in 14.996447 seconds)
repositorygcworker stdout | 2024-04-22 04:26:51,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:31:51 UTC)" (scheduled at 2024-04-22 04:26:51.555445+00:00)
repositorygcworker stdout | 2024-04-22 04:26:51,557 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 26, 51, 556418), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 04:26:51,567 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 26, 51, 556418), True, datetime.datetime(2024, 4, 22, 4, 26, 51, 556418), 0, 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 04:26:51,569 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 26, 51, 556418), True, datetime.datetime(2024, 4, 22, 4, 26, 51, 556418), 0, 'repositorygc/%', False, datetime.datetime(2024, 4, 22, 4, 26, 51, 556418), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 04:26:51,572 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:26:51,572 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:31:51 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:26:52,616 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
exportactionlogsworker stdout | 2024-04-22 04:26:53,566 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:26:53,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:27:39.566970+00:00 (in 45.999795 seconds)
exportactionlogsworker stdout | 2024-04-22 04:26:53,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:31:53 UTC)" (scheduled at 2024-04-22 04:26:53.566665+00:00)
exportactionlogsworker stdout | 2024-04-22 04:26:53,568 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 26, 53, 567559), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 04:26:53,577 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 26, 53, 567559), True, datetime.datetime(2024, 4, 22, 4, 26, 53, 567559), 0, 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 04:26:53,580 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 26, 53, 567559), True, datetime.datetime(2024, 4, 22, 4, 26, 53, 567559), 0, 'exportactionlogs/%', False, datetime.datetime(2024, 4, 22, 4, 26, 53, 567559), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 04:26:53,582 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:26:53,582 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:31:53 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:26:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:26:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:27:03.759375+00:00 (in 9.999465 seconds)
notificationworker stdout | 2024-04-22 04:26:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:27:03 UTC)" (scheduled at 2024-04-22 04:26:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:26:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:26:53,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 26, 53, 760239), True, datetime.datetime(2024, 4, 22, 4, 26, 53, 760239), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:26:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:26:53,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:26:53,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:27:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:26:56,252 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:26:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:26:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:27:05.871852+00:00 (in 8.998222 seconds)
securityworker stdout | 2024-04-22 04:26:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:27:26 UTC)" (scheduled at 2024-04-22 04:26:56.873109+00:00)
securityworker stdout | 2024-04-22 04:26:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:26:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:26:56,875 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:26:56,875 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:26:56,875 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:26:56,876 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:26:56,876 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:26:56,878 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:26:56,879 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:26:56,889 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:26:56,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:26:56,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:26:56,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 21, 56, 879682), 1, 2])
securityworker stdout | 2024-04-22 04:26:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:26:56,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:26:56,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 21, 56, 879682), 1, 2])
securityworker stdout | 2024-04-22 04:26:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:26:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:26:56,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:26:56,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:26:56,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:26:56,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:26:56,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:26:56,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:26:56,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:26:56,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:27:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:26:58,032 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
quotatotalworker stdout | 2024-04-22 04:26:59,385 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
repositorygcworker stdout | 2024-04-22 04:26:59,390 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
gunicorn-web stdout | 2024-04-22 04:27:00,473 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:27:00,517 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:27:00,552 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:27:00,611 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:27:00,613 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:27:00,653 [278] [DEBUG] [app] Starting request: urn:request:b640cbdd-1ca7-4398-a67c-bfc8eae6b718 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:27:00,653 [279] [DEBUG] [app] Starting request: urn:request:f67b4056-fe95-4f51-a784-41021c82b6a3 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:27:00,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:27:00,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:27:00,657 [292] [DEBUG] [app] Starting request: urn:request:853b2471-dbc3-4484-a542-6ef8640c9a8e (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:27:00,657 [286] [DEBUG] [app] Starting request: urn:request:9657cb31-e318-4a12-bd4b-8b347c6bb76c (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:27:00,657 [286] [DEBUG] [app] Ending request: urn:request:9657cb31-e318-4a12-bd4b-8b347c6bb76c (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:9657cb31-e318-4a12-bd4b-8b347c6bb76c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:27:00,657 [292] [DEBUG] [app] Ending request: urn:request:853b2471-dbc3-4484-a542-6ef8640c9a8e (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:853b2471-dbc3-4484-a542-6ef8640c9a8e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:27:00,658 [286] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:27:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:27:00,658 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:27:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:27:00,658 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:27:00,658 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:27:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:27:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:27:00,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:27:00,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:27:00,661 [282] [DEBUG] [app] Starting request: urn:request:f00f1402-e110-49f1-818e-07d49e0340d9 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:27:00,661 [281] [DEBUG] [app] Starting request: urn:request:76b3f7e1-0047-45ee-a6b1-8e3f386af151 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:27:00,661 [281] [DEBUG] [app] Ending request: urn:request:76b3f7e1-0047-45ee-a6b1-8e3f386af151 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:76b3f7e1-0047-45ee-a6b1-8e3f386af151', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:27:00,661 [282] [DEBUG] [app] Ending request: urn:request:f00f1402-e110-49f1-818e-07d49e0340d9 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:f00f1402-e110-49f1-818e-07d49e0340d9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:27:00,662 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:27:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:27:00,662 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:27:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:27:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:27:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:27:00,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:27:00,662 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:27:00,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:27:00,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:27:00,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:27:00,669 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:27:00,676 [278] [DEBUG] [app] Ending request: urn:request:b640cbdd-1ca7-4398-a67c-bfc8eae6b718 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b640cbdd-1ca7-4398-a67c-bfc8eae6b718', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:27:00,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:27:00,677 [279] [DEBUG] [app] Ending request: urn:request:f67b4056-fe95-4f51-a784-41021c82b6a3 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f67b4056-fe95-4f51-a784-41021c82b6a3', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:27:00,677 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:27:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:27:00,677 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:27:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
gunicorn-web stdout | 2024-04-22 04:27:00,677 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:27:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:27:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
quotatotalworker stdout | 2024-04-22 04:27:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:27:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:27:16.054492+00:00 (in 14.999495 seconds)
quotatotalworker stdout | 2024-04-22 04:27:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:27:16 UTC)" (scheduled at 2024-04-22 04:27:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:27:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:27:01,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:27:01,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:27:16 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:27:01,278 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:27:01,457 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotaregistrysizeworker stdout | 2024-04-22 04:27:02,281 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:27:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:27:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:27:16.552337+00:00 (in 13.995603 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:27:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:28:02 UTC)" (scheduled at 2024-04-22 04:27:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:27:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:27:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:28:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:27:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:27:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:27:13.759375+00:00 (in 9.999450 seconds)
notificationworker stdout | 2024-04-22 04:27:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:27:13 UTC)" (scheduled at 2024-04-22 04:27:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:27:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:27:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 27, 3, 760380), True, datetime.datetime(2024, 4, 22, 4, 27, 3, 760380), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:27:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:27:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:27:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:27:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:27:04,001 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:27:05,048 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:27:05,051 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:27:05,055 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
buildlogsarchiver stdout | 2024-04-22 04:27:05,321 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:27:05,400 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:27:05,756 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:27:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:27:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:27:26.873109+00:00 (in 21.000737 seconds)
securityworker stdout | 2024-04-22 04:27:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:27:35 UTC)" (scheduled at 2024-04-22 04:27:05.871852+00:00)
securityworker stdout | 2024-04-22 04:27:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:27:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:27:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:27:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:27:05,889 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:27:05,889 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:27:35 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:27:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:27:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:27:13.555667+00:00 (in 7.002675 seconds)
repositorygcworker stdout | 2024-04-22 04:27:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:28:06 UTC)" (scheduled at 2024-04-22 04:27:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:27:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:27:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 27, 6, 553392), True, datetime.datetime(2024, 4, 22, 4, 27, 6, 553392), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:27:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:27:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:27:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:28:06 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:27:06,792 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:27:07,953 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:27:08,037 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:27:08,297 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:27:09,220 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:27:10,449 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:27:10,463 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 04:27:10,874 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:27:10,934 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
autopruneworker stdout | 2024-04-22 04:27:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:27:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:27:41.264267+00:00 (in 29.999450 seconds)
autopruneworker stdout | 2024-04-22 04:27:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:27:41 UTC)" (scheduled at 2024-04-22 04:27:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:27:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713759971271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:27:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:27:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:27:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:27:41 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:27:11,427 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:27:11,430 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:27:11,450 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:27:11,453 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:27:11,455 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:27:11,459 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:27:11,462 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:27:11,468 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:27:11,471 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
storagereplication stdout | 2024-04-22 04:27:12,345 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:27:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:27:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:28:06.552482+00:00 (in 52.996308 seconds)
repositorygcworker stdout | 2024-04-22 04:27:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:28:13 UTC)" (scheduled at 2024-04-22 04:27:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:27:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:27:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:28:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:27:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:27:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:27:19.762424+00:00 (in 6.002622 seconds)
notificationworker stdout | 2024-04-22 04:27:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:27:23 UTC)" (scheduled at 2024-04-22 04:27:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:27:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:27:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 27, 13, 760078), True, datetime.datetime(2024, 4, 22, 4, 27, 13, 760078), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:27:13,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:27:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:27:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:27:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:27:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:27:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:27:44.952062+00:00 (in 29.999538 seconds)
gcworker stdout | 2024-04-22 04:27:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:27:44 UTC)" (scheduled at 2024-04-22 04:27:14.952062+00:00)
gcworker stdout | 2024-04-22 04:27:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712550434952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:27:14,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:27:14,964 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:27:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:27:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:27:15,652 [278] [DEBUG] [app] Starting request: urn:request:19e59143-16d6-4e55-9c5e-1e8f97c33396 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:27:15,652 [279] [DEBUG] [app] Starting request: urn:request:2d0e2e7a-f26a-40d6-afe7-ab04789efdc7 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:27:15,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:27:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:27:15,656 [284] [DEBUG] [app] Starting request: urn:request:dfaa72bd-4280-43a8-83db-59225bced250 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:27:15,656 [290] [DEBUG] [app] Starting request: urn:request:a46001ff-1fb7-49e6-a71f-6ce77b7211b4 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:27:15,656 [284] [DEBUG] [app] Ending request: urn:request:dfaa72bd-4280-43a8-83db-59225bced250 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:dfaa72bd-4280-43a8-83db-59225bced250', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:27:15,656 [290] [DEBUG] [app] Ending request: urn:request:a46001ff-1fb7-49e6-a71f-6ce77b7211b4 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:a46001ff-1fb7-49e6-a71f-6ce77b7211b4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:27:15,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:27:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:27:15,656 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:27:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:27:15,656 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:27:15,656 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:27:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:27:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:27:15,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:27:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:27:15,659 [281] [DEBUG] [app] Starting request: urn:request:d02abcc8-4150-4700-874c-0f193dbb2a0e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:27:15,659 [282] [DEBUG] [app] Starting request: urn:request:6ab3ad3a-3d99-4121-b9e3-b5fd68cb8d2f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:27:15,659 [282] [DEBUG] [app] Ending request: urn:request:6ab3ad3a-3d99-4121-b9e3-b5fd68cb8d2f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:6ab3ad3a-3d99-4121-b9e3-b5fd68cb8d2f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:27:15,659 [281] [DEBUG] [app] Ending request: urn:request:d02abcc8-4150-4700-874c-0f193dbb2a0e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d02abcc8-4150-4700-874c-0f193dbb2a0e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:27:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:27:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:27:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:27:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:27:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:27:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:27:15,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:27:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:27:15,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:27:15,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:27:15,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:27:15,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:27:15,673 [278] [DEBUG] [app] Ending request: urn:request:19e59143-16d6-4e55-9c5e-1e8f97c33396 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:19e59143-16d6-4e55-9c5e-1e8f97c33396', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:27:15,674 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:27:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:27:15,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:27:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:27:15,674 [279] [DEBUG] [app] Ending request: urn:request:2d0e2e7a-f26a-40d6-afe7-ab04789efdc7 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2d0e2e7a-f26a-40d6-afe7-ab04789efdc7', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:27:15,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:27:15,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:27:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:27:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.023)
quotatotalworker stdout | 2024-04-22 04:27:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:27:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:27:31.054492+00:00 (in 14.999472 seconds)
quotatotalworker stdout | 2024-04-22 04:27:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:27:31 UTC)" (scheduled at 2024-04-22 04:27:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:27:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:27:16,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:27:16,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:27:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:27:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:27:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:27:21.555879+00:00 (in 5.002952 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:27:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:28:16 UTC)" (scheduled at 2024-04-22 04:27:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:27:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:27:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 27, 16, 553360), True, datetime.datetime(2024, 4, 22, 4, 27, 16, 553360), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:27:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:27:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:27:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:28:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:27:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:27:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:27:47.052354+00:00 (in 29.999445 seconds)
buildlogsarchiver stdout | 2024-04-22 04:27:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:27:47 UTC)" (scheduled at 2024-04-22 04:27:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:27:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 27, 17, 53267), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:27:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:27:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:27:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:27:47 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:27:19,498 [278] [DEBUG] [app] Starting request: urn:request:b7b1b7e9-52c8-4819-bf9f-b51f0186b3d6 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:27:19,498 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:27:19,498 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:27:19,499 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:27:19,508 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:27:19,508 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:27:19,508 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:27:19,508 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:27:19,508 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:27:19,508 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:27:19,508 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:27:19,508 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:27:19,511 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:27:19,518 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:27:19,519 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:27:19,523 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:27:19,527 [278] [DEBUG] [app] Ending request: urn:request:b7b1b7e9-52c8-4819-bf9f-b51f0186b3d6 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:b7b1b7e9-52c8-4819-bf9f-b51f0186b3d6', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:27:19,528 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:27:19,528 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:27:19 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:27:19 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.032 1555 0.031)
notificationworker stdout | 2024-04-22 04:27:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:27:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:27:23.759375+00:00 (in 3.996482 seconds)
notificationworker stdout | 2024-04-22 04:27:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:28:19 UTC)" (scheduled at 2024-04-22 04:27:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:27:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:27:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:28:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:27:21,469 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:27:21,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:27:21,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:28:02.556208+00:00 (in 40.999805 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:27:21,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:32:21 UTC)" (scheduled at 2024-04-22 04:27:21.555879+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:27:21,557 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 27, 21, 556770), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 04:27:21,567 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 27, 21, 556770), True, datetime.datetime(2024, 4, 22, 4, 27, 21, 556770), 0, 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 04:27:21,570 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 27, 21, 556770), True, datetime.datetime(2024, 4, 22, 4, 27, 21, 556770), 0, 'secscanv4/%', False, datetime.datetime(2024, 4, 22, 4, 27, 21, 556770), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 04:27:21,572 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:27:21,572 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:32:21 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:27:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:27:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:27:38.058708+00:00 (in 15.999234 seconds)
namespacegcworker stdout | 2024-04-22 04:27:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:28:22 UTC)" (scheduled at 2024-04-22 04:27:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:27:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:27:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:28:22 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:27:22,645 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:27:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:27:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:27:33.759375+00:00 (in 9.999470 seconds)
notificationworker stdout | 2024-04-22 04:27:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:27:33 UTC)" (scheduled at 2024-04-22 04:27:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:27:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:27:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 27, 23, 760370), True, datetime.datetime(2024, 4, 22, 4, 27, 23, 760370), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:27:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:27:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:27:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:27:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:27:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:27:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:28:24.361582+00:00 (in 59.999496 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:27:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:28:24 UTC)" (scheduled at 2024-04-22 04:27:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:27:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:27:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:27:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:28:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:27:26,284 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:27:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:27:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:27:35.871852+00:00 (in 8.998225 seconds)
securityworker stdout | 2024-04-22 04:27:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:27:56 UTC)" (scheduled at 2024-04-22 04:27:26.873109+00:00)
securityworker stdout | 2024-04-22 04:27:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:27:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:27:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:27:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:27:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:27:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:27:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:27:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:27:26,882 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:27:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:27:26,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:27:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:27:26,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 22, 26, 881984), 1, 2])
securityworker stdout | 2024-04-22 04:27:26,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:27:26,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:27:26,898 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 22, 26, 881984), 1, 2])
securityworker stdout | 2024-04-22 04:27:26,900 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:27:26,900 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:27:26,900 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:27:26,900 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:27:26,901 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:27:26,901 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:27:26,901 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:27:26,902 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:27:26,902 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:27:26,902 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:27:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:27:28,066 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:27:29,405 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:27:29,421 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:27:30,481 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:27:30,527 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:27:30,563 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:27:30,623 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:27:30,626 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:27:30,652 [278] [DEBUG] [app] Starting request: urn:request:0e9a3ffc-ae6e-4f48-bc47-89321034a447 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:27:30,653 [279] [DEBUG] [app] Starting request: urn:request:1d4ca18a-d27d-4b17-8334-31734ce1a86c (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:27:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:27:30,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:27:30,655 [284] [DEBUG] [app] Starting request: urn:request:52ebdcc1-d9e9-4dd8-9c1f-2be61ac4ed89 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:27:30,656 [284] [DEBUG] [app] Ending request: urn:request:52ebdcc1-d9e9-4dd8-9c1f-2be61ac4ed89 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:52ebdcc1-d9e9-4dd8-9c1f-2be61ac4ed89', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:27:30,656 [291] [DEBUG] [app] Starting request: urn:request:78c28146-2b4b-41e7-891a-fe4d0a4fa00f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:27:30,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:27:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:27:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:27:30,656 [291] [DEBUG] [app] Ending request: urn:request:78c28146-2b4b-41e7-891a-fe4d0a4fa00f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:78c28146-2b4b-41e7-891a-fe4d0a4fa00f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:27:30,656 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 04:27:30,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:27:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:27:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-web stdout | 2024-04-22 04:27:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:27:30,657 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:27:30,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:27:30,659 [282] [DEBUG] [app] Starting request: urn:request:0c96a98e-db4b-4afc-b1b0-395a405a14f4 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:27:30,659 [278] [DEBUG] [app] Starting request: urn:request:a6dbb480-5b5a-42a9-a348-93cefef37a23 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:27:30,659 [282] [DEBUG] [app] Ending request: urn:request:0c96a98e-db4b-4afc-b1b0-395a405a14f4 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:0c96a98e-db4b-4afc-b1b0-395a405a14f4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:27:30,659 [278] [DEBUG] [app] Ending request: urn:request:a6dbb480-5b5a-42a9-a348-93cefef37a23 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a6dbb480-5b5a-42a9-a348-93cefef37a23', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:27:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:27:30,659 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:27:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:27:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:27:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:27:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:27:30,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:27:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:27:30,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:27:30,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:27:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:27:30,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:27:30,674 [278] [DEBUG] [app] Ending request: urn:request:0e9a3ffc-ae6e-4f48-bc47-89321034a447 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:0e9a3ffc-ae6e-4f48-bc47-89321034a447', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:27:30,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:27:30,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:27:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:27:30,675 [279] [DEBUG] [app] Ending request: urn:request:1d4ca18a-d27d-4b17-8334-31734ce1a86c (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:1d4ca18a-d27d-4b17-8334-31734ce1a86c', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:27:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:27:30,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:27:30,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:27:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:27:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotatotalworker stdout | 2024-04-22 04:27:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:27:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:27:46.054492+00:00 (in 14.999486 seconds)
quotatotalworker stdout | 2024-04-22 04:27:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:27:46 UTC)" (scheduled at 2024-04-22 04:27:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:27:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:27:31,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:27:31,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:27:46 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:27:31,313 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:27:31,464 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotaregistrysizeworker stdout | 2024-04-22 04:27:32,318 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:27:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:27:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:27:43.759375+00:00 (in 9.999478 seconds)
notificationworker stdout | 2024-04-22 04:27:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:27:43 UTC)" (scheduled at 2024-04-22 04:27:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:27:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:27:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 27, 33, 760214), True, datetime.datetime(2024, 4, 22, 4, 27, 33, 760214), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:27:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:27:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:27:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:27:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:27:34,032 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:27:35,056 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:27:35,059 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:27:35,062 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
buildlogsarchiver stdout | 2024-04-22 04:27:35,354 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:27:35,408 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:27:35,793 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:27:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:27:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:27:56.873109+00:00 (in 21.000712 seconds)
securityworker stdout | 2024-04-22 04:27:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:28:05 UTC)" (scheduled at 2024-04-22 04:27:35.871852+00:00)
securityworker stdout | 2024-04-22 04:27:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:27:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:27:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:27:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:27:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:27:35,887 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:27:35,890 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:27:35,890 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:27:35,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 22, 35, 876231), 1, 2])
securityworker stdout | 2024-04-22 04:27:35,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:27:35,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:27:35,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 22, 35, 876231), 1, 2])
securityworker stdout | 2024-04-22 04:27:35,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:27:35,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:27:35,895 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:27:35,895 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:28:05 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:27:36,816 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:27:37,969 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:27:38,050 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
namespacegcworker stdout | 2024-04-22 04:27:38,058 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:27:38,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:27:43.057186+00:00 (in 4.998074 seconds)
namespacegcworker stdout | 2024-04-22 04:27:38,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:32:38 UTC)" (scheduled at 2024-04-22 04:27:38.058708+00:00)
namespacegcworker stdout | 2024-04-22 04:27:38,059 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 27, 38, 59420), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 04:27:38,069 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 27, 38, 59420), True, datetime.datetime(2024, 4, 22, 4, 27, 38, 59420), 0, 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 04:27:38,072 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 27, 38, 59420), True, datetime.datetime(2024, 4, 22, 4, 27, 38, 59420), 0, 'namespacegc/%', False, datetime.datetime(2024, 4, 22, 4, 27, 38, 59420), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 04:27:38,074 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:27:38,074 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:32:38 UTC)" executed successfully
globalpromstats stdout | 2024-04-22 04:27:38,334 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:27:39,256 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
exportactionlogsworker stdout | 2024-04-22 04:27:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:27:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:27:41.564959+00:00 (in 1.997457 seconds)
exportactionlogsworker stdout | 2024-04-22 04:27:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:28:39 UTC)" (scheduled at 2024-04-22 04:27:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:27:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:27:39,568 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:28:39 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:27:40,466 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:27:40,499 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 04:27:40,911 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:27:40,960 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
autopruneworker stdout | 2024-04-22 04:27:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:27:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:28:11.264267+00:00 (in 29.999532 seconds)
autopruneworker stdout | 2024-04-22 04:27:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:28:11 UTC)" (scheduled at 2024-04-22 04:27:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:27:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713760001271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:27:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:27:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:27:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:28:11 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:27:41,440 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:27:41,442 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:27:41,458 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:27:41,462 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:27:41,466 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:27:41,470 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:27:41,472 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:27:41,478 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:27:41,481 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
exportactionlogsworker stdout | 2024-04-22 04:27:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:27:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:28:39.566970+00:00 (in 58.001524 seconds)
exportactionlogsworker stdout | 2024-04-22 04:27:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:28:41 UTC)" (scheduled at 2024-04-22 04:27:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:27:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:27:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 27, 41, 565862), True, datetime.datetime(2024, 4, 22, 4, 27, 41, 565862), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:27:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:27:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:27:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:28:41 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:27:42,378 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
namespacegcworker stdout | 2024-04-22 04:27:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:27:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:28:22.058978+00:00 (in 39.001296 seconds)
namespacegcworker stdout | 2024-04-22 04:27:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:28:43 UTC)" (scheduled at 2024-04-22 04:27:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:27:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:27:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 27, 43, 58108), True, datetime.datetime(2024, 4, 22, 4, 27, 43, 58108), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:27:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:27:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:27:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:28:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:27:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:27:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:27:53.759375+00:00 (in 9.999439 seconds)
notificationworker stdout | 2024-04-22 04:27:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:27:53 UTC)" (scheduled at 2024-04-22 04:27:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:27:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:27:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 27, 43, 760354), True, datetime.datetime(2024, 4, 22, 4, 27, 43, 760354), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:27:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:27:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:27:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:27:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:27:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:27:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:28:14.952062+00:00 (in 29.999496 seconds)
gcworker stdout | 2024-04-22 04:27:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:28:14 UTC)" (scheduled at 2024-04-22 04:27:44.952062+00:00)
gcworker stdout | 2024-04-22 04:27:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712550464952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:27:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:27:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:27:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:28:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:27:45,653 [282] [DEBUG] [app] Starting request: urn:request:e525bf77-e6c4-4514-94a6-a0c40606c0fa (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:27:45,653 [278] [DEBUG] [app] Starting request: urn:request:a17592a3-2121-4bd4-935f-2a5734e8f9f3 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:27:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:27:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:27:45,656 [284] [DEBUG] [app] Starting request: urn:request:5f35125c-0291-4a03-8bee-7747fd40a3ab (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:27:45,656 [291] [DEBUG] [app] Starting request: urn:request:de458404-ba73-46fd-b33b-be5ba662ec4f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:27:45,656 [284] [DEBUG] [app] Ending request: urn:request:5f35125c-0291-4a03-8bee-7747fd40a3ab (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5f35125c-0291-4a03-8bee-7747fd40a3ab', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:27:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:27:45,656 [291] [DEBUG] [app] Ending request: urn:request:de458404-ba73-46fd-b33b-be5ba662ec4f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:de458404-ba73-46fd-b33b-be5ba662ec4f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:27:45,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:27:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:27:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 04:27:45,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:27:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:27:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:27:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:27:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:27:45,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:27:45,659 [281] [DEBUG] [app] Starting request: urn:request:21de0671-40ec-4cc7-b19e-2a0bb4daeea4 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:27:45,659 [281] [DEBUG] [app] Ending request: urn:request:21de0671-40ec-4cc7-b19e-2a0bb4daeea4 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:21de0671-40ec-4cc7-b19e-2a0bb4daeea4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:27:45,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:27:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:27:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:27:45,660 [282] [DEBUG] [app] Starting request: urn:request:131d5a40-5c49-48ff-8822-d50793e65507 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:27:45,660 [282] [DEBUG] [app] Ending request: urn:request:131d5a40-5c49-48ff-8822-d50793e65507 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:131d5a40-5c49-48ff-8822-d50793e65507', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:27:45,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:27:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:27:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.000 159 0.000)
gunicorn-web stdout | 2024-04-22 04:27:45,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:27:45,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:27:45,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:27:45,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:27:45,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:27:45,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:27:45,675 [282] [DEBUG] [app] Ending request: urn:request:e525bf77-e6c4-4514-94a6-a0c40606c0fa (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e525bf77-e6c4-4514-94a6-a0c40606c0fa', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:27:45,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:27:45,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:27:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:27:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:27:45,675 [278] [DEBUG] [app] Ending request: urn:request:a17592a3-2121-4bd4-935f-2a5734e8f9f3 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a17592a3-2121-4bd4-935f-2a5734e8f9f3', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:27:45,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:27:45,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:27:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:27:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
quotatotalworker stdout | 2024-04-22 04:27:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:27:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:28:01.054492+00:00 (in 14.999458 seconds)
quotatotalworker stdout | 2024-04-22 04:27:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:28:01 UTC)" (scheduled at 2024-04-22 04:27:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:27:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:27:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:27:46,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:28:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:27:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:27:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:28:17.052354+00:00 (in 29.999426 seconds)
buildlogsarchiver stdout | 2024-04-22 04:27:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:28:17 UTC)" (scheduled at 2024-04-22 04:27:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:27:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 27, 47, 53295), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:27:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:27:47,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:27:47,063 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:28:17 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:27:50,702 [278] [DEBUG] [app] Starting request: urn:request:0432e740-fca0-43b7-9ca2-1c1dc4b1cfa9 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:27:50,702 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:27:50,702 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:27:50,703 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:27:50,713 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:27:50,713 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:27:50,713 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:27:50,714 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:27:50,714 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:27:50,714 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:27:50,714 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:27:50,714 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:27:50,716 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:27:50,723 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:27:50,724 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:27:50,729 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:27:50,733 [278] [DEBUG] [app] Ending request: urn:request:0432e740-fca0-43b7-9ca2-1c1dc4b1cfa9 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:0432e740-fca0-43b7-9ca2-1c1dc4b1cfa9', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:27:50,733 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:27:50 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.033 1536 0.033)
gunicorn-web stdout | 2024-04-22 04:27:50,734 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:27:50 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
expiredappspecifictokenworker stdout | 2024-04-22 04:27:51,505 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:27:52,657 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:27:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:27:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:28:03.759375+00:00 (in 9.999420 seconds)
notificationworker stdout | 2024-04-22 04:27:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:28:03 UTC)" (scheduled at 2024-04-22 04:27:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:27:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:27:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 27, 53, 760296), True, datetime.datetime(2024, 4, 22, 4, 27, 53, 760296), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:27:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:27:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:27:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:28:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:27:56,320 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:27:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:27:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:28:05.871852+00:00 (in 8.998223 seconds)
securityworker stdout | 2024-04-22 04:27:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:28:26 UTC)" (scheduled at 2024-04-22 04:27:56.873109+00:00)
securityworker stdout | 2024-04-22 04:27:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:27:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:27:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:27:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:27:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:27:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:27:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:27:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:27:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:27:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:27:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:27:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:27:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 22, 56, 881107), 1, 2])
securityworker stdout | 2024-04-22 04:27:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:27:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:27:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 22, 56, 881107), 1, 2])
securityworker stdout | 2024-04-22 04:27:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:27:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:27:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:27:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:27:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:27:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:27:56,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:27:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:27:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:27:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:28:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:27:58,075 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:27:59,422 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:27:59,456 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:28:00,489 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:28:00,537 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:28:00,573 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:28:00,636 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
gunicorn-web stdout | 2024-04-22 04:28:00,639 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:28:00,652 [278] [DEBUG] [app] Starting request: urn:request:8fce0054-3582-4966-a070-59dd8ac3a6e0 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:28:00,652 [282] [DEBUG] [app] Starting request: urn:request:176b4210-2f1e-475c-99c6-9cf9574b3365 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:28:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:28:00,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:28:00,655 [292] [DEBUG] [app] Starting request: urn:request:a0a8f8d4-a828-4c8a-8d87-4d59a0c32275 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:28:00,656 [284] [DEBUG] [app] Starting request: urn:request:40b072f6-b189-4348-aedd-9177ec30ea01 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:28:00,656 [292] [DEBUG] [app] Ending request: urn:request:a0a8f8d4-a828-4c8a-8d87-4d59a0c32275 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:a0a8f8d4-a828-4c8a-8d87-4d59a0c32275', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:28:00,656 [284] [DEBUG] [app] Ending request: urn:request:40b072f6-b189-4348-aedd-9177ec30ea01 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:40b072f6-b189-4348-aedd-9177ec30ea01', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:28:00,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:28:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:28:00,656 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:28:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:28:00,656 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:28:00,656 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:28:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:28:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:28:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:28:00,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:28:00,659 [281] [DEBUG] [app] Starting request: urn:request:12c67fd5-8586-43bf-abc5-d4163cd7f5d0 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:28:00,659 [281] [DEBUG] [app] Ending request: urn:request:12c67fd5-8586-43bf-abc5-d4163cd7f5d0 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:12c67fd5-8586-43bf-abc5-d4163cd7f5d0', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:28:00,659 [282] [DEBUG] [app] Starting request: urn:request:e1c70ba2-6504-4745-8e71-5d39c8534ce2 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:28:00,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:28:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:28:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 04:28:00,660 [282] [DEBUG] [app] Ending request: urn:request:e1c70ba2-6504-4745-8e71-5d39c8534ce2 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e1c70ba2-6504-4745-8e71-5d39c8534ce2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:28:00,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:28:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:28:00,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:28:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:28:00,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:28:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:28:00,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:28:00,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:28:00,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:28:00,674 [282] [DEBUG] [app] Ending request: urn:request:176b4210-2f1e-475c-99c6-9cf9574b3365 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:176b4210-2f1e-475c-99c6-9cf9574b3365', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:28:00,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:28:00,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:28:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:28:00,675 [278] [DEBUG] [app] Ending request: urn:request:8fce0054-3582-4966-a070-59dd8ac3a6e0 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:8fce0054-3582-4966-a070-59dd8ac3a6e0', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:28:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:28:00,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:28:00,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:28:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:28:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.024)
quotatotalworker stdout | 2024-04-22 04:28:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:28:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:28:16.054492+00:00 (in 14.999439 seconds)
quotatotalworker stdout | 2024-04-22 04:28:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:28:16 UTC)" (scheduled at 2024-04-22 04:28:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:28:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:28:01,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:28:01,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:28:16 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:28:01,339 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:28:01,487 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotaregistrysizeworker stdout | 2024-04-22 04:28:02,353 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:28:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:28:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:28:16.552337+00:00 (in 13.995632 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:28:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:29:02 UTC)" (scheduled at 2024-04-22 04:28:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:28:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:28:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:29:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:28:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:28:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:28:13.759375+00:00 (in 9.999425 seconds)
notificationworker stdout | 2024-04-22 04:28:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:28:13 UTC)" (scheduled at 2024-04-22 04:28:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:28:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:28:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 28, 3, 760384), True, datetime.datetime(2024, 4, 22, 4, 28, 3, 760384), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:28:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:28:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:28:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:28:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:28:04,069 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:28:05,065 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:28:05,067 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:28:05,070 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
buildlogsarchiver stdout | 2024-04-22 04:28:05,379 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:28:05,440 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:28:05,829 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:28:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:28:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:28:26.873109+00:00 (in 21.000740 seconds)
securityworker stdout | 2024-04-22 04:28:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:28:35 UTC)" (scheduled at 2024-04-22 04:28:05.871852+00:00)
securityworker stdout | 2024-04-22 04:28:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:28:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:28:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:28:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:28:05,885 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:28:05,885 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:28:35 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:28:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:28:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:28:13.555667+00:00 (in 7.002604 seconds)
repositorygcworker stdout | 2024-04-22 04:28:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:29:06 UTC)" (scheduled at 2024-04-22 04:28:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:28:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:28:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 28, 6, 553508), True, datetime.datetime(2024, 4, 22, 4, 28, 6, 553508), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:28:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:28:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:28:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:29:06 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:28:06,832 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:28:07,985 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:28:08,072 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:28:08,357 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:28:09,294 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:28:10,497 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:28:10,526 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 04:28:10,929 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:28:10,996 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
autopruneworker stdout | 2024-04-22 04:28:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:28:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:28:41.264267+00:00 (in 29.999470 seconds)
autopruneworker stdout | 2024-04-22 04:28:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:28:41 UTC)" (scheduled at 2024-04-22 04:28:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:28:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713760031271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:28:11,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:28:11,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:28:11,275 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:28:41 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:28:11,452 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:28:11,454 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:28:11,466 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:28:11,473 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:28:11,478 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:28:11,482 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:28:11,486 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:28:11,488 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:28:11,491 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
storagereplication stdout | 2024-04-22 04:28:12,408 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:28:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:28:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:29:06.552482+00:00 (in 52.996316 seconds)
repositorygcworker stdout | 2024-04-22 04:28:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:29:13 UTC)" (scheduled at 2024-04-22 04:28:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:28:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:28:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:29:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:28:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:28:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:28:19.762160+00:00 (in 6.002280 seconds)
notificationworker stdout | 2024-04-22 04:28:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:28:23 UTC)" (scheduled at 2024-04-22 04:28:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:28:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:28:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 28, 13, 760186), True, datetime.datetime(2024, 4, 22, 4, 28, 13, 760186), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:28:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:28:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:28:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:28:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:28:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:28:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:28:44.952062+00:00 (in 29.999513 seconds)
gcworker stdout | 2024-04-22 04:28:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:28:44 UTC)" (scheduled at 2024-04-22 04:28:14.952062+00:00)
gcworker stdout | 2024-04-22 04:28:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712550494952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:28:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:28:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:28:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:28:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:28:15,653 [278] [DEBUG] [app] Starting request: urn:request:69111373-0eb9-42f2-810c-7e5c06e05a21 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:28:15,653 [279] [DEBUG] [app] Starting request: urn:request:451f92a0-01c2-4485-9777-6ce717d71948 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:28:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:28:15,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:28:15,656 [290] [DEBUG] [app] Starting request: urn:request:cdf52a06-f414-4cac-a5f8-3e75eef00e55 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:28:15,656 [284] [DEBUG] [app] Starting request: urn:request:9bcf85bf-f789-4ded-bdbc-3126e6b2cd80 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:28:15,656 [284] [DEBUG] [app] Ending request: urn:request:9bcf85bf-f789-4ded-bdbc-3126e6b2cd80 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:9bcf85bf-f789-4ded-bdbc-3126e6b2cd80', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:28:15,656 [290] [DEBUG] [app] Ending request: urn:request:cdf52a06-f414-4cac-a5f8-3e75eef00e55 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:cdf52a06-f414-4cac-a5f8-3e75eef00e55', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:28:15,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:28:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:28:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:28:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:28:15,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:28:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:28:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:28:15,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:28:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:28:15,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:28:15,659 [282] [DEBUG] [app] Starting request: urn:request:ccb381a1-cbb7-4c20-b806-51f08d9f194b (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:28:15,659 [281] [DEBUG] [app] Starting request: urn:request:e7b73859-1677-4117-bbe4-fc1a42b3820f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:28:15,659 [281] [DEBUG] [app] Ending request: urn:request:e7b73859-1677-4117-bbe4-fc1a42b3820f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e7b73859-1677-4117-bbe4-fc1a42b3820f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:28:15,660 [282] [DEBUG] [app] Ending request: urn:request:ccb381a1-cbb7-4c20-b806-51f08d9f194b (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:ccb381a1-cbb7-4c20-b806-51f08d9f194b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:28:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.001)
gunicorn-web stdout | 2024-04-22 04:28:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:28:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:28:15,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:28:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:28:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:28:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:28:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:28:15,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:28:15,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:28:15,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:28:15,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:28:15,674 [279] [DEBUG] [app] Ending request: urn:request:451f92a0-01c2-4485-9777-6ce717d71948 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:451f92a0-01c2-4485-9777-6ce717d71948', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:28:15,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:28:15,674 [278] [DEBUG] [app] Ending request: urn:request:69111373-0eb9-42f2-810c-7e5c06e05a21 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:69111373-0eb9-42f2-810c-7e5c06e05a21', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:28:15,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:28:15,674 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:28:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:28:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:28:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:28:15,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:28:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:28:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:28:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:28:31.054492+00:00 (in 14.999448 seconds)
quotatotalworker stdout | 2024-04-22 04:28:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:28:31 UTC)" (scheduled at 2024-04-22 04:28:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:28:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:28:16,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:28:16,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:28:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:28:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:28:16,553 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:29:02.556208+00:00 (in 46.003117 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:28:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:29:16 UTC)" (scheduled at 2024-04-22 04:28:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:28:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:28:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 28, 16, 553514), True, datetime.datetime(2024, 4, 22, 4, 28, 16, 553514), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:28:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:28:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:28:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:29:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:28:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:28:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:28:47.052354+00:00 (in 29.999454 seconds)
buildlogsarchiver stdout | 2024-04-22 04:28:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:28:47 UTC)" (scheduled at 2024-04-22 04:28:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:28:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 28, 17, 53272), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:28:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:28:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:28:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:28:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:28:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:28:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:28:23.759375+00:00 (in 3.996685 seconds)
notificationworker stdout | 2024-04-22 04:28:19,762 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:33:19 UTC)" (scheduled at 2024-04-22 04:28:19.762160+00:00)
notificationworker stdout | 2024-04-22 04:28:19,763 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 28, 19, 763097), 'notification/%'])
notificationworker stdout | 2024-04-22 04:28:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:29:19 UTC)" (scheduled at 2024-04-22 04:28:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:28:19,764 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:28:19,764 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:29:19 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:28:19,773 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 28, 19, 763097), True, datetime.datetime(2024, 4, 22, 4, 28, 19, 763097), 0, 'notification/%'])
notificationworker stdout | 2024-04-22 04:28:19,776 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 28, 19, 763097), True, datetime.datetime(2024, 4, 22, 4, 28, 19, 763097), 0, 'notification/%', False, datetime.datetime(2024, 4, 22, 4, 28, 19, 763097), 'notification/%'])
notificationworker stdout | 2024-04-22 04:28:19,778 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:28:19,778 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:33:19 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:28:21,084 [279] [DEBUG] [app] Starting request: urn:request:48a78dea-bf4b-4c5d-a685-81a703688c91 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:28:21,085 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:28:21,085 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:28:21,085 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:28:21,095 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:28:21,095 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:28:21,095 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:28:21,095 [279] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:28:21,095 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:28:21,095 [279] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:28:21,095 [279] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:28:21,095 [279] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:28:21,097 [279] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:28:21,104 [279] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:28:21,105 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:28:21,109 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:28:21,113 [279] [DEBUG] [app] Ending request: urn:request:48a78dea-bf4b-4c5d-a685-81a703688c91 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:48a78dea-bf4b-4c5d-a685-81a703688c91', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:28:21,114 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:28:21,114 [279] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:28:21 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:28:21 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.031 1555 0.031)
expiredappspecifictokenworker stdout | 2024-04-22 04:28:21,541 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
namespacegcworker stdout | 2024-04-22 04:28:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:28:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:28:43.057186+00:00 (in 20.997654 seconds)
namespacegcworker stdout | 2024-04-22 04:28:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:29:22 UTC)" (scheduled at 2024-04-22 04:28:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:28:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:28:22,060 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:29:22 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:28:22,667 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:28:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:28:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:28:33.759375+00:00 (in 9.999476 seconds)
notificationworker stdout | 2024-04-22 04:28:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:28:33 UTC)" (scheduled at 2024-04-22 04:28:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:28:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:28:23,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 28, 23, 760165), True, datetime.datetime(2024, 4, 22, 4, 28, 23, 760165), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:28:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:28:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:28:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:28:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:28:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:28:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:29:24.361582+00:00 (in 59.999512 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:28:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:29:24 UTC)" (scheduled at 2024-04-22 04:28:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:28:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:28:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:28:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:29:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:28:26,351 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:28:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:28:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:28:35.871852+00:00 (in 8.998203 seconds)
securityworker stdout | 2024-04-22 04:28:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:28:56 UTC)" (scheduled at 2024-04-22 04:28:26.873109+00:00)
securityworker stdout | 2024-04-22 04:28:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:28:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:28:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:28:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:28:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:28:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:28:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:28:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:28:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:28:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:28:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:28:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:28:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 23, 26, 881244), 1, 2])
securityworker stdout | 2024-04-22 04:28:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:28:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:28:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 23, 26, 881244), 1, 2])
securityworker stdout | 2024-04-22 04:28:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:28:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:28:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:28:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:28:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:28:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:28:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:28:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:28:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:28:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:28:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:28:28,111 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:28:29,459 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:28:29,492 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:28:30,498 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:28:30,549 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:28:30,583 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:28:30,649 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:28:30,652 [282] [DEBUG] [app] Starting request: urn:request:e0f77b3e-00b7-42a7-8927-b0fcc61e9b90 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:28:30,653 [281] [DEBUG] [app] Starting request: urn:request:f9fa88f7-cd9e-4cd0-94de-02751af36277 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:28:30,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:28:30,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:28:30,656 [292] [DEBUG] [app] Starting request: urn:request:624fc236-8428-4b50-a16a-5768f400262c (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:28:30,656 [289] [DEBUG] [app] Starting request: urn:request:c72d4923-4878-42ec-8bdc-2bc47957e142 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:28:30,656 [289] [DEBUG] [app] Ending request: urn:request:c72d4923-4878-42ec-8bdc-2bc47957e142 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:c72d4923-4878-42ec-8bdc-2bc47957e142', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:28:30,656 [292] [DEBUG] [app] Ending request: urn:request:624fc236-8428-4b50-a16a-5768f400262c (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:624fc236-8428-4b50-a16a-5768f400262c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:28:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:28:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:28:30,657 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:28:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:28:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:28:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:28:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:28:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:28:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:28:30,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:28:30,659 [281] [DEBUG] [app] Starting request: urn:request:1dff4304-d670-4486-8924-84634080a43b (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:28:30,659 [281] [DEBUG] [app] Ending request: urn:request:1dff4304-d670-4486-8924-84634080a43b (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:1dff4304-d670-4486-8924-84634080a43b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:28:30,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:28:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:28:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:28:30,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:28:30,660 [279] [DEBUG] [app] Starting request: urn:request:3ceb16a1-c2db-4f31-946e-188c4fcae09f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:28:30,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:28:30,660 [279] [DEBUG] [app] Ending request: urn:request:3ceb16a1-c2db-4f31-946e-188c4fcae09f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3ceb16a1-c2db-4f31-946e-188c4fcae09f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:28:30,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:28:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:28:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:28:30,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:28:30,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:28:30,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:28:30,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:28:30,674 [281] [DEBUG] [app] Ending request: urn:request:f9fa88f7-cd9e-4cd0-94de-02751af36277 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f9fa88f7-cd9e-4cd0-94de-02751af36277', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:28:30,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:28:30,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:28:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:28:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:28:30,680 [282] [DEBUG] [app] Ending request: urn:request:e0f77b3e-00b7-42a7-8927-b0fcc61e9b90 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e0f77b3e-00b7-42a7-8927-b0fcc61e9b90', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:28:30,680 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:28:30,680 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:28:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:28:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.028 118 0.028)
gunicorn-web stdout | 2024-04-22 04:28:30,730 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
quotatotalworker stdout | 2024-04-22 04:28:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:28:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:28:46.054492+00:00 (in 14.999439 seconds)
quotatotalworker stdout | 2024-04-22 04:28:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:28:46 UTC)" (scheduled at 2024-04-22 04:28:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:28:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:28:31,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:28:31,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:28:46 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:28:31,365 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:28:31,523 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotaregistrysizeworker stdout | 2024-04-22 04:28:32,390 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:28:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:28:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:28:43.759375+00:00 (in 9.999481 seconds)
notificationworker stdout | 2024-04-22 04:28:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:28:43 UTC)" (scheduled at 2024-04-22 04:28:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:28:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:28:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 28, 33, 760332), True, datetime.datetime(2024, 4, 22, 4, 28, 33, 760332), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:28:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:28:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:28:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:28:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:28:34,100 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:28:35,074 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:28:35,077 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:28:35,079 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
buildlogsarchiver stdout | 2024-04-22 04:28:35,415 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:28:35,453 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:28:35,866 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
securityworker stdout | 2024-04-22 04:28:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:28:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:28:56.873109+00:00 (in 21.000802 seconds)
securityworker stdout | 2024-04-22 04:28:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:29:05 UTC)" (scheduled at 2024-04-22 04:28:35.871852+00:00)
securityworker stdout | 2024-04-22 04:28:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:28:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:28:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:28:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:28:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:28:35,887 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:28:35,889 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:28:35,890 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:28:35,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 23, 35, 876188), 1, 2])
securityworker stdout | 2024-04-22 04:28:35,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:28:35,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:28:35,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 23, 35, 876188), 1, 2])
securityworker stdout | 2024-04-22 04:28:35,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:28:35,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:28:35,895 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:28:35,895 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:29:05 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:28:36,869 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:28:38,008 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:28:38,108 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:28:38,388 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:28:39,316 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
exportactionlogsworker stdout | 2024-04-22 04:28:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:28:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:28:41.564959+00:00 (in 1.997481 seconds)
exportactionlogsworker stdout | 2024-04-22 04:28:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:29:39 UTC)" (scheduled at 2024-04-22 04:28:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:28:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:28:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:29:39 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:28:40,534 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:28:40,552 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 04:28:40,945 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:28:41,006 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
autopruneworker stdout | 2024-04-22 04:28:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:28:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:29:11.264267+00:00 (in 29.999557 seconds)
autopruneworker stdout | 2024-04-22 04:28:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:29:11 UTC)" (scheduled at 2024-04-22 04:28:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:28:41,271 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713760061271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:28:41,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:28:41,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:28:41,275 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:29:11 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:28:41,463 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:28:41,465 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:28:41,479 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:28:41,483 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:28:41,488 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:28:41,493 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:28:41,495 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:28:41,498 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:28:41,501 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
exportactionlogsworker stdout | 2024-04-22 04:28:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:28:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:29:39.566970+00:00 (in 58.001506 seconds)
exportactionlogsworker stdout | 2024-04-22 04:28:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:29:41 UTC)" (scheduled at 2024-04-22 04:28:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:28:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:28:41,567 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 28, 41, 565935), True, datetime.datetime(2024, 4, 22, 4, 28, 41, 565935), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:28:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:28:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:28:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:29:41 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:28:42,433 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
namespacegcworker stdout | 2024-04-22 04:28:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:28:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:29:22.058978+00:00 (in 39.001312 seconds)
namespacegcworker stdout | 2024-04-22 04:28:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:29:43 UTC)" (scheduled at 2024-04-22 04:28:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:28:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:28:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 28, 43, 58079), True, datetime.datetime(2024, 4, 22, 4, 28, 43, 58079), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:28:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:28:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:28:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:29:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:28:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:28:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:28:53.759375+00:00 (in 9.999503 seconds)
notificationworker stdout | 2024-04-22 04:28:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:28:53 UTC)" (scheduled at 2024-04-22 04:28:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:28:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:28:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 28, 43, 760163), True, datetime.datetime(2024, 4, 22, 4, 28, 43, 760163), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:28:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:28:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:28:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:28:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:28:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:28:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:29:14.952062+00:00 (in 29.999570 seconds)
gcworker stdout | 2024-04-22 04:28:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:29:14 UTC)" (scheduled at 2024-04-22 04:28:44.952062+00:00)
gcworker stdout | 2024-04-22 04:28:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712550524952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:28:44,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:28:44,964 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:28:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:29:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:28:45,653 [281] [DEBUG] [app] Starting request: urn:request:e465ac4f-1294-4dad-9302-c0e3b33ad2bc (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:28:45,653 [279] [DEBUG] [app] Starting request: urn:request:09edef44-cf80-45b6-ad29-c163a041208f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:28:45,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:28:45,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:28:45,656 [284] [DEBUG] [app] Starting request: urn:request:ccf24851-6c1a-4dae-8ee6-b5f45b4affc9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:28:45,656 [288] [DEBUG] [app] Starting request: urn:request:f35800f7-8b69-427a-9df0-7a22e754fec7 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:28:45,657 [284] [DEBUG] [app] Ending request: urn:request:ccf24851-6c1a-4dae-8ee6-b5f45b4affc9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:ccf24851-6c1a-4dae-8ee6-b5f45b4affc9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:28:45,657 [288] [DEBUG] [app] Ending request: urn:request:f35800f7-8b69-427a-9df0-7a22e754fec7 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f35800f7-8b69-427a-9df0-7a22e754fec7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:28:45,657 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:28:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:28:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:28:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:28:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:28:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:28:45,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:28:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:28:45,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:28:45,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:28:45,660 [282] [DEBUG] [app] Starting request: urn:request:e2efea1e-47cd-4a79-86c2-b1d6c70b008a (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:28:45,660 [278] [DEBUG] [app] Starting request: urn:request:d1dbf5c0-f4ce-4f0e-a52a-dd638a0a8c4c (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:28:45,660 [282] [DEBUG] [app] Ending request: urn:request:e2efea1e-47cd-4a79-86c2-b1d6c70b008a (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e2efea1e-47cd-4a79-86c2-b1d6c70b008a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:28:45,660 [278] [DEBUG] [app] Ending request: urn:request:d1dbf5c0-f4ce-4f0e-a52a-dd638a0a8c4c (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d1dbf5c0-f4ce-4f0e-a52a-dd638a0a8c4c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:28:45,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:28:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:28:45,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:28:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:28:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:28:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 04:28:45,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:28:45,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:28:45,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:28:45,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:28:45,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:28:45,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:28:45,675 [279] [DEBUG] [app] Ending request: urn:request:09edef44-cf80-45b6-ad29-c163a041208f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:09edef44-cf80-45b6-ad29-c163a041208f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:28:45,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:28:45,675 [281] [DEBUG] [app] Ending request: urn:request:e465ac4f-1294-4dad-9302-c0e3b33ad2bc (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e465ac4f-1294-4dad-9302-c0e3b33ad2bc', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:28:45,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:28:45,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:28:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:28:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:28:45,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:28:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:28:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotatotalworker stdout | 2024-04-22 04:28:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:28:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:29:01.054492+00:00 (in 14.999484 seconds)
quotatotalworker stdout | 2024-04-22 04:28:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:29:01 UTC)" (scheduled at 2024-04-22 04:28:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:28:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:28:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:28:46,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:29:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:28:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:28:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:29:17.052354+00:00 (in 29.999444 seconds)
buildlogsarchiver stdout | 2024-04-22 04:28:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:29:17 UTC)" (scheduled at 2024-04-22 04:28:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:28:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 28, 47, 53267), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:28:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:28:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:28:47,065 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:29:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:28:51,578 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
gunicorn-web stdout | 2024-04-22 04:28:52,477 [282] [DEBUG] [app] Starting request: urn:request:0cc33d6c-de53-4483-85c8-c5b470499ec2 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:28:52,478 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:28:52,478 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:28:52,478 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:28:52,488 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:28:52,488 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:28:52,488 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:28:52,488 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:28:52,488 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:28:52,488 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:28:52,488 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:28:52,488 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:28:52,490 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:28:52,497 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:28:52,498 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:28:52,503 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:28:52,507 [282] [DEBUG] [app] Ending request: urn:request:0cc33d6c-de53-4483-85c8-c5b470499ec2 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:0cc33d6c-de53-4483-85c8-c5b470499ec2', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:28:52,508 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:28:52,508 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:28:52 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:28:52 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.032 1536 0.032)
securityscanningnotificationworker stdout | 2024-04-22 04:28:52,705 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:28:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:28:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:29:03.759375+00:00 (in 9.999447 seconds)
notificationworker stdout | 2024-04-22 04:28:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:29:03 UTC)" (scheduled at 2024-04-22 04:28:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:28:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:28:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 28, 53, 760374), True, datetime.datetime(2024, 4, 22, 4, 28, 53, 760374), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:28:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:28:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:28:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:29:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:28:56,380 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:28:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:28:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:29:05.871852+00:00 (in 8.998203 seconds)
securityworker stdout | 2024-04-22 04:28:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:29:26 UTC)" (scheduled at 2024-04-22 04:28:56.873109+00:00)
securityworker stdout | 2024-04-22 04:28:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:28:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:28:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:28:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:28:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:28:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:28:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:28:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:28:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:28:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:28:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:28:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:28:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 23, 56, 881139), 1, 2])
securityworker stdout | 2024-04-22 04:28:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:28:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:28:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 23, 56, 881139), 1, 2])
securityworker stdout | 2024-04-22 04:28:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:28:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:28:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:28:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:28:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:28:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:28:56,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:28:56,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:28:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:28:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:29:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:28:58,136 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:28:59,471 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:28:59,529 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:29:00,507 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:29:00,559 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:29:00,594 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:29:00,653 [278] [DEBUG] [app] Starting request: urn:request:c604b13f-3923-4c48-b5f1-7f96480b6ee4 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:29:00,653 [281] [DEBUG] [app] Starting request: urn:request:e873d869-631d-42c0-9644-47b51b50862f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:29:00,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:29:00,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:29:00,656 [284] [DEBUG] [app] Starting request: urn:request:2808e046-1124-48a8-8e64-1ab1a3791321 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:29:00,657 [284] [DEBUG] [app] Ending request: urn:request:2808e046-1124-48a8-8e64-1ab1a3791321 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:2808e046-1124-48a8-8e64-1ab1a3791321', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:29:00,657 [292] [DEBUG] [app] Starting request: urn:request:c2c5ce68-a42e-4f8d-8c0b-4f9d67343078 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:29:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:29:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:29:00,657 [292] [DEBUG] [app] Ending request: urn:request:c2c5ce68-a42e-4f8d-8c0b-4f9d67343078 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:c2c5ce68-a42e-4f8d-8c0b-4f9d67343078', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:29:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:29:00,658 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:29:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:29:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:29:00,658 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:29:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-web stdout | 2024-04-22 04:29:00,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:29:00,660 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:29:00,660 [281] [DEBUG] [app] Starting request: urn:request:301ef5e0-f374-43d3-b90b-4f12e6ed15c8 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:29:00,660 [281] [DEBUG] [app] Ending request: urn:request:301ef5e0-f374-43d3-b90b-4f12e6ed15c8 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:301ef5e0-f374-43d3-b90b-4f12e6ed15c8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:29:00,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:29:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:29:00,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:29:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:29:00,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:29:00,661 [279] [DEBUG] [app] Starting request: urn:request:3220093f-acf6-48ad-95ac-7509857a3612 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:29:00,662 [279] [DEBUG] [app] Ending request: urn:request:3220093f-acf6-48ad-95ac-7509857a3612 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3220093f-acf6-48ad-95ac-7509857a3612', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:29:00,662 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:29:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:29:00,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:29:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:29:00,663 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:29:00,664 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:29:00,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:29:00,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:29:00,676 [278] [DEBUG] [app] Ending request: urn:request:c604b13f-3923-4c48-b5f1-7f96480b6ee4 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:c604b13f-3923-4c48-b5f1-7f96480b6ee4', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:29:00,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:29:00,677 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:29:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:29:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.025)
gunicorn-web stdout | 2024-04-22 04:29:00,678 [281] [DEBUG] [app] Ending request: urn:request:e873d869-631d-42c0-9644-47b51b50862f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e873d869-631d-42c0-9644-47b51b50862f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:29:00,679 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:29:00,679 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:29:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:29:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.027 118 0.027)
gunicorn-web stdout | 2024-04-22 04:29:00,742 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
quotatotalworker stdout | 2024-04-22 04:29:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:29:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:29:16.054492+00:00 (in 14.999445 seconds)
quotatotalworker stdout | 2024-04-22 04:29:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:29:16 UTC)" (scheduled at 2024-04-22 04:29:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:29:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:29:01,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:29:01,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:29:16 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:29:01,400 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:29:01,548 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotaregistrysizeworker stdout | 2024-04-22 04:29:02,426 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:29:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:29:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:29:16.552337+00:00 (in 13.995630 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:29:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:30:02 UTC)" (scheduled at 2024-04-22 04:29:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:29:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:29:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:30:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:29:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:29:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:29:13.759375+00:00 (in 9.999454 seconds)
notificationworker stdout | 2024-04-22 04:29:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:29:13 UTC)" (scheduled at 2024-04-22 04:29:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:29:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:29:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 29, 3, 760214), True, datetime.datetime(2024, 4, 22, 4, 29, 3, 760214), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:29:03,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:29:03,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:29:03,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:29:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:29:04,137 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:29:05,083 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:29:05,087 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:29:05,089 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
buildlogsarchiver stdout | 2024-04-22 04:29:05,453 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:29:05,489 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
securityworker stdout | 2024-04-22 04:29:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:29:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:29:26.873109+00:00 (in 21.000727 seconds)
securityworker stdout | 2024-04-22 04:29:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:29:35 UTC)" (scheduled at 2024-04-22 04:29:05.871852+00:00)
securityworker stdout | 2024-04-22 04:29:05,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:29:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:29:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:29:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:29:05,885 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:29:05,885 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:29:35 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:29:05,903 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
repositorygcworker stdout | 2024-04-22 04:29:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:29:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:29:13.555667+00:00 (in 7.002611 seconds)
repositorygcworker stdout | 2024-04-22 04:29:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:30:06 UTC)" (scheduled at 2024-04-22 04:29:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:29:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:29:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 29, 6, 553474), True, datetime.datetime(2024, 4, 22, 4, 29, 6, 553474), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:29:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:29:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:29:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:30:06 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:29:06,905 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:29:08,027 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:29:08,146 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:29:08,423 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:29:09,347 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:29:10,553 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:29:10,567 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 04:29:10,976 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:29:11,016 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
autopruneworker stdout | 2024-04-22 04:29:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:29:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:29:41.264267+00:00 (in 29.999526 seconds)
autopruneworker stdout | 2024-04-22 04:29:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:29:41 UTC)" (scheduled at 2024-04-22 04:29:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:29:11,271 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713760091271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:29:11,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:29:11,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:29:11,275 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:29:41 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:29:11,473 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:29:11,476 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:29:11,490 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:29:11,493 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:29:11,497 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:29:11,501 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:29:11,505 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:29:11,508 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:29:11,511 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
storagereplication stdout | 2024-04-22 04:29:12,469 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:29:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:29:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:30:06.552482+00:00 (in 52.996267 seconds)
repositorygcworker stdout | 2024-04-22 04:29:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:30:13 UTC)" (scheduled at 2024-04-22 04:29:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:29:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:29:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:30:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:29:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:29:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:29:19.762424+00:00 (in 6.002564 seconds)
notificationworker stdout | 2024-04-22 04:29:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:29:23 UTC)" (scheduled at 2024-04-22 04:29:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:29:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:29:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 29, 13, 760227), True, datetime.datetime(2024, 4, 22, 4, 29, 13, 760227), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:29:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:29:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:29:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:29:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:29:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:29:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:29:44.952062+00:00 (in 29.999489 seconds)
gcworker stdout | 2024-04-22 04:29:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:29:44 UTC)" (scheduled at 2024-04-22 04:29:14.952062+00:00)
gcworker stdout | 2024-04-22 04:29:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712550554952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:29:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:29:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:29:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:29:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:29:15,653 [282] [DEBUG] [app] Starting request: urn:request:2ec43ea5-eec1-44ee-9a13-3520c33a84a7 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:29:15,653 [278] [DEBUG] [app] Starting request: urn:request:35c18d13-f4b4-42fa-8a21-0a5d6d27e00f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:29:15,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:29:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:29:15,656 [291] [DEBUG] [app] Starting request: urn:request:a0c32339-04d8-4a13-913d-a1348b2cc78f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:29:15,656 [290] [DEBUG] [app] Starting request: urn:request:315904e3-1bd7-4581-9bcb-4becbf1cb1a5 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:29:15,656 [291] [DEBUG] [app] Ending request: urn:request:a0c32339-04d8-4a13-913d-a1348b2cc78f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:a0c32339-04d8-4a13-913d-a1348b2cc78f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:29:15,657 [290] [DEBUG] [app] Ending request: urn:request:315904e3-1bd7-4581-9bcb-4becbf1cb1a5 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:315904e3-1bd7-4581-9bcb-4becbf1cb1a5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:29:15,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:29:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:29:15,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:29:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:29:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:29:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:29:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:29:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:29:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:29:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:29:15,659 [278] [DEBUG] [app] Starting request: urn:request:a8eff4f4-b557-4559-b3a2-de56da3d3ba1 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:29:15,659 [281] [DEBUG] [app] Starting request: urn:request:c2bf7416-0224-4994-9dd9-33c884df9e30 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:29:15,660 [278] [DEBUG] [app] Ending request: urn:request:a8eff4f4-b557-4559-b3a2-de56da3d3ba1 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a8eff4f4-b557-4559-b3a2-de56da3d3ba1', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:29:15,660 [281] [DEBUG] [app] Ending request: urn:request:c2bf7416-0224-4994-9dd9-33c884df9e30 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:c2bf7416-0224-4994-9dd9-33c884df9e30', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:29:15,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:29:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:29:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:29:15,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:29:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:29:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:29:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:29:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:29:15,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:29:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:29:15,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:29:15,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:29:15,673 [282] [DEBUG] [app] Ending request: urn:request:2ec43ea5-eec1-44ee-9a13-3520c33a84a7 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2ec43ea5-eec1-44ee-9a13-3520c33a84a7', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:29:15,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:29:15,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:29:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:29:15,674 [278] [DEBUG] [app] Ending request: urn:request:35c18d13-f4b4-42fa-8a21-0a5d6d27e00f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:35c18d13-f4b4-42fa-8a21-0a5d6d27e00f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:29:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:29:15,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:29:15,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:29:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:29:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
quotatotalworker stdout | 2024-04-22 04:29:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:29:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:29:31.054492+00:00 (in 14.999449 seconds)
quotatotalworker stdout | 2024-04-22 04:29:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:29:31 UTC)" (scheduled at 2024-04-22 04:29:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:29:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:29:16,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:29:16,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:29:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:29:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:29:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:30:02.556208+00:00 (in 46.003269 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:29:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:30:16 UTC)" (scheduled at 2024-04-22 04:29:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:29:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:29:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 29, 16, 553371), True, datetime.datetime(2024, 4, 22, 4, 29, 16, 553371), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:29:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:29:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:29:16,565 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:30:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:29:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:29:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:29:47.052354+00:00 (in 29.999485 seconds)
buildlogsarchiver stdout | 2024-04-22 04:29:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:29:47 UTC)" (scheduled at 2024-04-22 04:29:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:29:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 29, 17, 53215), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:29:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:29:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:29:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:29:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:29:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:29:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:29:23.759375+00:00 (in 3.996409 seconds)
notificationworker stdout | 2024-04-22 04:29:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:30:19 UTC)" (scheduled at 2024-04-22 04:29:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:29:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:29:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:30:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:29:21,615 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
namespacegcworker stdout | 2024-04-22 04:29:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:29:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:29:43.057186+00:00 (in 20.997705 seconds)
namespacegcworker stdout | 2024-04-22 04:29:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:30:22 UTC)" (scheduled at 2024-04-22 04:29:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:29:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:29:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:30:22 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:29:22,742 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
gunicorn-web stdout | 2024-04-22 04:29:22,866 [278] [DEBUG] [app] Starting request: urn:request:e0a48d78-c958-4ac9-b25f-1ba66ac81432 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:29:22,866 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:29:22,866 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:29:22,867 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:29:22,876 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:29:22,876 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:29:22,876 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:29:22,877 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:29:22,877 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:29:22,877 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:29:22,877 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:29:22,877 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:29:22,879 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:29:22,885 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:29:22,886 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:29:22,890 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:29:22,895 [278] [DEBUG] [app] Ending request: urn:request:e0a48d78-c958-4ac9-b25f-1ba66ac81432 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:e0a48d78-c958-4ac9-b25f-1ba66ac81432', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:29:22,895 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:29:22 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.031 1555 0.030)
gunicorn-web stdout | 2024-04-22 04:29:22,895 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:29:22 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
notificationworker stdout | 2024-04-22 04:29:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:29:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:29:33.759375+00:00 (in 9.999449 seconds)
notificationworker stdout | 2024-04-22 04:29:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:29:33 UTC)" (scheduled at 2024-04-22 04:29:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:29:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:29:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 29, 23, 760285), True, datetime.datetime(2024, 4, 22, 4, 29, 23, 760285), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:29:23,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:29:23,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:29:23,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:29:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:29:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:29:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:30:24.361582+00:00 (in 59.999470 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:29:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:30:24 UTC)" (scheduled at 2024-04-22 04:29:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:29:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:29:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:29:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:30:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:29:26,406 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:29:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:29:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:29:35.871852+00:00 (in 8.998204 seconds)
securityworker stdout | 2024-04-22 04:29:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:29:56 UTC)" (scheduled at 2024-04-22 04:29:26.873109+00:00)
securityworker stdout | 2024-04-22 04:29:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:29:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:29:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:29:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:29:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:29:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:29:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:29:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:29:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:29:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:29:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:29:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:29:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 24, 26, 881079), 1, 2])
securityworker stdout | 2024-04-22 04:29:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:29:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:29:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 24, 26, 881079), 1, 2])
securityworker stdout | 2024-04-22 04:29:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:29:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:29:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:29:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:29:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:29:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:29:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:29:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:29:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:29:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:29:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:29:28,157 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:29:29,504 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:29:29,564 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:29:30,514 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:29:30,568 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:29:30,606 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:29:30,653 [281] [DEBUG] [app] Starting request: urn:request:4dbbc0ac-3f33-44be-8d20-26d86c982b87 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:29:30,653 [278] [DEBUG] [app] Starting request: urn:request:3778c0d6-41cb-43be-862d-3d0d920f36e3 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:29:30,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:29:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:29:30,656 [284] [DEBUG] [app] Starting request: urn:request:3a4fb6a8-4a4f-4923-89b9-fd635b4089cb (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:29:30,656 [292] [DEBUG] [app] Starting request: urn:request:3690a51d-7430-4987-87bd-be70e433c9a8 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:29:30,656 [284] [DEBUG] [app] Ending request: urn:request:3a4fb6a8-4a4f-4923-89b9-fd635b4089cb (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:3a4fb6a8-4a4f-4923-89b9-fd635b4089cb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:29:30,657 [292] [DEBUG] [app] Ending request: urn:request:3690a51d-7430-4987-87bd-be70e433c9a8 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:3690a51d-7430-4987-87bd-be70e433c9a8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:29:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:29:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:29:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:29:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 04:29:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:29:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:29:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:29:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
gunicorn-web stdout | 2024-04-22 04:29:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:29:30,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:29:30,659 [282] [DEBUG] [app] Starting request: urn:request:e13d7520-464a-42ac-a7e2-80628239d0b3 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:29:30,660 [282] [DEBUG] [app] Ending request: urn:request:e13d7520-464a-42ac-a7e2-80628239d0b3 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e13d7520-464a-42ac-a7e2-80628239d0b3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:29:30,660 [281] [DEBUG] [app] Starting request: urn:request:266a6275-1e83-45a6-a96a-0034ef0f357d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:29:30,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:29:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:29:30,660 [281] [DEBUG] [app] Ending request: urn:request:266a6275-1e83-45a6-a96a-0034ef0f357d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:266a6275-1e83-45a6-a96a-0034ef0f357d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:29:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:29:30,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:29:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:29:30,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:29:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.000)
gunicorn-web stdout | 2024-04-22 04:29:30,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:29:30,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:29:30,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:29:30,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:29:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:29:30,674 [281] [DEBUG] [app] Ending request: urn:request:4dbbc0ac-3f33-44be-8d20-26d86c982b87 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:4dbbc0ac-3f33-44be-8d20-26d86c982b87', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:29:30,675 [278] [DEBUG] [app] Ending request: urn:request:3778c0d6-41cb-43be-862d-3d0d920f36e3 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:3778c0d6-41cb-43be-862d-3d0d920f36e3', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:29:30,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:29:30,675 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:29:30,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:29:30,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:29:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:29:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:29:30,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:29:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:29:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:29:30,753 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
quotatotalworker stdout | 2024-04-22 04:29:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:29:31,054 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:29:46.054492+00:00 (in 14.999506 seconds)
quotatotalworker stdout | 2024-04-22 04:29:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:29:46 UTC)" (scheduled at 2024-04-22 04:29:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:29:31,055 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:29:31,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:29:31,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:29:46 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:29:31,434 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:29:31,585 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotaregistrysizeworker stdout | 2024-04-22 04:29:32,463 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:29:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:29:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:29:43.759375+00:00 (in 9.999416 seconds)
notificationworker stdout | 2024-04-22 04:29:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:29:43 UTC)" (scheduled at 2024-04-22 04:29:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:29:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:29:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 29, 33, 760400), True, datetime.datetime(2024, 4, 22, 4, 29, 33, 760400), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:29:33,776 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:29:33,776 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:29:33,776 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:29:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:29:34,162 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:29:35,090 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:29:35,094 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:29:35,098 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
buildlogsarchiver stdout | 2024-04-22 04:29:35,473 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:29:35,496 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
securityworker stdout | 2024-04-22 04:29:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:29:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:29:56.873109+00:00 (in 21.000732 seconds)
securityworker stdout | 2024-04-22 04:29:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:30:05 UTC)" (scheduled at 2024-04-22 04:29:35.871852+00:00)
securityworker stdout | 2024-04-22 04:29:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:29:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:29:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:29:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:29:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:29:35,888 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:29:35,890 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:29:35,890 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:29:35,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 24, 35, 876234), 1, 2])
securityworker stdout | 2024-04-22 04:29:35,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:29:35,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:29:35,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 24, 35, 876234), 1, 2])
securityworker stdout | 2024-04-22 04:29:35,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:29:35,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:29:35,895 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:29:35,895 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:30:05 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:29:35,936 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
logrotateworker stdout | 2024-04-22 04:29:36,942 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:29:38,035 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:29:38,158 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:29:38,458 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:29:39,376 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
exportactionlogsworker stdout | 2024-04-22 04:29:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:29:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:29:41.564959+00:00 (in 1.997482 seconds)
exportactionlogsworker stdout | 2024-04-22 04:29:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:30:39 UTC)" (scheduled at 2024-04-22 04:29:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:29:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:29:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:30:39 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:29:40,588 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:29:40,602 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 04:29:41,010 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:29:41,052 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
autopruneworker stdout | 2024-04-22 04:29:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:29:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:30:11.264267+00:00 (in 29.999452 seconds)
autopruneworker stdout | 2024-04-22 04:29:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:30:11 UTC)" (scheduled at 2024-04-22 04:29:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:29:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713760121271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:29:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:29:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:29:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:30:11 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:29:41,482 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:29:41,484 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:29:41,500 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:29:41,504 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:29:41,507 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:29:41,511 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:29:41,515 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:29:41,518 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:29:41,520 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
exportactionlogsworker stdout | 2024-04-22 04:29:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:29:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:30:39.566970+00:00 (in 58.001556 seconds)
exportactionlogsworker stdout | 2024-04-22 04:29:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:30:41 UTC)" (scheduled at 2024-04-22 04:29:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:29:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:29:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 29, 41, 565738), True, datetime.datetime(2024, 4, 22, 4, 29, 41, 565738), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:29:41,581 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:29:41,582 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:29:41,582 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:30:41 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:29:42,506 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
namespacegcworker stdout | 2024-04-22 04:29:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:29:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:30:22.058978+00:00 (in 39.001295 seconds)
namespacegcworker stdout | 2024-04-22 04:29:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:30:43 UTC)" (scheduled at 2024-04-22 04:29:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:29:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:29:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 29, 43, 58081), True, datetime.datetime(2024, 4, 22, 4, 29, 43, 58081), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:29:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:29:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:29:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:30:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:29:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:29:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:29:53.759375+00:00 (in 9.999502 seconds)
notificationworker stdout | 2024-04-22 04:29:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:29:53 UTC)" (scheduled at 2024-04-22 04:29:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:29:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:29:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 29, 43, 760134), True, datetime.datetime(2024, 4, 22, 4, 29, 43, 760134), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:29:43,786 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:29:43,786 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:29:43,786 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:29:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:29:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:29:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:30:14.952062+00:00 (in 29.999533 seconds)
gcworker stdout | 2024-04-22 04:29:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:30:14 UTC)" (scheduled at 2024-04-22 04:29:44.952062+00:00)
gcworker stdout | 2024-04-22 04:29:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712550584952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:29:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:29:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:29:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:30:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:29:45,653 [278] [DEBUG] [app] Starting request: urn:request:2797d14a-0408-4b4b-a168-d4f99cf0303b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:29:45,653 [281] [DEBUG] [app] Starting request: urn:request:e4f7deea-08a3-4aba-b92d-05b092790453 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:29:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:29:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:29:45,656 [288] [DEBUG] [app] Starting request: urn:request:6ce9d0cc-8439-4947-adb9-c4afe93bbc20 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:29:45,656 [284] [DEBUG] [app] Starting request: urn:request:ceaf73b4-3234-4ff9-a809-75e5b6ebadd2 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:29:45,656 [288] [DEBUG] [app] Ending request: urn:request:6ce9d0cc-8439-4947-adb9-c4afe93bbc20 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:6ce9d0cc-8439-4947-adb9-c4afe93bbc20', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:29:45,656 [284] [DEBUG] [app] Ending request: urn:request:ceaf73b4-3234-4ff9-a809-75e5b6ebadd2 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:ceaf73b4-3234-4ff9-a809-75e5b6ebadd2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:29:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:29:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:29:45,657 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:29:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:29:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:29:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-web stdout | 2024-04-22 04:29:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:29:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:29:45,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:29:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:29:45,659 [281] [DEBUG] [app] Starting request: urn:request:19d96021-398a-42f4-9472-9c1ce5284096 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:29:45,659 [282] [DEBUG] [app] Starting request: urn:request:415cc2da-cca7-46ad-b3a8-30273df75318 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:29:45,659 [281] [DEBUG] [app] Ending request: urn:request:19d96021-398a-42f4-9472-9c1ce5284096 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:19d96021-398a-42f4-9472-9c1ce5284096', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:29:45,660 [282] [DEBUG] [app] Ending request: urn:request:415cc2da-cca7-46ad-b3a8-30273df75318 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:415cc2da-cca7-46ad-b3a8-30273df75318', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:29:45,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:29:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:29:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:29:45,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:29:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:29:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:29:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:29:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:29:45,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:29:45,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:29:45,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:29:45,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:29:45,674 [278] [DEBUG] [app] Ending request: urn:request:2797d14a-0408-4b4b-a168-d4f99cf0303b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2797d14a-0408-4b4b-a168-d4f99cf0303b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:29:45,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:29:45,675 [281] [DEBUG] [app] Ending request: urn:request:e4f7deea-08a3-4aba-b92d-05b092790453 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e4f7deea-08a3-4aba-b92d-05b092790453', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:29:45,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:29:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:29:45,675 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:29:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:29:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:29:45,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:29:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:29:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:29:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:30:01.054492+00:00 (in 14.999465 seconds)
quotatotalworker stdout | 2024-04-22 04:29:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:30:01 UTC)" (scheduled at 2024-04-22 04:29:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:29:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:29:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:29:46,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:30:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:29:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:29:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:30:17.052354+00:00 (in 29.999506 seconds)
buildlogsarchiver stdout | 2024-04-22 04:29:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:30:17 UTC)" (scheduled at 2024-04-22 04:29:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:29:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 29, 47, 53229), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:29:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:29:47,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:29:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:30:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:29:51,650 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:29:52,778 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:29:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:29:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:30:03.759375+00:00 (in 9.999474 seconds)
notificationworker stdout | 2024-04-22 04:29:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:30:03 UTC)" (scheduled at 2024-04-22 04:29:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:29:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:29:53,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 29, 53, 760184), True, datetime.datetime(2024, 4, 22, 4, 29, 53, 760184), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:29:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:29:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:29:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:30:03 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:29:53,987 [278] [DEBUG] [app] Starting request: urn:request:e522f136-a831-430e-9c23-9018ed9bdb98 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:29:53,987 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:29:53,987 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:29:53,988 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:29:53,997 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:29:53,997 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:29:53,997 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:29:53,997 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:29:53,997 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:29:53,997 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:29:53,997 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:29:53,998 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:29:54,000 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:29:54,006 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:29:54,007 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:29:54,011 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:29:54,016 [278] [DEBUG] [app] Ending request: urn:request:e522f136-a831-430e-9c23-9018ed9bdb98 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:e522f136-a831-430e-9c23-9018ed9bdb98', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:29:54,016 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:29:54,017 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:29:54 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:29:54 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.031 1536 0.031)
builder stdout | 2024-04-22 04:29:56,444 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:29:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:29:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:30:05.871852+00:00 (in 8.998250 seconds)
securityworker stdout | 2024-04-22 04:29:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:30:26 UTC)" (scheduled at 2024-04-22 04:29:56.873109+00:00)
securityworker stdout | 2024-04-22 04:29:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:29:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:29:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:29:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:29:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:29:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:29:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:29:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:29:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:29:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:29:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:29:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:29:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 24, 56, 881027), 1, 2])
securityworker stdout | 2024-04-22 04:29:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:29:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:29:56,900 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 24, 56, 881027), 1, 2])
securityworker stdout | 2024-04-22 04:29:56,903 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:29:56,903 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:29:56,903 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:29:56,903 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:29:56,903 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:29:56,903 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:29:56,903 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:29:56,904 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:29:56,904 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:29:56,904 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:30:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:29:58,194 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:29:59,541 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:29:59,600 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:30:00,522 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:30:00,579 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:30:00,617 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:30:00,653 [278] [DEBUG] [app] Starting request: urn:request:c90558be-96fd-420d-9f04-d33545056f33 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:30:00,653 [281] [DEBUG] [app] Starting request: urn:request:f721cc0c-1072-4076-9d35-2d423414a60a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:30:00,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:30:00,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:30:00,656 [291] [DEBUG] [app] Starting request: urn:request:684a8d47-7827-4ef4-8eea-2641b0e8f44c (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:30:00,656 [286] [DEBUG] [app] Starting request: urn:request:27b742fe-b641-439a-a638-54bc48e5e03a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:30:00,656 [286] [DEBUG] [app] Ending request: urn:request:27b742fe-b641-439a-a638-54bc48e5e03a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:27b742fe-b641-439a-a638-54bc48e5e03a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:30:00,656 [291] [DEBUG] [app] Ending request: urn:request:684a8d47-7827-4ef4-8eea-2641b0e8f44c (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:684a8d47-7827-4ef4-8eea-2641b0e8f44c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:30:00,656 [286] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:30:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:30:00,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:30:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:30:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:30:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:30:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:30:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:30:00,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:30:00,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:30:00,659 [278] [DEBUG] [app] Starting request: urn:request:cca535a5-3e52-44e9-81e1-c3ec05d523ba (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:30:00,659 [279] [DEBUG] [app] Starting request: urn:request:a9651ea8-0fec-4a4e-a57b-9d3bff610efc (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:30:00,659 [278] [DEBUG] [app] Ending request: urn:request:cca535a5-3e52-44e9-81e1-c3ec05d523ba (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:cca535a5-3e52-44e9-81e1-c3ec05d523ba', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:30:00,659 [279] [DEBUG] [app] Ending request: urn:request:a9651ea8-0fec-4a4e-a57b-9d3bff610efc (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a9651ea8-0fec-4a4e-a57b-9d3bff610efc', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:30:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:30:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:30:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:30:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.001)
gunicorn-web stdout | 2024-04-22 04:30:00,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:30:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:30:00,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:30:00,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:30:00,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:30:00,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:30:00,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:30:00,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:30:00,675 [278] [DEBUG] [app] Ending request: urn:request:c90558be-96fd-420d-9f04-d33545056f33 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:c90558be-96fd-420d-9f04-d33545056f33', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:30:00,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:30:00,675 [281] [DEBUG] [app] Ending request: urn:request:f721cc0c-1072-4076-9d35-2d423414a60a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f721cc0c-1072-4076-9d35-2d423414a60a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:30:00,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:30:00,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:30:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:30:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:30:00,676 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:30:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:30:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 04:30:00,685 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:30:00,765 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
quotatotalworker stdout | 2024-04-22 04:30:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:30:01,054 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:30:16.054492+00:00 (in 14.999506 seconds)
quotatotalworker stdout | 2024-04-22 04:30:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:30:16 UTC)" (scheduled at 2024-04-22 04:30:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:30:01,055 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:30:01,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:30:01,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:30:16 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:30:01,446 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:30:01,616 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotaregistrysizeworker stdout | 2024-04-22 04:30:02,473 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:30:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:30:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:30:16.552337+00:00 (in 13.995655 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:30:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:31:02 UTC)" (scheduled at 2024-04-22 04:30:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:30:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:30:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:31:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:30:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:30:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:30:13.759375+00:00 (in 9.999446 seconds)
notificationworker stdout | 2024-04-22 04:30:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:30:13 UTC)" (scheduled at 2024-04-22 04:30:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:30:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:30:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 30, 3, 760252), True, datetime.datetime(2024, 4, 22, 4, 30, 3, 760252), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:30:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:30:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:30:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:30:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:30:04,169 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:30:05,098 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:30:05,101 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:30:05,106 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
buildlogsarchiver stdout | 2024-04-22 04:30:05,507 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:30:05,531 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
securityworker stdout | 2024-04-22 04:30:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:30:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:30:26.873109+00:00 (in 21.000719 seconds)
securityworker stdout | 2024-04-22 04:30:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:30:35 UTC)" (scheduled at 2024-04-22 04:30:05.871852+00:00)
securityworker stdout | 2024-04-22 04:30:05,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:30:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:30:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:30:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:30:05,885 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:30:05,885 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:30:35 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:30:05,969 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
repositorygcworker stdout | 2024-04-22 04:30:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:30:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:30:13.555667+00:00 (in 7.002686 seconds)
repositorygcworker stdout | 2024-04-22 04:30:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:31:06 UTC)" (scheduled at 2024-04-22 04:30:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:30:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:30:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 30, 6, 553381), True, datetime.datetime(2024, 4, 22, 4, 30, 6, 553381), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:30:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:30:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:30:06,565 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:31:06 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:30:06,961 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:30:08,068 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:30:08,177 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:30:08,495 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:30:09,392 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:30:10,598 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:30:10,624 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 04:30:11,032 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:30:11,068 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
autopruneworker stdout | 2024-04-22 04:30:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:30:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:30:41.264267+00:00 (in 29.999522 seconds)
autopruneworker stdout | 2024-04-22 04:30:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:30:41 UTC)" (scheduled at 2024-04-22 04:30:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:30:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713760151271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:30:11,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:30:11,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:30:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:30:41 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:30:11,490 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:30:11,494 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:30:11,508 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:30:11,512 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:30:11,516 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:30:11,521 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:30:11,524 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:30:11,526 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:30:11,529 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
storagereplication stdout | 2024-04-22 04:30:12,527 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:30:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:30:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:31:06.552482+00:00 (in 52.996291 seconds)
repositorygcworker stdout | 2024-04-22 04:30:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:31:13 UTC)" (scheduled at 2024-04-22 04:30:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:30:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:30:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:31:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:30:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:30:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:30:19.762424+00:00 (in 6.002559 seconds)
notificationworker stdout | 2024-04-22 04:30:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:30:23 UTC)" (scheduled at 2024-04-22 04:30:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:30:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:30:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 30, 13, 760165), True, datetime.datetime(2024, 4, 22, 4, 30, 13, 760165), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:30:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:30:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:30:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:30:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:30:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:30:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:30:44.952062+00:00 (in 29.999538 seconds)
gcworker stdout | 2024-04-22 04:30:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:30:44 UTC)" (scheduled at 2024-04-22 04:30:14.952062+00:00)
gcworker stdout | 2024-04-22 04:30:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712550614952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:30:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:30:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:30:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:30:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:30:15,501 [282] [DEBUG] [app] Starting request: urn:request:1730cce7-c053-48d1-be58-6ee93862201c (/api/v1/user/notifications) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:30:15,502 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:30:15,502 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:30:15,502 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:30:15,523 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:30:15,524 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:30:15,524 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:30:15,524 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:30:15,524 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:30:15,524 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:30:15,524 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:30:15,524 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:30:15,526 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."dismissed" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."dismissed" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', [False, 1, False, 1, 'admin', 6])
gunicorn-web stdout | 2024-04-22 04:30:15,532 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:30:15,534 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:30:15,536 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:30:15,539 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:30:15,541 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:30:15,543 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:30:15,545 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:30:15,547 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:30:15,550 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:30:15,552 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [10, 1, 0])
gunicorn-web stdout | 2024-04-22 04:30:15,554 [282] [DEBUG] [app] Ending request: urn:request:1730cce7-c053-48d1-be58-6ee93862201c (/api/v1/user/notifications) {'endpoint': 'api.usernotificationlist', 'request_id': 'urn:request:1730cce7-c053-48d1-be58-6ee93862201c', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/notifications', 'path': '/api/v1/user/notifications', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:30:15,554 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:30:15,555 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:30:15 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 3386 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:30:15 +0000] "GET /api/v1/user/notifications HTTP/1.1" 200 3386 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.055 1530 0.055)
gunicorn-web stdout | 2024-04-22 04:30:15,653 [282] [DEBUG] [app] Starting request: urn:request:6625eced-9f0b-40f8-ad93-37af0cd8f0c4 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:30:15,653 [281] [DEBUG] [app] Starting request: urn:request:f1e7ae71-7221-4e4b-9120-2d6c3a9f53cd (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:30:15,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:30:15,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:30:15,656 [284] [DEBUG] [app] Starting request: urn:request:0c36470a-342d-4716-878d-b589104914ff (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:30:15,656 [284] [DEBUG] [app] Ending request: urn:request:0c36470a-342d-4716-878d-b589104914ff (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:0c36470a-342d-4716-878d-b589104914ff', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:30:15,656 [292] [DEBUG] [app] Starting request: urn:request:9db583c2-9e97-4d9c-b91d-d31ed8aaebdd (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:30:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:30:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:30:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:30:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:30:15,657 [292] [DEBUG] [app] Ending request: urn:request:9db583c2-9e97-4d9c-b91d-d31ed8aaebdd (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:9db583c2-9e97-4d9c-b91d-d31ed8aaebdd', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:30:15,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:30:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:30:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:30:15,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:30:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:30:15,659 [282] [DEBUG] [app] Starting request: urn:request:9a440ac0-5b28-4c63-a28f-45aca2070984 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:30:15,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:30:15,659 [282] [DEBUG] [app] Ending request: urn:request:9a440ac0-5b28-4c63-a28f-45aca2070984 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9a440ac0-5b28-4c63-a28f-45aca2070984', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:30:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:30:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:30:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:30:15,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:30:15,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:30:15,661 [279] [DEBUG] [app] Starting request: urn:request:c023c810-4521-4f63-9ebb-1d0db9415062 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:30:15,661 [279] [DEBUG] [app] Ending request: urn:request:c023c810-4521-4f63-9ebb-1d0db9415062 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:c023c810-4521-4f63-9ebb-1d0db9415062', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:30:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:30:15,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:30:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:30:15,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:30:15,662 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:30:15,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:30:15,668 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:30:15,674 [282] [DEBUG] [app] Ending request: urn:request:6625eced-9f0b-40f8-ad93-37af0cd8f0c4 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:6625eced-9f0b-40f8-ad93-37af0cd8f0c4', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:30:15,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:30:15,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:30:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:30:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:30:15,676 [281] [DEBUG] [app] Ending request: urn:request:f1e7ae71-7221-4e4b-9120-2d6c3a9f53cd (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f1e7ae71-7221-4e4b-9120-2d6c3a9f53cd', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:30:15,676 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:30:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.025)
gunicorn-web stdout | 2024-04-22 04:30:15,677 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:30:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:30:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:30:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:30:31.054492+00:00 (in 14.999467 seconds)
quotatotalworker stdout | 2024-04-22 04:30:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:30:31 UTC)" (scheduled at 2024-04-22 04:30:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:30:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:30:16,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:30:16,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:30:31 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:30:16,219 [279] [DEBUG] [app] Starting request: urn:request:ec0caff0-4cca-4ac0-a402-cc4c34d1b791 (/api/v1/user/apptoken) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:30:16,219 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:30:16,219 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:30:16,220 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:30:16,229 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:30:16,229 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:30:16,229 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:30:16,229 [279] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:30:16,229 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:30:16,229 [279] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:30:16,229 [279] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:30:16,229 [279] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:30:16,230 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."uuid", "t1"."title", "t1"."token_name", "t1"."token_secret", "t1"."created", "t1"."expiration", "t1"."last_accessed" FROM "appspecificauthtoken" AS "t1" WHERE ((("t1"."user_id" = %s) AND ("t1"."expiration" <= %s)) AND ("t1"."expiration" > %s))', [1, datetime.datetime(2024, 4, 24, 23, 42, 16, 229815), datetime.datetime(2024, 4, 22, 4, 30, 16, 229858)])
gunicorn-web stdout | 2024-04-22 04:30:16,232 [279] [DEBUG] [app] Ending request: urn:request:ec0caff0-4cca-4ac0-a402-cc4c34d1b791 (/api/v1/user/apptoken) {'endpoint': 'api.apptokens', 'request_id': 'urn:request:ec0caff0-4cca-4ac0-a402-cc4c34d1b791', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/apptoken?expiring=true', 'path': '/api/v1/user/apptoken', 'parameters': {'expiring': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:30:16,233 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:30:16,233 [279] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:30:16 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:30:16 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.1" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.015 1520 0.015)
securityscanningnotificationworker stdout | 2024-04-22 04:30:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:30:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:31:02.556208+00:00 (in 46.003322 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:30:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:31:16 UTC)" (scheduled at 2024-04-22 04:30:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:30:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:30:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 30, 16, 553309), True, datetime.datetime(2024, 4, 22, 4, 30, 16, 553309), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:30:16,569 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:30:16,569 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:30:16,569 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:31:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:30:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:30:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:30:47.052354+00:00 (in 29.999406 seconds)
buildlogsarchiver stdout | 2024-04-22 04:30:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:30:47 UTC)" (scheduled at 2024-04-22 04:30:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:30:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 30, 17, 53328), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:30:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:30:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:30:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:30:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:30:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:30:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:30:23.759375+00:00 (in 3.996459 seconds)
notificationworker stdout | 2024-04-22 04:30:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:31:19 UTC)" (scheduled at 2024-04-22 04:30:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:30:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:30:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:31:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:30:21,663 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
namespacegcworker stdout | 2024-04-22 04:30:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:30:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:30:43.057186+00:00 (in 20.997664 seconds)
namespacegcworker stdout | 2024-04-22 04:30:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:31:22 UTC)" (scheduled at 2024-04-22 04:30:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:30:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:30:22,060 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:31:22 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:30:22,816 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:30:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:30:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:30:33.759375+00:00 (in 9.999440 seconds)
notificationworker stdout | 2024-04-22 04:30:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:30:33 UTC)" (scheduled at 2024-04-22 04:30:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:30:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:30:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 30, 23, 760248), True, datetime.datetime(2024, 4, 22, 4, 30, 23, 760248), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:30:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:30:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:30:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:30:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:30:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:30:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:31:24.361582+00:00 (in 59.999460 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:30:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:31:24 UTC)" (scheduled at 2024-04-22 04:30:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:30:24,363 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
gunicorn-web stdout | 2024-04-22 04:30:24,372 [282] [DEBUG] [app] Starting request: urn:request:462961d0-18f6-425d-b875-393d4d2febee (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:30:24,372 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:30:24,372 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
quotaregistrysizeworker stdout | 2024-04-22 04:30:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:30:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:31:24 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:30:24,373 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:30:24,381 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:30:24,382 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:30:24,382 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:30:24,382 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:30:24,382 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:30:24,382 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:30:24,382 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:30:24,382 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:30:24,384 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:30:24,391 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:30:24,392 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:30:24,397 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:30:24,401 [282] [DEBUG] [app] Ending request: urn:request:462961d0-18f6-425d-b875-393d4d2febee (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:462961d0-18f6-425d-b875-393d4d2febee', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:30:24,401 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:30:24 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.032 1536 0.032)
gunicorn-web stdout | 2024-04-22 04:30:24,402 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:30:24 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
builder stdout | 2024-04-22 04:30:26,467 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:30:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:30:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:30:35.871852+00:00 (in 8.998192 seconds)
securityworker stdout | 2024-04-22 04:30:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:30:56 UTC)" (scheduled at 2024-04-22 04:30:26.873109+00:00)
securityworker stdout | 2024-04-22 04:30:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:30:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:30:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:30:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:30:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:30:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:30:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:30:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:30:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:30:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:30:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:30:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:30:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 25, 26, 881281), 1, 2])
securityworker stdout | 2024-04-22 04:30:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:30:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:30:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 25, 26, 881281), 1, 2])
securityworker stdout | 2024-04-22 04:30:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:30:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:30:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:30:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:30:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:30:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:30:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:30:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:30:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:30:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:30:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:30:28,230 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:30:29,553 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:30:29,608 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:30:30,531 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:30:30,589 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:30:30,627 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:30:30,653 [282] [DEBUG] [app] Starting request: urn:request:0f42732b-b15f-41e5-a73d-0c147d91f479 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:30:30,653 [279] [DEBUG] [app] Starting request: urn:request:a223372c-a7cc-450a-9761-692c9dd6d145 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:30:30,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:30:30,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:30:30,656 [292] [DEBUG] [app] Starting request: urn:request:efedf687-66a5-490b-b23f-a4ec78ef51e7 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:30:30,656 [284] [DEBUG] [app] Starting request: urn:request:1e16f601-8344-447d-bb69-393124ba257f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:30:30,657 [292] [DEBUG] [app] Ending request: urn:request:efedf687-66a5-490b-b23f-a4ec78ef51e7 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:efedf687-66a5-490b-b23f-a4ec78ef51e7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:30:30,657 [284] [DEBUG] [app] Ending request: urn:request:1e16f601-8344-447d-bb69-393124ba257f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:1e16f601-8344-447d-bb69-393124ba257f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:30:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:30:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:30:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:30:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:30:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:30:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:30:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:30:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:30:30,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:30:30,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:30:30,660 [282] [DEBUG] [app] Starting request: urn:request:ea5ea9e3-c093-4445-b638-2a4ebb939dbd (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:30:30,660 [278] [DEBUG] [app] Starting request: urn:request:b5b0a7d7-685a-4811-bbdb-298223d7e0ed (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:30:30,660 [282] [DEBUG] [app] Ending request: urn:request:ea5ea9e3-c093-4445-b638-2a4ebb939dbd (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:ea5ea9e3-c093-4445-b638-2a4ebb939dbd', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:30:30,660 [278] [DEBUG] [app] Ending request: urn:request:b5b0a7d7-685a-4811-bbdb-298223d7e0ed (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b5b0a7d7-685a-4811-bbdb-298223d7e0ed', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:30:30,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:30:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:30:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:30:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:30:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:30:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:30:30,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:30:30,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:30:30,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:30:30,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:30:30,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:30:30,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:30:30,674 [282] [DEBUG] [app] Ending request: urn:request:0f42732b-b15f-41e5-a73d-0c147d91f479 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:0f42732b-b15f-41e5-a73d-0c147d91f479', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:30:30,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:30:30,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:30:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:30:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:30:30,675 [279] [DEBUG] [app] Ending request: urn:request:a223372c-a7cc-450a-9761-692c9dd6d145 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a223372c-a7cc-450a-9761-692c9dd6d145', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:30:30,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:30:30,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:30:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:30:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:30:30,696 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:30:30,778 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
quotatotalworker stdout | 2024-04-22 04:30:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:30:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:30:46.054492+00:00 (in 14.999447 seconds)
quotatotalworker stdout | 2024-04-22 04:30:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:30:46 UTC)" (scheduled at 2024-04-22 04:30:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:30:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:30:31,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:30:31,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:30:46 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:30:31,476 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:30:31,624 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotaregistrysizeworker stdout | 2024-04-22 04:30:32,510 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:30:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:30:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:30:43.759375+00:00 (in 9.999432 seconds)
notificationworker stdout | 2024-04-22 04:30:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:30:43 UTC)" (scheduled at 2024-04-22 04:30:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:30:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:30:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 30, 33, 760239), True, datetime.datetime(2024, 4, 22, 4, 30, 33, 760239), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:30:33,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:30:33,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:30:33,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:30:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:30:34,205 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:30:35,106 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:30:35,109 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:30:35,113 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
buildlogsarchiver stdout | 2024-04-22 04:30:35,544 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:30:35,568 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
securityworker stdout | 2024-04-22 04:30:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:30:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:30:56.873109+00:00 (in 21.000762 seconds)
securityworker stdout | 2024-04-22 04:30:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:31:05 UTC)" (scheduled at 2024-04-22 04:30:35.871852+00:00)
securityworker stdout | 2024-04-22 04:30:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:30:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:30:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:30:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:30:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:30:35,888 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:30:35,890 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:30:35,890 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:30:35,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 25, 35, 876303), 1, 2])
securityworker stdout | 2024-04-22 04:30:35,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:30:35,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:30:35,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 25, 35, 876303), 1, 2])
securityworker stdout | 2024-04-22 04:30:35,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:30:35,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:30:35,896 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:30:35,896 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:31:05 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:30:35,993 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
logrotateworker stdout | 2024-04-22 04:30:36,969 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:30:38,084 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:30:38,190 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:30:38,529 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:30:39,409 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
exportactionlogsworker stdout | 2024-04-22 04:30:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:30:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:30:41.564959+00:00 (in 1.997490 seconds)
exportactionlogsworker stdout | 2024-04-22 04:30:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:31:39 UTC)" (scheduled at 2024-04-22 04:30:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:30:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:30:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:31:39 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:30:40,616 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:30:40,660 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 04:30:41,069 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:30:41,105 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
autopruneworker stdout | 2024-04-22 04:30:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:30:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:31:11.264267+00:00 (in 29.999501 seconds)
autopruneworker stdout | 2024-04-22 04:30:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:31:11 UTC)" (scheduled at 2024-04-22 04:30:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:30:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713760181272, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:30:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:30:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:30:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:31:11 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:30:41,499 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:30:41,502 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:30:41,516 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:30:41,521 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:30:41,524 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:30:41,529 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:30:41,534 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:30:41,539 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:30:41,541 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
exportactionlogsworker stdout | 2024-04-22 04:30:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:30:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:31:39.566970+00:00 (in 58.001505 seconds)
exportactionlogsworker stdout | 2024-04-22 04:30:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:31:41 UTC)" (scheduled at 2024-04-22 04:30:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:30:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:30:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 30, 41, 565895), True, datetime.datetime(2024, 4, 22, 4, 30, 41, 565895), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:30:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:30:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:30:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:31:41 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:30:42,550 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
namespacegcworker stdout | 2024-04-22 04:30:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:30:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:31:22.058978+00:00 (in 39.001279 seconds)
namespacegcworker stdout | 2024-04-22 04:30:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:31:43 UTC)" (scheduled at 2024-04-22 04:30:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:30:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:30:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 30, 43, 58086), True, datetime.datetime(2024, 4, 22, 4, 30, 43, 58086), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:30:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:30:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:30:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:31:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:30:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:30:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:30:53.759375+00:00 (in 9.999499 seconds)
notificationworker stdout | 2024-04-22 04:30:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:30:53 UTC)" (scheduled at 2024-04-22 04:30:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:30:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:30:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 30, 43, 760132), True, datetime.datetime(2024, 4, 22, 4, 30, 43, 760132), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:30:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:30:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:30:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:30:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:30:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:30:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:31:14.952062+00:00 (in 29.999517 seconds)
gcworker stdout | 2024-04-22 04:30:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:31:14 UTC)" (scheduled at 2024-04-22 04:30:44.952062+00:00)
gcworker stdout | 2024-04-22 04:30:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712550644952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:30:44,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:30:44,964 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:30:44,964 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:31:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:30:45,653 [281] [DEBUG] [app] Starting request: urn:request:29dea322-34a7-44a5-8a42-bde3eebbfd16 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:30:45,653 [282] [DEBUG] [app] Starting request: urn:request:7f7fad0b-92fe-4fc4-96fe-98082ac9ab2a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:30:45,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:30:45,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:30:45,657 [292] [DEBUG] [app] Starting request: urn:request:6b0323b6-bde0-40c4-b2a4-6db9d61263c2 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:30:45,657 [290] [DEBUG] [app] Starting request: urn:request:2f36eb37-031c-4a46-ac38-f40b125a2af2 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:30:45,657 [292] [DEBUG] [app] Ending request: urn:request:6b0323b6-bde0-40c4-b2a4-6db9d61263c2 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:6b0323b6-bde0-40c4-b2a4-6db9d61263c2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:30:45,657 [290] [DEBUG] [app] Ending request: urn:request:2f36eb37-031c-4a46-ac38-f40b125a2af2 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:2f36eb37-031c-4a46-ac38-f40b125a2af2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:30:45,658 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:30:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:30:45,658 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:30:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:30:45,658 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:30:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:30:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:30:45,658 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:30:45,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:30:45,660 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:30:45,660 [281] [DEBUG] [app] Starting request: urn:request:5f918814-3f9c-42f5-a4f0-63de2a6847e8 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:30:45,661 [281] [DEBUG] [app] Ending request: urn:request:5f918814-3f9c-42f5-a4f0-63de2a6847e8 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:5f918814-3f9c-42f5-a4f0-63de2a6847e8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:30:45,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:30:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:30:45,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:30:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:30:45,662 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:30:45,662 [278] [DEBUG] [app] Starting request: urn:request:dfc0cafc-a398-4b73-87e2-b15a023ec7e2 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:30:45,662 [278] [DEBUG] [app] Ending request: urn:request:dfc0cafc-a398-4b73-87e2-b15a023ec7e2 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:dfc0cafc-a398-4b73-87e2-b15a023ec7e2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:30:45,662 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:30:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:30:45,663 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:30:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:30:45,663 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:30:45,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:30:45,669 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:30:45,675 [281] [DEBUG] [app] Ending request: urn:request:29dea322-34a7-44a5-8a42-bde3eebbfd16 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:29dea322-34a7-44a5-8a42-bde3eebbfd16', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:30:45,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:30:45,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:30:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:30:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:30:45,676 [282] [DEBUG] [app] Ending request: urn:request:7f7fad0b-92fe-4fc4-96fe-98082ac9ab2a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:7f7fad0b-92fe-4fc4-96fe-98082ac9ab2a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:30:45,676 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:30:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
gunicorn-web stdout | 2024-04-22 04:30:45,677 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:30:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:30:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:30:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:31:01.054492+00:00 (in 14.999434 seconds)
quotatotalworker stdout | 2024-04-22 04:30:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:31:01 UTC)" (scheduled at 2024-04-22 04:30:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:30:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:30:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:30:46,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:31:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:30:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:30:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:31:17.052354+00:00 (in 29.999442 seconds)
buildlogsarchiver stdout | 2024-04-22 04:30:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:31:17 UTC)" (scheduled at 2024-04-22 04:30:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:30:47,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 30, 47, 53311), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:30:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:30:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:30:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:31:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:30:51,700 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:30:52,827 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:30:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:30:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:31:03.759375+00:00 (in 9.999433 seconds)
notificationworker stdout | 2024-04-22 04:30:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:31:03 UTC)" (scheduled at 2024-04-22 04:30:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:30:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:30:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 30, 53, 760270), True, datetime.datetime(2024, 4, 22, 4, 30, 53, 760270), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:30:53,785 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:30:53,786 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:30:53,786 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:31:03 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:30:55,556 [278] [DEBUG] [app] Starting request: urn:request:eeff22c6-8852-4080-8867-34029bd17d96 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:30:55,556 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:30:55,556 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:30:55,557 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:30:55,566 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:30:55,566 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:30:55,566 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:30:55,566 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:30:55,566 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:30:55,566 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:30:55,566 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:30:55,566 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:30:55,568 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:30:55,575 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:30:55,576 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:30:55,580 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:30:55,585 [278] [DEBUG] [app] Ending request: urn:request:eeff22c6-8852-4080-8867-34029bd17d96 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:eeff22c6-8852-4080-8867-34029bd17d96', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:30:55,586 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:30:55 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.031 1536 0.031)
gunicorn-web stdout | 2024-04-22 04:30:55,586 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:30:55 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
builder stdout | 2024-04-22 04:30:56,504 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:30:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:30:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:31:05.871852+00:00 (in 8.998236 seconds)
securityworker stdout | 2024-04-22 04:30:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:31:26 UTC)" (scheduled at 2024-04-22 04:30:56.873109+00:00)
securityworker stdout | 2024-04-22 04:30:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:30:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:30:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:30:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:30:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:30:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:30:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:30:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:30:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:30:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:30:56,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:30:56,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:30:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 25, 56, 880941), 1, 2])
securityworker stdout | 2024-04-22 04:30:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:30:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:30:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 25, 56, 880941), 1, 2])
securityworker stdout | 2024-04-22 04:30:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:30:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:30:56,900 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:30:56,900 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:30:56,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:30:56,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:30:56,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:30:56,901 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:30:56,901 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:30:56,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:31:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:30:58,266 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:30:59,582 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:30:59,647 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:31:00,539 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:31:00,599 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:31:00,637 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:31:00,652 [281] [DEBUG] [app] Starting request: urn:request:d3bb0fe0-957f-440c-a578-783adb8d2b96 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:31:00,652 [279] [DEBUG] [app] Starting request: urn:request:3e1083f6-96eb-4f26-821a-4694a1cdc7ec (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:31:00,653 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:31:00,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:31:00,655 [284] [DEBUG] [app] Starting request: urn:request:d15639a0-f92d-499f-b827-3987a1cdb2f4 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:31:00,655 [284] [DEBUG] [app] Ending request: urn:request:d15639a0-f92d-499f-b827-3987a1cdb2f4 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:d15639a0-f92d-499f-b827-3987a1cdb2f4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:31:00,655 [292] [DEBUG] [app] Starting request: urn:request:3a2a55ac-497e-4549-a2a8-002fc821de7f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:31:00,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:31:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:31:00,656 [292] [DEBUG] [app] Ending request: urn:request:3a2a55ac-497e-4549-a2a8-002fc821de7f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:3a2a55ac-497e-4549-a2a8-002fc821de7f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:31:00,656 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:31:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:31:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:31:00,656 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:31:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:31:00,656 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:31:00,657 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:31:00,657 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:31:00,658 [278] [DEBUG] [app] Starting request: urn:request:4b9c21f6-197c-4870-bb3d-4632db14e5eb (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:31:00,659 [278] [DEBUG] [app] Ending request: urn:request:4b9c21f6-197c-4870-bb3d-4632db14e5eb (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:4b9c21f6-197c-4870-bb3d-4632db14e5eb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:31:00,659 [282] [DEBUG] [app] Starting request: urn:request:c4cde8d8-2a0b-46dd-81a5-ced79c6337d3 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:31:00,659 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:31:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:31:00,659 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:31:00,659 [282] [DEBUG] [app] Ending request: urn:request:c4cde8d8-2a0b-46dd-81a5-ced79c6337d3 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:c4cde8d8-2a0b-46dd-81a5-ced79c6337d3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:31:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:31:00,659 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:31:00,659 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:31:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:31:00,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:31:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:31:00,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:31:00,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:31:00,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:31:00,673 [281] [DEBUG] [app] Ending request: urn:request:d3bb0fe0-957f-440c-a578-783adb8d2b96 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:d3bb0fe0-957f-440c-a578-783adb8d2b96', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:31:00,673 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:31:00,674 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:31:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:31:00,674 [279] [DEBUG] [app] Ending request: urn:request:3e1083f6-96eb-4f26-821a-4694a1cdc7ec (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:3e1083f6-96eb-4f26-821a-4694a1cdc7ec', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:31:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:31:00,674 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:31:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.022)
gunicorn-web stdout | 2024-04-22 04:31:00,674 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:31:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:31:00,707 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:31:00,791 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
quotatotalworker stdout | 2024-04-22 04:31:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:31:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:31:16.054492+00:00 (in 14.999454 seconds)
quotatotalworker stdout | 2024-04-22 04:31:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:31:16 UTC)" (scheduled at 2024-04-22 04:31:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:31:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:31:01,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:31:01,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:31:16 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:31:01,513 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:31:01,660 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotaregistrysizeworker stdout | 2024-04-22 04:31:02,547 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
securityscanningnotificationworker stdout | 2024-04-22 04:31:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:31:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:31:16.552337+00:00 (in 13.995626 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:31:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:32:02 UTC)" (scheduled at 2024-04-22 04:31:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:31:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:31:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:32:02 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:31:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:31:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:31:13.759375+00:00 (in 9.999451 seconds)
notificationworker stdout | 2024-04-22 04:31:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:31:13 UTC)" (scheduled at 2024-04-22 04:31:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:31:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:31:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 31, 3, 760254), True, datetime.datetime(2024, 4, 22, 4, 31, 3, 760254), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:31:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:31:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:31:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:31:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:31:04,242 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:31:05,115 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:31:05,117 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:31:05,120 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
buildlogsarchiver stdout | 2024-04-22 04:31:05,551 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:31:05,579 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
securityworker stdout | 2024-04-22 04:31:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:31:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:31:26.873109+00:00 (in 21.000765 seconds)
securityworker stdout | 2024-04-22 04:31:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:31:35 UTC)" (scheduled at 2024-04-22 04:31:05.871852+00:00)
securityworker stdout | 2024-04-22 04:31:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:31:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:31:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:31:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:31:05,885 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:31:05,885 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:31:35 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:31:06,028 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
repositorygcworker stdout | 2024-04-22 04:31:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:31:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:31:13.555667+00:00 (in 7.002596 seconds)
repositorygcworker stdout | 2024-04-22 04:31:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:32:06 UTC)" (scheduled at 2024-04-22 04:31:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:31:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:31:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 31, 6, 553481), True, datetime.datetime(2024, 4, 22, 4, 31, 6, 553481), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:31:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:31:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:31:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:32:06 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:31:06,976 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:31:08,121 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:31:08,209 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:31:08,544 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:31:09,425 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:31:10,641 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:31:10,673 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 04:31:11,099 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:31:11,113 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
autopruneworker stdout | 2024-04-22 04:31:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:31:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:31:41.264267+00:00 (in 29.999464 seconds)
autopruneworker stdout | 2024-04-22 04:31:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:31:41 UTC)" (scheduled at 2024-04-22 04:31:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:31:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713760211271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:31:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:31:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:31:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:31:41 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:31:11,509 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:31:11,511 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:31:11,528 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:31:11,531 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:31:11,534 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:31:11,538 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:31:11,541 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:31:11,548 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:31:11,552 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
storagereplication stdout | 2024-04-22 04:31:12,587 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:31:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:31:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:31:51.555445+00:00 (in 37.999242 seconds)
repositorygcworker stdout | 2024-04-22 04:31:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:32:13 UTC)" (scheduled at 2024-04-22 04:31:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:31:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:31:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:32:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:31:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:31:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:31:19.762424+00:00 (in 6.002572 seconds)
notificationworker stdout | 2024-04-22 04:31:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:31:23 UTC)" (scheduled at 2024-04-22 04:31:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:31:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:31:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 31, 13, 760132), True, datetime.datetime(2024, 4, 22, 4, 31, 13, 760132), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:31:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:31:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:31:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:31:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:31:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:31:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:31:44.952062+00:00 (in 29.999501 seconds)
gcworker stdout | 2024-04-22 04:31:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:31:44 UTC)" (scheduled at 2024-04-22 04:31:14.952062+00:00)
gcworker stdout | 2024-04-22 04:31:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712550674952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:31:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:31:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:31:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:31:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:31:15,653 [278] [DEBUG] [app] Starting request: urn:request:b0437108-04ae-4a7b-aeba-fb4f612a83ae (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:31:15,653 [282] [DEBUG] [app] Starting request: urn:request:1627112f-8286-45f1-a9b5-6c737c10d829 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:31:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:31:15,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:31:15,656 [290] [DEBUG] [app] Starting request: urn:request:0cac7c97-2c1b-4e2a-9295-b230479e59d1 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:31:15,656 [284] [DEBUG] [app] Starting request: urn:request:01f03e3d-307b-40b6-8b41-6ca62bdddb2b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:31:15,656 [290] [DEBUG] [app] Ending request: urn:request:0cac7c97-2c1b-4e2a-9295-b230479e59d1 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:0cac7c97-2c1b-4e2a-9295-b230479e59d1', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:31:15,657 [284] [DEBUG] [app] Ending request: urn:request:01f03e3d-307b-40b6-8b41-6ca62bdddb2b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:01f03e3d-307b-40b6-8b41-6ca62bdddb2b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:31:15,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:31:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:31:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:31:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:31:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:31:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:31:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:31:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:31:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:31:15,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:31:15,660 [281] [DEBUG] [app] Starting request: urn:request:bdf5acbb-c9ab-4a67-b871-d64c12313e7d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:31:15,660 [281] [DEBUG] [app] Ending request: urn:request:bdf5acbb-c9ab-4a67-b871-d64c12313e7d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:bdf5acbb-c9ab-4a67-b871-d64c12313e7d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:31:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:31:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:31:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:31:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:31:15,661 [279] [DEBUG] [app] Starting request: urn:request:7b665229-1308-4d39-9a4c-ca47a926d22e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:31:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:31:15,661 [279] [DEBUG] [app] Ending request: urn:request:7b665229-1308-4d39-9a4c-ca47a926d22e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:7b665229-1308-4d39-9a4c-ca47a926d22e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:31:15,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:31:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:31:15,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:31:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:31:15,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:31:15,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:31:15,669 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:31:15,675 [282] [DEBUG] [app] Ending request: urn:request:1627112f-8286-45f1-a9b5-6c737c10d829 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:1627112f-8286-45f1-a9b5-6c737c10d829', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:31:15,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:31:15,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:31:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:31:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 04:31:15,676 [278] [DEBUG] [app] Ending request: urn:request:b0437108-04ae-4a7b-aeba-fb4f612a83ae (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b0437108-04ae-4a7b-aeba-fb4f612a83ae', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:31:15,677 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:31:15,677 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:31:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:31:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
quotatotalworker stdout | 2024-04-22 04:31:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:31:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:31:31.054492+00:00 (in 14.999459 seconds)
quotatotalworker stdout | 2024-04-22 04:31:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:31:31 UTC)" (scheduled at 2024-04-22 04:31:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:31:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:31:16,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:31:16,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:31:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:31:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:31:16,553 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:32:02.556208+00:00 (in 46.003175 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:31:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:32:16 UTC)" (scheduled at 2024-04-22 04:31:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:31:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:31:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 31, 16, 553459), True, datetime.datetime(2024, 4, 22, 4, 31, 16, 553459), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:31:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:31:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:31:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:32:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:31:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:31:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:31:47.052354+00:00 (in 29.999468 seconds)
buildlogsarchiver stdout | 2024-04-22 04:31:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:31:47 UTC)" (scheduled at 2024-04-22 04:31:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:31:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 31, 17, 53255), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:31:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:31:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:31:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:31:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:31:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:31:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:31:23.759375+00:00 (in 3.996483 seconds)
notificationworker stdout | 2024-04-22 04:31:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:32:19 UTC)" (scheduled at 2024-04-22 04:31:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:31:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:31:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:32:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:31:21,712 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
namespacegcworker stdout | 2024-04-22 04:31:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:31:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:31:43.057186+00:00 (in 20.997673 seconds)
namespacegcworker stdout | 2024-04-22 04:31:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:32:22 UTC)" (scheduled at 2024-04-22 04:31:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:31:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:31:22,060 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:32:22 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:31:22,839 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:31:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:31:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:31:33.759375+00:00 (in 9.999542 seconds)
notificationworker stdout | 2024-04-22 04:31:23,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:31:33 UTC)" (scheduled at 2024-04-22 04:31:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:31:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:31:23,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 31, 23, 760105), True, datetime.datetime(2024, 4, 22, 4, 31, 23, 760105), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:31:23,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:31:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:31:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:31:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:31:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:31:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:32:24.361582+00:00 (in 59.999458 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:31:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:32:24 UTC)" (scheduled at 2024-04-22 04:31:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:31:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:31:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:31:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:32:24 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:31:25,951 [278] [DEBUG] [app] Starting request: urn:request:8c5cebd7-4f45-457b-8b75-d8779de8b41a (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:31:25,951 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:31:25,951 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:31:25,952 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:31:25,960 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:31:25,961 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:31:25,961 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:31:25,961 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:31:25,961 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:31:25,961 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:31:25,961 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:31:25,961 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:31:25,963 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:31:25,970 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:31:25,971 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:31:25,975 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:31:25,980 [278] [DEBUG] [app] Ending request: urn:request:8c5cebd7-4f45-457b-8b75-d8779de8b41a (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:8c5cebd7-4f45-457b-8b75-d8779de8b41a', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:31:25,980 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:31:25,980 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:31:25 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:31:25 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1555 0.030)
builder stdout | 2024-04-22 04:31:26,525 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:31:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:31:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:31:35.871852+00:00 (in 8.998278 seconds)
securityworker stdout | 2024-04-22 04:31:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:31:56 UTC)" (scheduled at 2024-04-22 04:31:26.873109+00:00)
securityworker stdout | 2024-04-22 04:31:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:31:26,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:31:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:31:26,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:31:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:31:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:31:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:31:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:31:26,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:31:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:31:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:31:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:31:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 26, 26, 880690), 1, 2])
securityworker stdout | 2024-04-22 04:31:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:31:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:31:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 26, 26, 880690), 1, 2])
securityworker stdout | 2024-04-22 04:31:26,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:31:26,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:31:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:31:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:31:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:31:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:31:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:31:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:31:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:31:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:31:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:31:28,303 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:31:29,615 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:31:29,682 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:31:30,549 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:31:30,609 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:31:30,649 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:31:30,653 [281] [DEBUG] [app] Starting request: urn:request:1c075d59-1ae1-47bc-99bb-447e9571d756 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:31:30,653 [282] [DEBUG] [app] Starting request: urn:request:0cd919ee-1a5f-411c-a581-7c68834423c8 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:31:30,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:31:30,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:31:30,656 [284] [DEBUG] [app] Starting request: urn:request:2e234763-2be7-4939-b490-af3457d635c9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:31:30,656 [284] [DEBUG] [app] Ending request: urn:request:2e234763-2be7-4939-b490-af3457d635c9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:2e234763-2be7-4939-b490-af3457d635c9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:31:30,657 [292] [DEBUG] [app] Starting request: urn:request:1cb9d2d7-ecba-4eaf-b296-210523548641 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:31:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:31:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:31:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:31:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 04:31:30,657 [292] [DEBUG] [app] Ending request: urn:request:1cb9d2d7-ecba-4eaf-b296-210523548641 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:1cb9d2d7-ecba-4eaf-b296-210523548641', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:31:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:31:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:31:30,658 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:31:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:31:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:31:30,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:31:30,659 [278] [DEBUG] [app] Starting request: urn:request:5d966ee9-cb39-4c7d-9784-3a130475d71b (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:31:30,660 [278] [DEBUG] [app] Ending request: urn:request:5d966ee9-cb39-4c7d-9784-3a130475d71b (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:5d966ee9-cb39-4c7d-9784-3a130475d71b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:31:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:31:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:31:30,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:31:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:31:30,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:31:30,661 [279] [DEBUG] [app] Starting request: urn:request:68dc4f61-a88b-4cd1-83b0-424af4f63ee3 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:31:30,661 [279] [DEBUG] [app] Ending request: urn:request:68dc4f61-a88b-4cd1-83b0-424af4f63ee3 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:68dc4f61-a88b-4cd1-83b0-424af4f63ee3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:31:30,662 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:31:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:31:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:31:30,662 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:31:30,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:31:30,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:31:30,669 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:31:30,675 [281] [DEBUG] [app] Ending request: urn:request:1c075d59-1ae1-47bc-99bb-447e9571d756 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:1c075d59-1ae1-47bc-99bb-447e9571d756', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:31:30,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:31:30,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:31:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:31:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:31:30,677 [282] [DEBUG] [app] Ending request: urn:request:0cd919ee-1a5f-411c-a581-7c68834423c8 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:0cd919ee-1a5f-411c-a581-7c68834423c8', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:31:30,677 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:31:30,678 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:31:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:31:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
gunicorn-web stdout | 2024-04-22 04:31:30,718 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:31:30,802 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
quotatotalworker stdout | 2024-04-22 04:31:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:31:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:31:46.054492+00:00 (in 14.999452 seconds)
quotatotalworker stdout | 2024-04-22 04:31:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:31:46 UTC)" (scheduled at 2024-04-22 04:31:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:31:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:31:31,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:31:31,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:31:46 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:31:31,531 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:31:31,678 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotaregistrysizeworker stdout | 2024-04-22 04:31:32,583 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:31:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:31:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:31:43.759375+00:00 (in 9.999494 seconds)
notificationworker stdout | 2024-04-22 04:31:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:31:43 UTC)" (scheduled at 2024-04-22 04:31:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:31:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:31:33,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 31, 33, 760158), True, datetime.datetime(2024, 4, 22, 4, 31, 33, 760158), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:31:33,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:31:33,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:31:33,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:31:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:31:34,278 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:31:35,122 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:31:35,125 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:31:35,129 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
buildlogsarchiver stdout | 2024-04-22 04:31:35,582 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:31:35,614 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
securityworker stdout | 2024-04-22 04:31:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:31:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:31:56.873109+00:00 (in 21.000749 seconds)
securityworker stdout | 2024-04-22 04:31:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:32:05 UTC)" (scheduled at 2024-04-22 04:31:35.871852+00:00)
securityworker stdout | 2024-04-22 04:31:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:31:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:31:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:31:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:31:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:31:35,887 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:31:35,890 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:31:35,890 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:31:35,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 26, 35, 876301), 1, 2])
securityworker stdout | 2024-04-22 04:31:35,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:31:35,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:31:35,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 26, 35, 876301), 1, 2])
securityworker stdout | 2024-04-22 04:31:35,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:31:35,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:31:35,896 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:31:35,896 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:32:05 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:31:36,049 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
logrotateworker stdout | 2024-04-22 04:31:37,011 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:31:38,157 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:31:38,214 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:31:38,580 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:31:39,441 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
exportactionlogsworker stdout | 2024-04-22 04:31:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:31:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:31:41.564959+00:00 (in 1.997477 seconds)
exportactionlogsworker stdout | 2024-04-22 04:31:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:32:39 UTC)" (scheduled at 2024-04-22 04:31:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:31:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:31:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:32:39 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:31:40,652 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:31:40,709 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:31:41,129 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:31:41,133 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
autopruneworker stdout | 2024-04-22 04:31:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:31:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:32:11.264267+00:00 (in 29.999494 seconds)
autopruneworker stdout | 2024-04-22 04:31:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:32:11 UTC)" (scheduled at 2024-04-22 04:31:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:31:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713760241271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:31:41,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:31:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:31:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:32:11 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:31:41,520 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:31:41,523 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:31:41,539 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:31:41,544 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:31:41,548 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:31:41,551 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:31:41,554 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:31:41,558 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:31:41,562 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
exportactionlogsworker stdout | 2024-04-22 04:31:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:31:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:31:53.566665+00:00 (in 12.001271 seconds)
exportactionlogsworker stdout | 2024-04-22 04:31:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:32:41 UTC)" (scheduled at 2024-04-22 04:31:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:31:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:31:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 31, 41, 565741), True, datetime.datetime(2024, 4, 22, 4, 31, 41, 565741), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:31:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:31:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:31:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:32:41 UTC)" executed successfully
storagereplication stdout | 2024-04-22 04:31:42,613 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
namespacegcworker stdout | 2024-04-22 04:31:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:31:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:32:22.058978+00:00 (in 39.001350 seconds)
namespacegcworker stdout | 2024-04-22 04:31:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:32:43 UTC)" (scheduled at 2024-04-22 04:31:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:31:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:31:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 31, 43, 58024), True, datetime.datetime(2024, 4, 22, 4, 31, 43, 58024), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:31:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:31:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:31:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:32:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:31:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:31:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:31:53.759375+00:00 (in 9.999468 seconds)
notificationworker stdout | 2024-04-22 04:31:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:31:53 UTC)" (scheduled at 2024-04-22 04:31:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:31:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:31:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 31, 43, 760175), True, datetime.datetime(2024, 4, 22, 4, 31, 43, 760175), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:31:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:31:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:31:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:31:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:31:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:31:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:32:14.952062+00:00 (in 29.999507 seconds)
gcworker stdout | 2024-04-22 04:31:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:32:14 UTC)" (scheduled at 2024-04-22 04:31:44.952062+00:00)
gcworker stdout | 2024-04-22 04:31:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712550704952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:31:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:31:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:31:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:32:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:31:45,653 [278] [DEBUG] [app] Starting request: urn:request:a5753c1e-6169-4bb4-ba4b-a7e75affd99b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:31:45,653 [281] [DEBUG] [app] Starting request: urn:request:2af58c33-56fa-41ad-980b-f1b145c36d29 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:31:45,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:31:45,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:31:45,656 [284] [DEBUG] [app] Starting request: urn:request:deb0ab8c-6a0e-4aae-8018-b3139f90b757 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:31:45,656 [288] [DEBUG] [app] Starting request: urn:request:8aaa82b0-a3a7-4e9d-b7d6-9943549027a4 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:31:45,657 [284] [DEBUG] [app] Ending request: urn:request:deb0ab8c-6a0e-4aae-8018-b3139f90b757 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:deb0ab8c-6a0e-4aae-8018-b3139f90b757', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:31:45,657 [288] [DEBUG] [app] Ending request: urn:request:8aaa82b0-a3a7-4e9d-b7d6-9943549027a4 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:8aaa82b0-a3a7-4e9d-b7d6-9943549027a4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:31:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:31:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:31:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:31:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:31:45,657 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:31:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:31:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:31:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:31:45,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:31:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:31:45,660 [279] [DEBUG] [app] Starting request: urn:request:42642ed6-2c42-4a6c-92d9-96b6a4424f20 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:31:45,660 [282] [DEBUG] [app] Starting request: urn:request:df1571e1-4caa-4013-96f8-26bd2f078725 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:31:45,660 [279] [DEBUG] [app] Ending request: urn:request:42642ed6-2c42-4a6c-92d9-96b6a4424f20 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:42642ed6-2c42-4a6c-92d9-96b6a4424f20', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:31:45,660 [282] [DEBUG] [app] Ending request: urn:request:df1571e1-4caa-4013-96f8-26bd2f078725 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:df1571e1-4caa-4013-96f8-26bd2f078725', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:31:45,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:31:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:31:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 04:31:45,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:31:45,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:31:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:31:45,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:31:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:31:45,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:31:45,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:31:45,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:31:45,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:31:45,674 [278] [DEBUG] [app] Ending request: urn:request:a5753c1e-6169-4bb4-ba4b-a7e75affd99b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a5753c1e-6169-4bb4-ba4b-a7e75affd99b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:31:45,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:31:45,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:31:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:31:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:31:45,675 [281] [DEBUG] [app] Ending request: urn:request:2af58c33-56fa-41ad-980b-f1b145c36d29 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2af58c33-56fa-41ad-980b-f1b145c36d29', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:31:45,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:31:45,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:31:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:31:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.022)
quotatotalworker stdout | 2024-04-22 04:31:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:31:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:32:01.054492+00:00 (in 14.999447 seconds)
quotatotalworker stdout | 2024-04-22 04:31:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:32:01 UTC)" (scheduled at 2024-04-22 04:31:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:31:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:31:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:31:46,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:32:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:31:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:31:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:32:17.052354+00:00 (in 29.999443 seconds)
buildlogsarchiver stdout | 2024-04-22 04:31:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:32:17 UTC)" (scheduled at 2024-04-22 04:31:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:31:47,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 31, 47, 53386), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:31:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:31:47,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:31:47,063 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:32:17 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:31:51,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:31:51,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:32:06.552482+00:00 (in 14.996484 seconds)
repositorygcworker stdout | 2024-04-22 04:31:51,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:36:51 UTC)" (scheduled at 2024-04-22 04:31:51.555445+00:00)
repositorygcworker stdout | 2024-04-22 04:31:51,557 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 31, 51, 556391), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 04:31:51,567 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 31, 51, 556391), True, datetime.datetime(2024, 4, 22, 4, 31, 51, 556391), 0, 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 04:31:51,570 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 31, 51, 556391), True, datetime.datetime(2024, 4, 22, 4, 31, 51, 556391), 0, 'repositorygc/%', False, datetime.datetime(2024, 4, 22, 4, 31, 51, 556391), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 04:31:51,572 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:31:51,572 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:36:51 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:31:51,749 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:31:52,865 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
exportactionlogsworker stdout | 2024-04-22 04:31:53,566 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:31:53,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:32:39.566970+00:00 (in 45.999800 seconds)
exportactionlogsworker stdout | 2024-04-22 04:31:53,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:36:53 UTC)" (scheduled at 2024-04-22 04:31:53.566665+00:00)
exportactionlogsworker stdout | 2024-04-22 04:31:53,568 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 31, 53, 567584), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 04:31:53,578 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 31, 53, 567584), True, datetime.datetime(2024, 4, 22, 4, 31, 53, 567584), 0, 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 04:31:53,581 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 31, 53, 567584), True, datetime.datetime(2024, 4, 22, 4, 31, 53, 567584), 0, 'exportactionlogs/%', False, datetime.datetime(2024, 4, 22, 4, 31, 53, 567584), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 04:31:53,583 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:31:53,583 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:36:53 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:31:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:31:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:32:03.759375+00:00 (in 9.999462 seconds)
notificationworker stdout | 2024-04-22 04:31:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:32:03 UTC)" (scheduled at 2024-04-22 04:31:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:31:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:31:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 31, 53, 760176), True, datetime.datetime(2024, 4, 22, 4, 31, 53, 760176), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:31:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:31:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:31:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:32:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:31:56,558 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:31:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:31:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:32:05.871852+00:00 (in 8.998263 seconds)
securityworker stdout | 2024-04-22 04:31:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:32:26 UTC)" (scheduled at 2024-04-22 04:31:56.873109+00:00)
securityworker stdout | 2024-04-22 04:31:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:31:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:31:56,875 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:31:56,875 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:31:56,875 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:31:56,875 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:31:56,876 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:31:56,878 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:31:56,879 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:31:56,889 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:31:56,891 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:31:56,891 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:31:56,892 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 26, 56, 879291), 1, 2])
securityworker stdout | 2024-04-22 04:31:56,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:31:56,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:31:56,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 26, 56, 879291), 1, 2])
securityworker stdout | 2024-04-22 04:31:56,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:31:56,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:31:56,897 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:31:56,897 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:31:56,897 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:31:56,897 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:31:56,897 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:31:56,898 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:31:56,898 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:31:56,898 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:32:26 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:31:57,372 [279] [DEBUG] [app] Starting request: urn:request:4e8f70d8-df41-4333-a82a-919cbe61b1f7 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:31:57,373 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:31:57,373 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:31:57,373 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:31:57,383 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:31:57,383 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:31:57,383 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:31:57,384 [279] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:31:57,384 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:31:57,384 [279] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:31:57,384 [279] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:31:57,384 [279] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:31:57,386 [279] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:31:57,393 [279] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:31:57,394 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:31:57,398 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:31:57,403 [279] [DEBUG] [app] Ending request: urn:request:4e8f70d8-df41-4333-a82a-919cbe61b1f7 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:4e8f70d8-df41-4333-a82a-919cbe61b1f7', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:31:57,403 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:31:57,404 [279] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:31:57 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:31:57 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.032 1536 0.032)
repositoryactioncounter stdout | 2024-04-22 04:31:58,340 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:31:59,640 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:31:59,718 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:32:00,556 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:32:00,618 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:32:00,653 [279] [DEBUG] [app] Starting request: urn:request:9f1d0cf4-cc1c-4f49-9282-de945cc4b618 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:32:00,653 [282] [DEBUG] [app] Starting request: urn:request:10ff7d4d-5d1e-4b25-b337-5ed766f57a59 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:32:00,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:32:00,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:32:00,656 [288] [DEBUG] [app] Starting request: urn:request:0b967636-020b-49ad-9274-f32a09cd69b3 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:32:00,656 [284] [DEBUG] [app] Starting request: urn:request:38ddeb0b-b698-48a5-be9b-61181d1efd55 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:32:00,657 [288] [DEBUG] [app] Ending request: urn:request:0b967636-020b-49ad-9274-f32a09cd69b3 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:0b967636-020b-49ad-9274-f32a09cd69b3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:32:00,657 [284] [DEBUG] [app] Ending request: urn:request:38ddeb0b-b698-48a5-be9b-61181d1efd55 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:38ddeb0b-b698-48a5-be9b-61181d1efd55', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:32:00,657 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:32:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:32:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:32:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:32:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:32:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:32:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:32:00,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:32:00,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:32:00,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:32:00,660 [281] [DEBUG] [app] Starting request: urn:request:685e37a1-1108-4376-88ef-9f64f6665601 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:32:00,660 [278] [DEBUG] [app] Starting request: urn:request:3dce9d3c-7277-4a56-b103-1a45cab11e25 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:32:00,661 [281] [DEBUG] [app] Ending request: urn:request:685e37a1-1108-4376-88ef-9f64f6665601 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:685e37a1-1108-4376-88ef-9f64f6665601', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:32:00,661 [278] [DEBUG] [app] Ending request: urn:request:3dce9d3c-7277-4a56-b103-1a45cab11e25 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:3dce9d3c-7277-4a56-b103-1a45cab11e25', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:32:00,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:32:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:32:00,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:32:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:32:00,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:32:00,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:32:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:32:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:32:00,662 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:32:00,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:32:00,663 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:32:00,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:32:00,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:32:00,676 [279] [DEBUG] [app] Ending request: urn:request:9f1d0cf4-cc1c-4f49-9282-de945cc4b618 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:9f1d0cf4-cc1c-4f49-9282-de945cc4b618', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:32:00,676 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:32:00,677 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:32:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:32:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.025 118 0.025)
gunicorn-web stdout | 2024-04-22 04:32:00,678 [282] [DEBUG] [app] Ending request: urn:request:10ff7d4d-5d1e-4b25-b337-5ed766f57a59 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:10ff7d4d-5d1e-4b25-b337-5ed766f57a59', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:32:00,678 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:32:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.026 118 0.026)
gunicorn-web stdout | 2024-04-22 04:32:00,678 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:32:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:32:00,729 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:32:00,814 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
quotatotalworker stdout | 2024-04-22 04:32:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:32:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:32:16.054492+00:00 (in 14.999449 seconds)
quotatotalworker stdout | 2024-04-22 04:32:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:32:16 UTC)" (scheduled at 2024-04-22 04:32:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:32:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:32:01,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:32:01,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:32:16 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:32:01,558 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:32:01,684 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
securityscanningnotificationworker stdout | 2024-04-22 04:32:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:32:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:32:16.552337+00:00 (in 13.995463 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:32:02,557 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:33:02 UTC)" (scheduled at 2024-04-22 04:32:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:32:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:32:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:33:02 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:32:02,613 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:32:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:32:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:32:13.759375+00:00 (in 9.999475 seconds)
notificationworker stdout | 2024-04-22 04:32:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:32:13 UTC)" (scheduled at 2024-04-22 04:32:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:32:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:32:03,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 32, 3, 760148), True, datetime.datetime(2024, 4, 22, 4, 32, 3, 760148), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:32:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:32:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:32:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:32:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:32:04,288 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:32:05,131 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:32:05,134 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:32:05,136 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
buildlogsarchiver stdout | 2024-04-22 04:32:05,614 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:32:05,649 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
securityworker stdout | 2024-04-22 04:32:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:32:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:32:26.873109+00:00 (in 21.000805 seconds)
securityworker stdout | 2024-04-22 04:32:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:32:35 UTC)" (scheduled at 2024-04-22 04:32:05.871852+00:00)
securityworker stdout | 2024-04-22 04:32:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:32:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:32:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:32:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:32:05,885 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:32:05,885 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:32:35 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:32:06,086 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
repositorygcworker stdout | 2024-04-22 04:32:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:32:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:32:13.555667+00:00 (in 7.002607 seconds)
repositorygcworker stdout | 2024-04-22 04:32:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:33:06 UTC)" (scheduled at 2024-04-22 04:32:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:32:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:32:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 32, 6, 553498), True, datetime.datetime(2024, 4, 22, 4, 32, 6, 553498), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:32:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:32:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:32:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:33:06 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:32:07,032 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:32:08,173 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:32:08,250 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:32:08,616 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:32:09,458 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:32:10,688 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:32:10,718 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:32:11,143 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:32:11,149 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
autopruneworker stdout | 2024-04-22 04:32:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:32:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:32:41.264267+00:00 (in 29.999467 seconds)
autopruneworker stdout | 2024-04-22 04:32:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:32:41 UTC)" (scheduled at 2024-04-22 04:32:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:32:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713760271271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:32:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:32:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:32:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:32:41 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:32:11,530 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:32:11,534 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:32:11,549 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:32:11,552 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:32:11,558 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:32:11,561 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:32:11,564 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:32:11,568 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:32:11,572 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
storagereplication stdout | 2024-04-22 04:32:12,650 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:32:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:32:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:33:06.552482+00:00 (in 52.996301 seconds)
repositorygcworker stdout | 2024-04-22 04:32:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:33:13 UTC)" (scheduled at 2024-04-22 04:32:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:32:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:32:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:33:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:32:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:32:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:32:19.762424+00:00 (in 6.002562 seconds)
notificationworker stdout | 2024-04-22 04:32:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:32:23 UTC)" (scheduled at 2024-04-22 04:32:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:32:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:32:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 32, 13, 760139), True, datetime.datetime(2024, 4, 22, 4, 32, 13, 760139), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:32:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:32:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:32:13,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:32:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:32:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:32:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:32:44.952062+00:00 (in 29.999474 seconds)
gcworker stdout | 2024-04-22 04:32:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:32:44 UTC)" (scheduled at 2024-04-22 04:32:14.952062+00:00)
gcworker stdout | 2024-04-22 04:32:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712550734953, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:32:14,966 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:32:14,966 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:32:14,966 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:32:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:32:15,653 [278] [DEBUG] [app] Starting request: urn:request:30422efc-9314-4e30-a399-36eca5350f83 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:32:15,653 [282] [DEBUG] [app] Starting request: urn:request:2c0ed8f1-6523-40de-96e3-9a260cdd539e (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:32:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:32:15,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:32:15,656 [284] [DEBUG] [app] Starting request: urn:request:89782fd4-38c6-49ca-a987-a9aa15c0de39 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:32:15,656 [284] [DEBUG] [app] Ending request: urn:request:89782fd4-38c6-49ca-a987-a9aa15c0de39 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:89782fd4-38c6-49ca-a987-a9aa15c0de39', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:32:15,656 [292] [DEBUG] [app] Starting request: urn:request:ebc62c28-6b7e-4703-be66-bc150dba670d (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:32:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:32:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:32:15,657 [292] [DEBUG] [app] Ending request: urn:request:ebc62c28-6b7e-4703-be66-bc150dba670d (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:ebc62c28-6b7e-4703-be66-bc150dba670d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:32:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:32:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:32:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:32:15,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:32:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:32:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:32:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:32:15,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:32:15,659 [281] [DEBUG] [app] Starting request: urn:request:9dba8fd1-c2b0-49d0-9f69-e7127d59ded6 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:32:15,660 [281] [DEBUG] [app] Ending request: urn:request:9dba8fd1-c2b0-49d0-9f69-e7127d59ded6 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9dba8fd1-c2b0-49d0-9f69-e7127d59ded6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:32:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:32:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:32:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:32:15,660 [278] [DEBUG] [app] Starting request: urn:request:bef20c9d-bf5e-457d-b848-e23aaea524d0 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:32:15,661 [278] [DEBUG] [app] Ending request: urn:request:bef20c9d-bf5e-457d-b848-e23aaea524d0 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:bef20c9d-bf5e-457d-b848-e23aaea524d0', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:32:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:32:15,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:32:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:32:15,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:32:15,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:32:15,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:32:15,662 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:32:15,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:32:15,668 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:32:15,674 [278] [DEBUG] [app] Ending request: urn:request:30422efc-9314-4e30-a399-36eca5350f83 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:30422efc-9314-4e30-a399-36eca5350f83', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:32:15,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:32:15,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:32:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:32:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:32:15,675 [282] [DEBUG] [app] Ending request: urn:request:2c0ed8f1-6523-40de-96e3-9a260cdd539e (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2c0ed8f1-6523-40de-96e3-9a260cdd539e', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:32:15,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:32:15,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:32:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:32:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
quotatotalworker stdout | 2024-04-22 04:32:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:32:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:32:31.054492+00:00 (in 14.999446 seconds)
quotatotalworker stdout | 2024-04-22 04:32:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:32:31 UTC)" (scheduled at 2024-04-22 04:32:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:32:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:32:16,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:32:16,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:32:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:32:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:32:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:32:21.555879+00:00 (in 5.003020 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:32:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:33:16 UTC)" (scheduled at 2024-04-22 04:32:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:32:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:32:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 32, 16, 553239), True, datetime.datetime(2024, 4, 22, 4, 32, 16, 553239), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:32:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:32:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:32:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:33:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:32:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:32:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:32:47.052354+00:00 (in 29.999432 seconds)
buildlogsarchiver stdout | 2024-04-22 04:32:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:32:47 UTC)" (scheduled at 2024-04-22 04:32:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:32:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 32, 17, 53274), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:32:17,069 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:32:17,069 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:32:17,069 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:32:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:32:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:32:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:32:23.759375+00:00 (in 3.996406 seconds)
notificationworker stdout | 2024-04-22 04:32:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:33:19 UTC)" (scheduled at 2024-04-22 04:32:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:32:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:32:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:33:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:32:21,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:32:21,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:33:02.556208+00:00 (in 40.999808 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:32:21,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:37:21 UTC)" (scheduled at 2024-04-22 04:32:21.555879+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:32:21,557 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 32, 21, 556817), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 04:32:21,567 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 32, 21, 556817), True, datetime.datetime(2024, 4, 22, 4, 32, 21, 556817), 0, 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 04:32:21,570 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 32, 21, 556817), True, datetime.datetime(2024, 4, 22, 4, 32, 21, 556817), 0, 'secscanv4/%', False, datetime.datetime(2024, 4, 22, 4, 32, 21, 556817), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 04:32:21,572 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:32:21,572 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:37:21 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:32:21,784 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
namespacegcworker stdout | 2024-04-22 04:32:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:32:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:32:38.058708+00:00 (in 15.999216 seconds)
namespacegcworker stdout | 2024-04-22 04:32:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:33:22 UTC)" (scheduled at 2024-04-22 04:32:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:32:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:32:22,060 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:33:22 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:32:22,901 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:32:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:32:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:32:33.759375+00:00 (in 9.999498 seconds)
notificationworker stdout | 2024-04-22 04:32:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:32:33 UTC)" (scheduled at 2024-04-22 04:32:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:32:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:32:23,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 32, 23, 760168), True, datetime.datetime(2024, 4, 22, 4, 32, 23, 760168), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:32:23,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:32:23,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:32:23,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:32:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:32:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:32:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:33:24.361582+00:00 (in 59.999465 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:32:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:33:24 UTC)" (scheduled at 2024-04-22 04:32:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:32:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:32:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:32:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:33:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:32:26,595 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:32:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:32:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:32:35.871852+00:00 (in 8.998264 seconds)
securityworker stdout | 2024-04-22 04:32:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:32:56 UTC)" (scheduled at 2024-04-22 04:32:26.873109+00:00)
securityworker stdout | 2024-04-22 04:32:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:32:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:32:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:32:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:32:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:32:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:32:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:32:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:32:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:32:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:32:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:32:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:32:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 27, 26, 881035), 1, 2])
securityworker stdout | 2024-04-22 04:32:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:32:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:32:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 27, 26, 881035), 1, 2])
securityworker stdout | 2024-04-22 04:32:26,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:32:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:32:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:32:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:32:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:32:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:32:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:32:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:32:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:32:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:32:56 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:32:27,759 [279] [DEBUG] [app] Starting request: urn:request:be9ec81e-9a59-4e1f-898c-b525adf76d57 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:32:27,759 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:32:27,759 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:32:27,760 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:32:27,769 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:32:27,769 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:32:27,769 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:32:27,769 [279] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:32:27,769 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:32:27,769 [279] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:32:27,769 [279] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:32:27,769 [279] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:32:27,771 [279] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:32:27,777 [279] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:32:27,778 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:32:27,783 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:32:27,787 [279] [DEBUG] [app] Ending request: urn:request:be9ec81e-9a59-4e1f-898c-b525adf76d57 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:be9ec81e-9a59-4e1f-898c-b525adf76d57', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:32:27,788 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:32:27,788 [279] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:32:27 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:32:27 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1555 0.030)
repositoryactioncounter stdout | 2024-04-22 04:32:28,377 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:32:29,676 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:32:29,751 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:32:30,565 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:32:30,628 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:32:30,652 [282] [DEBUG] [app] Starting request: urn:request:d1467398-3a04-469f-967b-21a86b4b9c7f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:32:30,652 [281] [DEBUG] [app] Starting request: urn:request:328246f9-4eb5-4d7e-8096-aefc50458cd7 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:32:30,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:32:30,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:32:30,656 [284] [DEBUG] [app] Starting request: urn:request:d27b1b9d-aa37-4528-b247-82d18597719f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:32:30,656 [292] [DEBUG] [app] Starting request: urn:request:c1c54580-ca15-4d5d-aed1-65603fedcb54 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:32:30,656 [284] [DEBUG] [app] Ending request: urn:request:d27b1b9d-aa37-4528-b247-82d18597719f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:d27b1b9d-aa37-4528-b247-82d18597719f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:32:30,656 [292] [DEBUG] [app] Ending request: urn:request:c1c54580-ca15-4d5d-aed1-65603fedcb54 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:c1c54580-ca15-4d5d-aed1-65603fedcb54', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:32:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:32:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:32:30,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:32:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:32:30,656 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:32:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:32:30,656 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:32:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:32:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:32:30,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:32:30,659 [278] [DEBUG] [app] Starting request: urn:request:044b34d8-ae28-48bc-a51c-eb9ddd03af65 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:32:30,659 [278] [DEBUG] [app] Ending request: urn:request:044b34d8-ae28-48bc-a51c-eb9ddd03af65 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:044b34d8-ae28-48bc-a51c-eb9ddd03af65', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:32:30,659 [281] [DEBUG] [app] Starting request: urn:request:e20befd3-14b5-4769-b2bd-3e109bd1407b (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:32:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:32:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:32:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:32:30,660 [281] [DEBUG] [app] Ending request: urn:request:e20befd3-14b5-4769-b2bd-3e109bd1407b (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e20befd3-14b5-4769-b2bd-3e109bd1407b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:32:30,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:32:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:32:30,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:32:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:32:30,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:32:30,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:32:30,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:32:30,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:32:30,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:32:30,675 [282] [DEBUG] [app] Ending request: urn:request:d1467398-3a04-469f-967b-21a86b4b9c7f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:d1467398-3a04-469f-967b-21a86b4b9c7f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:32:30,675 [281] [DEBUG] [app] Ending request: urn:request:328246f9-4eb5-4d7e-8096-aefc50458cd7 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:328246f9-4eb5-4d7e-8096-aefc50458cd7', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:32:30,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:32:30,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:32:30,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:32:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:32:30,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:32:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:32:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:32:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.023)
gunicorn-web stdout | 2024-04-22 04:32:30,685 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:32:30,740 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:32:30,826 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
quotatotalworker stdout | 2024-04-22 04:32:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:32:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:32:46.054492+00:00 (in 14.999449 seconds)
quotatotalworker stdout | 2024-04-22 04:32:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:32:46 UTC)" (scheduled at 2024-04-22 04:32:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:32:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:32:31,069 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:32:31,069 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:32:46 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:32:31,595 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:32:31,706 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotaregistrysizeworker stdout | 2024-04-22 04:32:32,633 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:32:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:32:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:32:43.759375+00:00 (in 9.999497 seconds)
notificationworker stdout | 2024-04-22 04:32:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:32:43 UTC)" (scheduled at 2024-04-22 04:32:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:32:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:32:33,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 32, 33, 760150), True, datetime.datetime(2024, 4, 22, 4, 32, 33, 760150), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:32:33,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:32:33,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:32:33,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:32:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:32:34,300 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:32:35,139 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:32:35,141 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:32:35,144 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
buildlogsarchiver stdout | 2024-04-22 04:32:35,650 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:32:35,685 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
securityworker stdout | 2024-04-22 04:32:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:32:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:32:56.873109+00:00 (in 21.000742 seconds)
securityworker stdout | 2024-04-22 04:32:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:33:05 UTC)" (scheduled at 2024-04-22 04:32:35.871852+00:00)
securityworker stdout | 2024-04-22 04:32:35,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:32:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:32:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:32:35,877 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:32:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:32:35,889 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:32:35,891 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:32:35,891 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:32:35,892 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 27, 35, 876856), 1, 2])
securityworker stdout | 2024-04-22 04:32:35,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:32:35,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:32:35,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 27, 35, 876856), 1, 2])
securityworker stdout | 2024-04-22 04:32:35,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:32:35,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:32:35,897 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:32:35,897 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:33:05 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:32:36,107 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
logrotateworker stdout | 2024-04-22 04:32:37,070 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
namespacegcworker stdout | 2024-04-22 04:32:38,058 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:32:38,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:32:43.057186+00:00 (in 4.997935 seconds)
namespacegcworker stdout | 2024-04-22 04:32:38,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:37:38 UTC)" (scheduled at 2024-04-22 04:32:38.058708+00:00)
namespacegcworker stdout | 2024-04-22 04:32:38,060 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 32, 38, 59616), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 04:32:38,070 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 32, 38, 59616), True, datetime.datetime(2024, 4, 22, 4, 32, 38, 59616), 0, 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 04:32:38,073 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 32, 38, 59616), True, datetime.datetime(2024, 4, 22, 4, 32, 38, 59616), 0, 'namespacegc/%', False, datetime.datetime(2024, 4, 22, 4, 32, 38, 59616), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 04:32:38,075 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:32:38,075 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:37:38 UTC)" executed successfully
autopruneworker stdout | 2024-04-22 04:32:38,183 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:32:38,276 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:32:38,624 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:32:39,494 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
exportactionlogsworker stdout | 2024-04-22 04:32:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:32:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:32:41.564959+00:00 (in 1.997477 seconds)
exportactionlogsworker stdout | 2024-04-22 04:32:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:33:39 UTC)" (scheduled at 2024-04-22 04:32:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:32:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:32:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:33:39 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:32:40,725 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:32:40,753 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:32:41,177 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:32:41,185 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
autopruneworker stdout | 2024-04-22 04:32:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:32:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:33:11.264267+00:00 (in 29.999500 seconds)
autopruneworker stdout | 2024-04-22 04:32:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:33:11 UTC)" (scheduled at 2024-04-22 04:32:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:32:41,279 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713760301278, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:32:41,283 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:32:41,283 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:32:41,283 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:33:11 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:32:41,541 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:32:41,546 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:32:41,558 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:32:41,562 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
exportactionlogsworker stdout | 2024-04-22 04:32:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:32:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:33:39.566970+00:00 (in 58.001541 seconds)
exportactionlogsworker stdout | 2024-04-22 04:32:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:33:41 UTC)" (scheduled at 2024-04-22 04:32:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:32:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:32:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 32, 41, 565828), True, datetime.datetime(2024, 4, 22, 4, 32, 41, 565828), 0, 'exportactionlogs/%', 50, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:32:41,569 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:32:41,573 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
exportactionlogsworker stdout | 2024-04-22 04:32:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:32:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:32:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:33:41 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:32:41,577 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:32:41,581 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:32:41,584 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
storagereplication stdout | 2024-04-22 04:32:42,665 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
namespacegcworker stdout | 2024-04-22 04:32:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:32:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:33:22.058978+00:00 (in 39.001290 seconds)
namespacegcworker stdout | 2024-04-22 04:32:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:33:43 UTC)" (scheduled at 2024-04-22 04:32:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:32:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:32:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 32, 43, 58069), True, datetime.datetime(2024, 4, 22, 4, 32, 43, 58069), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:32:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:32:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:32:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:33:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:32:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:32:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:32:53.759375+00:00 (in 9.999520 seconds)
notificationworker stdout | 2024-04-22 04:32:43,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:32:53 UTC)" (scheduled at 2024-04-22 04:32:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:32:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:32:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 32, 43, 760133), True, datetime.datetime(2024, 4, 22, 4, 32, 43, 760133), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:32:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:32:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:32:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:32:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:32:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:32:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:33:14.952062+00:00 (in 29.999579 seconds)
gcworker stdout | 2024-04-22 04:32:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:33:14 UTC)" (scheduled at 2024-04-22 04:32:44.952062+00:00)
gcworker stdout | 2024-04-22 04:32:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712550764952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:32:44,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:32:44,964 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:32:44,964 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:33:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:32:45,653 [281] [DEBUG] [app] Starting request: urn:request:7efff665-96f5-4052-adeb-8855ab2fb143 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:32:45,653 [278] [DEBUG] [app] Starting request: urn:request:91cc14e3-1576-46a9-b41d-1bba905872be (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:32:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:32:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:32:45,656 [291] [DEBUG] [app] Starting request: urn:request:512542fd-42bd-4796-b50a-cb6ad801618a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:32:45,656 [286] [DEBUG] [app] Starting request: urn:request:43c5172c-ded9-459f-aa63-24fff2a1997a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:32:45,656 [291] [DEBUG] [app] Ending request: urn:request:512542fd-42bd-4796-b50a-cb6ad801618a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:512542fd-42bd-4796-b50a-cb6ad801618a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:32:45,656 [286] [DEBUG] [app] Ending request: urn:request:43c5172c-ded9-459f-aa63-24fff2a1997a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:43c5172c-ded9-459f-aa63-24fff2a1997a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:32:45,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:32:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:32:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:32:45,657 [286] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:32:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:32:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:32:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:32:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:32:45,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:32:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:32:45,659 [279] [DEBUG] [app] Starting request: urn:request:20ba7e99-490c-4dda-94be-9660afbee6b4 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:32:45,659 [282] [DEBUG] [app] Starting request: urn:request:bc240572-13fe-4f15-9956-19e6e231be36 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:32:45,660 [279] [DEBUG] [app] Ending request: urn:request:20ba7e99-490c-4dda-94be-9660afbee6b4 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:20ba7e99-490c-4dda-94be-9660afbee6b4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:32:45,660 [282] [DEBUG] [app] Ending request: urn:request:bc240572-13fe-4f15-9956-19e6e231be36 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:bc240572-13fe-4f15-9956-19e6e231be36', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:32:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:32:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:32:45,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:32:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:32:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:32:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:32:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:32:45,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:32:45,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:32:45,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:32:45,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:32:45,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:32:45,674 [278] [DEBUG] [app] Ending request: urn:request:91cc14e3-1576-46a9-b41d-1bba905872be (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:91cc14e3-1576-46a9-b41d-1bba905872be', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:32:45,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:32:45,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:32:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:32:45,675 [281] [DEBUG] [app] Ending request: urn:request:7efff665-96f5-4052-adeb-8855ab2fb143 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:7efff665-96f5-4052-adeb-8855ab2fb143', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:32:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:32:45,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:32:45,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:32:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:32:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotatotalworker stdout | 2024-04-22 04:32:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:32:46,054 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:33:01.054492+00:00 (in 14.999510 seconds)
quotatotalworker stdout | 2024-04-22 04:32:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:33:01 UTC)" (scheduled at 2024-04-22 04:32:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:32:46,055 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:32:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:32:46,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:33:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:32:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:32:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:33:17.052354+00:00 (in 29.999479 seconds)
buildlogsarchiver stdout | 2024-04-22 04:32:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:33:17 UTC)" (scheduled at 2024-04-22 04:32:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:32:47,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 32, 47, 53245), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:32:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:32:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:32:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:33:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:32:51,821 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:32:52,938 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:32:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:32:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:33:03.759375+00:00 (in 9.999437 seconds)
notificationworker stdout | 2024-04-22 04:32:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:33:03 UTC)" (scheduled at 2024-04-22 04:32:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:32:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:32:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 32, 53, 760284), True, datetime.datetime(2024, 4, 22, 4, 32, 53, 760284), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:32:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:32:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:32:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:33:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:32:56,627 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:32:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:32:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:33:05.871852+00:00 (in 8.998236 seconds)
securityworker stdout | 2024-04-22 04:32:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:33:26 UTC)" (scheduled at 2024-04-22 04:32:56.873109+00:00)
securityworker stdout | 2024-04-22 04:32:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:32:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:32:56,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:32:56,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:32:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:32:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:32:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:32:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:32:56,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:32:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:32:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:32:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:32:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 27, 56, 880720), 1, 2])
securityworker stdout | 2024-04-22 04:32:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:32:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:32:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 27, 56, 880720), 1, 2])
securityworker stdout | 2024-04-22 04:32:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:32:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:32:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:32:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:32:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:32:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:32:56,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:32:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:32:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:32:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:33:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:32:58,413 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
gunicorn-web stdout | 2024-04-22 04:32:58,918 [278] [DEBUG] [app] Starting request: urn:request:0bf7f38a-c941-45a0-aba1-816a247de9be (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:32:58,918 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:32:58,918 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:32:58,919 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:32:58,928 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:32:58,928 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:32:58,928 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:32:58,929 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:32:58,929 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:32:58,929 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:32:58,929 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:32:58,929 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:32:58,931 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:32:58,937 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:32:58,938 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:32:58,942 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:32:58,947 [278] [DEBUG] [app] Ending request: urn:request:0bf7f38a-c941-45a0-aba1-816a247de9be (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:0bf7f38a-c941-45a0-aba1-816a247de9be', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:32:58,947 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:32:58,948 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:32:58 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:32:58 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1536 0.031)
repositorygcworker stdout | 2024-04-22 04:32:59,712 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:32:59,787 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:33:00,573 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:33:00,638 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:33:00,653 [278] [DEBUG] [app] Starting request: urn:request:e49c4248-c4f0-40b8-bd31-d9bdb288bd5b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:33:00,653 [279] [DEBUG] [app] Starting request: urn:request:17cfe6bc-1e1f-4f7d-aacc-618bdb264dbf (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:33:00,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:33:00,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:33:00,656 [284] [DEBUG] [app] Starting request: urn:request:c7152988-4bdb-42f7-b356-4b061cd863b2 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:33:00,657 [284] [DEBUG] [app] Ending request: urn:request:c7152988-4bdb-42f7-b356-4b061cd863b2 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:c7152988-4bdb-42f7-b356-4b061cd863b2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:33:00,657 [292] [DEBUG] [app] Starting request: urn:request:5ee3bdef-06e3-43f7-a261-34a385b6abd3 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:33:00,657 [292] [DEBUG] [app] Ending request: urn:request:5ee3bdef-06e3-43f7-a261-34a385b6abd3 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5ee3bdef-06e3-43f7-a261-34a385b6abd3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:33:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:33:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:33:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:33:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:33:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:33:00,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:33:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:33:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:33:00,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:33:00,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:33:00,660 [282] [DEBUG] [app] Starting request: urn:request:b96fe264-e9bc-46d8-a20b-acefe5652928 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:33:00,660 [282] [DEBUG] [app] Ending request: urn:request:b96fe264-e9bc-46d8-a20b-acefe5652928 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b96fe264-e9bc-46d8-a20b-acefe5652928', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:33:00,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:33:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:33:00,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:33:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:33:00,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:33:00,661 [281] [DEBUG] [app] Starting request: urn:request:ed43c6de-1726-413b-891c-fc806871939a (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:33:00,661 [281] [DEBUG] [app] Ending request: urn:request:ed43c6de-1726-413b-891c-fc806871939a (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:ed43c6de-1726-413b-891c-fc806871939a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:33:00,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:33:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:33:00,662 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:33:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:33:00,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:33:00,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:33:00,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:33:00,675 [279] [DEBUG] [app] Ending request: urn:request:17cfe6bc-1e1f-4f7d-aacc-618bdb264dbf (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:17cfe6bc-1e1f-4f7d-aacc-618bdb264dbf', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:33:00,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:33:00,676 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:33:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:33:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:33:00,676 [278] [DEBUG] [app] Ending request: urn:request:e49c4248-c4f0-40b8-bd31-d9bdb288bd5b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e49c4248-c4f0-40b8-bd31-d9bdb288bd5b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:33:00,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:33:00,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:33:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:33:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 04:33:00,696 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:33:00,751 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:33:00,838 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
quotatotalworker stdout | 2024-04-22 04:33:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:33:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:33:16.054492+00:00 (in 14.999476 seconds)
quotatotalworker stdout | 2024-04-22 04:33:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:33:16 UTC)" (scheduled at 2024-04-22 04:33:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:33:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:33:01,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:33:01,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:33:16 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:33:01,615 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:33:01,738 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
securityscanningnotificationworker stdout | 2024-04-22 04:33:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:33:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:33:16.552337+00:00 (in 13.995584 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:33:02,557 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:34:02 UTC)" (scheduled at 2024-04-22 04:33:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:33:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:33:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:34:02 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:33:02,657 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:33:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:33:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:33:13.759375+00:00 (in 9.999424 seconds)
notificationworker stdout | 2024-04-22 04:33:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:33:13 UTC)" (scheduled at 2024-04-22 04:33:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:33:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:33:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 33, 3, 760293), True, datetime.datetime(2024, 4, 22, 4, 33, 3, 760293), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:33:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:33:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:33:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:33:13 UTC)" executed successfully
servicekey stdout | 2024-04-22 04:33:04,053 [93] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
servicekey stdout | 2024-04-22 04:33:04,053 [93] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 05:28:04.053182+00:00 (in 3299.999458 seconds)
servicekey stdout | 2024-04-22 04:33:04,053 [93] [INFO] [apscheduler.executors.default] Running job "ServiceKeyWorker._refresh_service_key (trigger: interval[0:55:00], next run at: 2024-04-22 05:28:04 UTC)" (scheduled at 2024-04-22 04:33:04.053182+00:00)
servicekey stdout | 2024-04-22 04:33:04,054 [93] [DEBUG] [__main__] Starting automatic refresh of service key DqSmkDsnqQT4kX8z98Vd1K2N_NQrUiM-LrUzIWQ-hsk to new expiration 2024-04-22 06:33:04.054052
servicekey stdout | 2024-04-22 04:33:04,054 [93] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE (("t1"."kid" = %s) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s))) LIMIT %s OFFSET %s', ['DqSmkDsnqQT4kX8z98Vd1K2N_NQrUiM-LrUzIWQ-hsk', datetime.datetime(2024, 4, 15, 4, 33, 4, 54228), None, 1, 0])
servicekey stdout | 2024-04-22 04:33:04,064 [93] [DEBUG] [peewee] ('UPDATE "servicekey" SET "name" = %s, "kid" = %s, "service" = %s, "jwk" = %s, "metadata" = %s, "created_date" = %s, "expiration_date" = %s, "rotation_duration" = %s, "approval_id" = %s WHERE ("servicekey"."id" = %s)', ['https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com:443', 'DqSmkDsnqQT4kX8z98Vd1K2N_NQrUiM-LrUzIWQ-hsk', 'quay', '{"n": "yBslD6e149PD2fCkAyl_k2sShwjXRoZTDbR9aTxM8kATDI1EFad_7kKCQ1P9tQj8f9-axTqqskEjSwBb8wQoe1mAK4S6OVGkB3VWEs8DgkaIIc9NVpNkbdt9LLN1xUu-R5Jnd6NOx8sBUIQV_-U2skBKBud9QOEPQH2-1oa9ycLVX3a_l-nYwCEOaDKBcm__X1UUSKmzg31zbE1ru-Uhf3DAY_a4kZnulkyjtsAMh_3Ew8XhmAcHXqXTii5LlYtzLTMmzTZJfJ2YJ8tGiPzW9-ynbQ2oH1hF-n4sdIlgcU5TKeaAM1pmFlQ1L5uay3TIkYJ0hzpdqEVFO0QkSY4Ipw", "e": "AQAB", "kty": "RSA", "kid": "DqSmkDsnqQT4kX8z98Vd1K2N_NQrUiM-LrUzIWQ-hsk"}', '{"created_by": "CLI tool"}', datetime.datetime(2024, 4, 22, 3, 33, 19, 436611), datetime.datetime(2024, 4, 22, 6, 33, 4, 54052), None, 2, 2])
servicekey stdout | 2024-04-22 04:33:04,067 [93] [DEBUG] [__main__] Finished automatic refresh of service key DqSmkDsnqQT4kX8z98Vd1K2N_NQrUiM-LrUzIWQ-hsk with new expiration 2024-04-22 06:33:04.054052
servicekey stdout | 2024-04-22 04:33:04,067 [93] [DEBUG] [data.database] Disconnecting from database.
servicekey stdout | 2024-04-22 04:33:04,068 [93] [INFO] [apscheduler.executors.default] Job "ServiceKeyWorker._refresh_service_key (trigger: interval[0:55:00], next run at: 2024-04-22 05:28:04 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:33:04,332 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:33:05,147 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:33:05,150 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:33:05,153 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
buildlogsarchiver stdout | 2024-04-22 04:33:05,665 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:33:05,711 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
securityworker stdout | 2024-04-22 04:33:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:33:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:33:26.873109+00:00 (in 21.000788 seconds)
securityworker stdout | 2024-04-22 04:33:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:33:35 UTC)" (scheduled at 2024-04-22 04:33:05.871852+00:00)
securityworker stdout | 2024-04-22 04:33:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:33:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:33:05,874 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:33:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:33:05,884 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:33:05,885 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:33:35 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:33:06,114 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
repositorygcworker stdout | 2024-04-22 04:33:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:33:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:33:13.555667+00:00 (in 7.002637 seconds)
repositorygcworker stdout | 2024-04-22 04:33:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:34:06 UTC)" (scheduled at 2024-04-22 04:33:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:33:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:33:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 33, 6, 553455), True, datetime.datetime(2024, 4, 22, 4, 33, 6, 553455), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:33:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:33:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:33:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:34:06 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:33:07,083 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:33:08,208 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:33:08,312 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:33:08,655 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:33:09,508 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:33:10,762 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:33:10,791 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
namespacegcworker stdout | 2024-04-22 04:33:11,213 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
manifestbackfillworker stdout | 2024-04-22 04:33:11,219 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
autopruneworker stdout | 2024-04-22 04:33:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:33:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:33:41.264267+00:00 (in 29.999452 seconds)
autopruneworker stdout | 2024-04-22 04:33:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:33:41 UTC)" (scheduled at 2024-04-22 04:33:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:33:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713760331271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:33:11,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:33:11,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:33:11,275 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:33:41 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:33:11,550 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:33:11,555 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:33:11,568 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:33:11,570 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:33:11,578 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:33:11,582 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:33:11,585 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:33:11,589 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:33:11,592 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
storagereplication stdout | 2024-04-22 04:33:12,671 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:33:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:33:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:34:06.552482+00:00 (in 52.996359 seconds)
repositorygcworker stdout | 2024-04-22 04:33:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:34:13 UTC)" (scheduled at 2024-04-22 04:33:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:33:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:33:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:34:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:33:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:33:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:33:19.762160+00:00 (in 6.002311 seconds)
notificationworker stdout | 2024-04-22 04:33:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:33:23 UTC)" (scheduled at 2024-04-22 04:33:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:33:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:33:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 33, 13, 760095), True, datetime.datetime(2024, 4, 22, 4, 33, 13, 760095), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:33:13,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:33:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:33:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:33:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:33:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:33:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:33:44.952062+00:00 (in 29.999568 seconds)
gcworker stdout | 2024-04-22 04:33:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:33:44 UTC)" (scheduled at 2024-04-22 04:33:14.952062+00:00)
gcworker stdout | 2024-04-22 04:33:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712550794952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:33:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:33:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:33:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:33:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:33:15,653 [281] [DEBUG] [app] Starting request: urn:request:1d57f6d5-1209-4aa1-8860-713141232b88 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:33:15,653 [282] [DEBUG] [app] Starting request: urn:request:79b8d8f5-f63e-4411-b61e-3b81a5d79d69 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:33:15,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:33:15,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:33:15,656 [292] [DEBUG] [app] Starting request: urn:request:ee1c0983-ea33-4052-8f66-96051ba959e7 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:33:15,656 [288] [DEBUG] [app] Starting request: urn:request:4adbd57f-2e8f-48b5-9dbe-b0d0d5b21e72 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:33:15,656 [288] [DEBUG] [app] Ending request: urn:request:4adbd57f-2e8f-48b5-9dbe-b0d0d5b21e72 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:4adbd57f-2e8f-48b5-9dbe-b0d0d5b21e72', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:33:15,656 [292] [DEBUG] [app] Ending request: urn:request:ee1c0983-ea33-4052-8f66-96051ba959e7 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:ee1c0983-ea33-4052-8f66-96051ba959e7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:33:15,657 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:33:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:33:15,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:33:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:33:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:33:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:33:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:33:15,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:33:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:33:15,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:33:15,659 [282] [DEBUG] [app] Starting request: urn:request:5cd74c60-190d-4a0a-a1d0-dae473095296 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:33:15,659 [278] [DEBUG] [app] Starting request: urn:request:48cdb35e-77db-4fff-a2e6-159a7d7b693e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:33:15,659 [282] [DEBUG] [app] Ending request: urn:request:5cd74c60-190d-4a0a-a1d0-dae473095296 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:5cd74c60-190d-4a0a-a1d0-dae473095296', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:33:15,660 [278] [DEBUG] [app] Ending request: urn:request:48cdb35e-77db-4fff-a2e6-159a7d7b693e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:48cdb35e-77db-4fff-a2e6-159a7d7b693e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:33:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:33:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:33:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:33:15,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:33:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:33:15,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:33:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:33:15,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:33:15,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:33:15,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:33:15,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:33:15,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:33:15,674 [281] [DEBUG] [app] Ending request: urn:request:1d57f6d5-1209-4aa1-8860-713141232b88 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:1d57f6d5-1209-4aa1-8860-713141232b88', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:33:15,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:33:15,674 [282] [DEBUG] [app] Ending request: urn:request:79b8d8f5-f63e-4411-b61e-3b81a5d79d69 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:79b8d8f5-f63e-4411-b61e-3b81a5d79d69', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:33:15,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:33:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:33:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:33:15,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:33:15,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:33:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:33:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotatotalworker stdout | 2024-04-22 04:33:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:33:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:33:31.054492+00:00 (in 14.999456 seconds)
quotatotalworker stdout | 2024-04-22 04:33:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:33:31 UTC)" (scheduled at 2024-04-22 04:33:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:33:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:33:16,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:33:16,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:33:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:33:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:33:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:34:02.556208+00:00 (in 46.003279 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:33:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:34:16 UTC)" (scheduled at 2024-04-22 04:33:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:33:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:33:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 33, 16, 553324), True, datetime.datetime(2024, 4, 22, 4, 33, 16, 553324), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:33:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:33:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:33:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:34:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:33:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:33:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:33:47.052354+00:00 (in 29.999510 seconds)
buildlogsarchiver stdout | 2024-04-22 04:33:17,052 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:33:47 UTC)" (scheduled at 2024-04-22 04:33:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:33:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 33, 17, 53037), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:33:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:33:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:33:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:33:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:33:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:33:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:33:23.759375+00:00 (in 3.996672 seconds)
notificationworker stdout | 2024-04-22 04:33:19,762 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:38:19 UTC)" (scheduled at 2024-04-22 04:33:19.762160+00:00)
notificationworker stdout | 2024-04-22 04:33:19,763 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 33, 19, 762978), 'notification/%'])
notificationworker stdout | 2024-04-22 04:33:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:34:19 UTC)" (scheduled at 2024-04-22 04:33:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:33:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:33:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:34:19 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:33:19,773 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 33, 19, 762978), True, datetime.datetime(2024, 4, 22, 4, 33, 19, 762978), 0, 'notification/%'])
notificationworker stdout | 2024-04-22 04:33:19,776 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 33, 19, 762978), True, datetime.datetime(2024, 4, 22, 4, 33, 19, 762978), 0, 'notification/%', False, datetime.datetime(2024, 4, 22, 4, 33, 19, 762978), 'notification/%'])
notificationworker stdout | 2024-04-22 04:33:19,778 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:33:19,778 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:38:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:33:21,840 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
namespacegcworker stdout | 2024-04-22 04:33:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:33:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:33:43.057186+00:00 (in 20.997745 seconds)
namespacegcworker stdout | 2024-04-22 04:33:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:34:22 UTC)" (scheduled at 2024-04-22 04:33:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:33:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:33:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:34:22 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:33:22,956 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:33:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:33:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:33:33.759375+00:00 (in 9.999416 seconds)
notificationworker stdout | 2024-04-22 04:33:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:33:33 UTC)" (scheduled at 2024-04-22 04:33:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:33:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:33:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 33, 23, 760234), True, datetime.datetime(2024, 4, 22, 4, 33, 23, 760234), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:33:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:33:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:33:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:33:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:33:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:33:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:34:24.361582+00:00 (in 59.999460 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:33:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:34:24 UTC)" (scheduled at 2024-04-22 04:33:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:33:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:33:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:33:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:34:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:33:26,640 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:33:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:33:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:33:35.871852+00:00 (in 8.998245 seconds)
securityworker stdout | 2024-04-22 04:33:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:33:56 UTC)" (scheduled at 2024-04-22 04:33:26.873109+00:00)
securityworker stdout | 2024-04-22 04:33:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:33:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:33:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:33:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:33:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:33:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:33:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:33:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:33:26,882 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:33:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:33:26,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:33:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:33:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 28, 26, 882095), 1, 2])
securityworker stdout | 2024-04-22 04:33:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:33:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:33:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 28, 26, 882095), 1, 2])
securityworker stdout | 2024-04-22 04:33:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:33:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:33:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:33:26,900 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:33:26,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:33:26,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:33:26,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:33:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:33:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:33:26,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:33:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:33:28,428 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:33:29,749 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:33:29,819 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:33:30,305 [278] [DEBUG] [app] Starting request: urn:request:28a9e599-d4b3-4ef5-86cf-14c735994027 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:33:30,305 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:33:30,305 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:33:30,306 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:33:30,315 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:33:30,315 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:33:30,315 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:33:30,315 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:33:30,315 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:33:30,315 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:33:30,315 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:33:30,315 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:33:30,317 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:33:30,324 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:33:30,325 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:33:30,329 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:33:30,334 [278] [DEBUG] [app] Ending request: urn:request:28a9e599-d4b3-4ef5-86cf-14c735994027 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:28a9e599-d4b3-4ef5-86cf-14c735994027', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:33:30,334 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:33:30,334 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:33:30 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:33:30 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1536 0.030)
gunicorn-web stdout | 2024-04-22 04:33:30,581 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:33:30,649 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:33:30,652 [279] [DEBUG] [app] Starting request: urn:request:39b7ca83-8f6f-4339-ba1f-928709033d5a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:33:30,653 [278] [DEBUG] [app] Starting request: urn:request:f685720d-ac54-4feb-bba2-d3f13da5b3b6 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:33:30,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:33:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:33:30,655 [291] [DEBUG] [app] Starting request: urn:request:d6475bcc-2bbf-4555-b3d4-5c02f8d6a7b3 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:33:30,656 [291] [DEBUG] [app] Ending request: urn:request:d6475bcc-2bbf-4555-b3d4-5c02f8d6a7b3 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:d6475bcc-2bbf-4555-b3d4-5c02f8d6a7b3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:33:30,656 [292] [DEBUG] [app] Starting request: urn:request:24fa5ac7-0834-4e58-8d45-11d464d217a0 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:33:30,656 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:33:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:33:30,656 [292] [DEBUG] [app] Ending request: urn:request:24fa5ac7-0834-4e58-8d45-11d464d217a0 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:24fa5ac7-0834-4e58-8d45-11d464d217a0', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:33:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:33:30,656 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:33:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:33:30,656 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:33:30,656 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:33:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:33:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:33:30,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:33:30,659 [281] [DEBUG] [app] Starting request: urn:request:018f487b-0138-40ae-8f70-34607a848ef4 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:33:30,659 [281] [DEBUG] [app] Ending request: urn:request:018f487b-0138-40ae-8f70-34607a848ef4 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:018f487b-0138-40ae-8f70-34607a848ef4', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:33:30,659 [282] [DEBUG] [app] Starting request: urn:request:823ef233-4bc3-4bc2-b27b-39a58c4f1fa6 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:33:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 04:33:30,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:33:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:33:30,660 [282] [DEBUG] [app] Ending request: urn:request:823ef233-4bc3-4bc2-b27b-39a58c4f1fa6 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:823ef233-4bc3-4bc2-b27b-39a58c4f1fa6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:33:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:33:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:33:30,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:33:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:33:30,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:33:30,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:33:30,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:33:30,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:33:30,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:33:30,674 [278] [DEBUG] [app] Ending request: urn:request:f685720d-ac54-4feb-bba2-d3f13da5b3b6 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f685720d-ac54-4feb-bba2-d3f13da5b3b6', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:33:30,674 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:33:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:33:30,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:33:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:33:30,674 [279] [DEBUG] [app] Ending request: urn:request:39b7ca83-8f6f-4339-ba1f-928709033d5a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:39b7ca83-8f6f-4339-ba1f-928709033d5a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:33:30,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:33:30,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:33:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:33:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:33:30,706 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:33:30,762 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:33:30,850 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
quotatotalworker stdout | 2024-04-22 04:33:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:33:31,054 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:33:46.054492+00:00 (in 14.999512 seconds)
quotatotalworker stdout | 2024-04-22 04:33:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:33:46 UTC)" (scheduled at 2024-04-22 04:33:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:33:31,055 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:33:31,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:33:31,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:33:46 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:33:31,645 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:33:31,775 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotaregistrysizeworker stdout | 2024-04-22 04:33:32,682 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:33:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:33:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:33:43.759375+00:00 (in 9.999517 seconds)
notificationworker stdout | 2024-04-22 04:33:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:33:43 UTC)" (scheduled at 2024-04-22 04:33:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:33:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:33:33,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 33, 33, 760173), True, datetime.datetime(2024, 4, 22, 4, 33, 33, 760173), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:33:33,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:33:33,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:33:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:33:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:33:34,362 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:33:35,155 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:33:35,158 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:33:35,162 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
buildlogsarchiver stdout | 2024-04-22 04:33:35,701 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:33:35,729 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
securityworker stdout | 2024-04-22 04:33:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:33:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:33:56.873109+00:00 (in 21.000751 seconds)
securityworker stdout | 2024-04-22 04:33:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:34:05 UTC)" (scheduled at 2024-04-22 04:33:35.871852+00:00)
securityworker stdout | 2024-04-22 04:33:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:33:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:33:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:33:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:33:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:33:35,887 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:33:35,890 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:33:35,890 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:33:35,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 28, 35, 876216), 1, 2])
securityworker stdout | 2024-04-22 04:33:35,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:33:35,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:33:35,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 28, 35, 876216), 1, 2])
securityworker stdout | 2024-04-22 04:33:35,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:33:35,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:33:35,895 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:33:35,895 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:34:05 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:33:36,149 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
logrotateworker stdout | 2024-04-22 04:33:37,116 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:33:38,245 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:33:38,339 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:33:38,671 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:33:39,545 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
exportactionlogsworker stdout | 2024-04-22 04:33:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:33:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:33:41.564959+00:00 (in 1.997478 seconds)
exportactionlogsworker stdout | 2024-04-22 04:33:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:34:39 UTC)" (scheduled at 2024-04-22 04:33:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:33:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:33:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:34:39 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:33:40,788 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:33:40,799 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
manifestbackfillworker stdout | 2024-04-22 04:33:41,232 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:33:41,250 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
autopruneworker stdout | 2024-04-22 04:33:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:33:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:34:11.264267+00:00 (in 29.999571 seconds)
autopruneworker stdout | 2024-04-22 04:33:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:34:11 UTC)" (scheduled at 2024-04-22 04:33:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:33:41,271 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713760361271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:33:41,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:33:41,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:33:41,275 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:34:11 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:33:41,558 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:33:41,564 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
exportactionlogsworker stdout | 2024-04-22 04:33:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:33:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:34:39.566970+00:00 (in 58.001569 seconds)
exportactionlogsworker stdout | 2024-04-22 04:33:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:34:41 UTC)" (scheduled at 2024-04-22 04:33:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:33:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:33:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 33, 41, 565726), True, datetime.datetime(2024, 4, 22, 4, 33, 41, 565726), 0, 'exportactionlogs/%', 50, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:33:41,576 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
exportactionlogsworker stdout | 2024-04-22 04:33:41,580 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:33:41,580 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:33:41,581 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:34:41 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:33:41,583 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:33:41,587 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:33:41,592 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:33:41,595 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:33:41,599 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:33:41,602 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
storagereplication stdout | 2024-04-22 04:33:42,685 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
namespacegcworker stdout | 2024-04-22 04:33:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:33:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:34:22.058978+00:00 (in 39.001360 seconds)
namespacegcworker stdout | 2024-04-22 04:33:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:34:43 UTC)" (scheduled at 2024-04-22 04:33:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:33:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:33:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 33, 43, 58007), True, datetime.datetime(2024, 4, 22, 4, 33, 43, 58007), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:33:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:33:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:33:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:34:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:33:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:33:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:33:53.759375+00:00 (in 9.999480 seconds)
notificationworker stdout | 2024-04-22 04:33:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:33:53 UTC)" (scheduled at 2024-04-22 04:33:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:33:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:33:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 33, 43, 760175), True, datetime.datetime(2024, 4, 22, 4, 33, 43, 760175), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:33:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:33:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:33:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:33:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:33:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:33:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:34:14.952062+00:00 (in 29.999542 seconds)
gcworker stdout | 2024-04-22 04:33:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:34:14 UTC)" (scheduled at 2024-04-22 04:33:44.952062+00:00)
gcworker stdout | 2024-04-22 04:33:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712550824952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:33:44,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:33:44,964 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:33:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:34:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:33:45,653 [278] [DEBUG] [app] Starting request: urn:request:7a4c6242-4a9f-456e-a6a5-04022b484d4f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:33:45,653 [281] [DEBUG] [app] Starting request: urn:request:15d2ca22-082f-46f0-ab7b-33f57f7b2c58 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:33:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:33:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:33:45,656 [288] [DEBUG] [app] Starting request: urn:request:e788cc13-3139-47ec-9ccb-cff860664713 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:33:45,656 [292] [DEBUG] [app] Starting request: urn:request:661ad16e-82f6-4768-b784-d5e9798c69bd (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:33:45,656 [288] [DEBUG] [app] Ending request: urn:request:e788cc13-3139-47ec-9ccb-cff860664713 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:e788cc13-3139-47ec-9ccb-cff860664713', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:33:45,656 [292] [DEBUG] [app] Ending request: urn:request:661ad16e-82f6-4768-b784-d5e9798c69bd (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:661ad16e-82f6-4768-b784-d5e9798c69bd', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:33:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:33:45,656 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:33:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:33:45,656 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:33:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:33:45,656 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:33:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:33:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:33:45,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:33:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:33:45,659 [282] [DEBUG] [app] Starting request: urn:request:2aa4d879-a8ce-4439-8022-3c146c7da1a0 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:33:45,659 [279] [DEBUG] [app] Starting request: urn:request:e5e46919-205f-4706-8f6d-66cab57debbe (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:33:45,659 [282] [DEBUG] [app] Ending request: urn:request:2aa4d879-a8ce-4439-8022-3c146c7da1a0 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:2aa4d879-a8ce-4439-8022-3c146c7da1a0', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:33:45,659 [279] [DEBUG] [app] Ending request: urn:request:e5e46919-205f-4706-8f6d-66cab57debbe (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:e5e46919-205f-4706-8f6d-66cab57debbe', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:33:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:33:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:33:45,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:33:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:33:45,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:33:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:33:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:33:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:33:45,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:33:45,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:33:45,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:33:45,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:33:45,674 [281] [DEBUG] [app] Ending request: urn:request:15d2ca22-082f-46f0-ab7b-33f57f7b2c58 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:15d2ca22-082f-46f0-ab7b-33f57f7b2c58', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:33:45,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:33:45,674 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:33:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:33:45,674 [278] [DEBUG] [app] Ending request: urn:request:7a4c6242-4a9f-456e-a6a5-04022b484d4f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:7a4c6242-4a9f-456e-a6a5-04022b484d4f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:33:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:33:45,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:33:45,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:33:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:33:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.023)
quotatotalworker stdout | 2024-04-22 04:33:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:33:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:34:01.054492+00:00 (in 14.999481 seconds)
quotatotalworker stdout | 2024-04-22 04:33:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:34:01 UTC)" (scheduled at 2024-04-22 04:33:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:33:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:33:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:33:46,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:34:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:33:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:33:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:34:17.052354+00:00 (in 29.999470 seconds)
buildlogsarchiver stdout | 2024-04-22 04:33:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:34:17 UTC)" (scheduled at 2024-04-22 04:33:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:33:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 33, 47, 53222), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:33:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:33:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:33:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:34:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:33:51,877 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:33:52,963 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:33:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:33:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:34:03.759375+00:00 (in 9.999432 seconds)
notificationworker stdout | 2024-04-22 04:33:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:34:03 UTC)" (scheduled at 2024-04-22 04:33:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:33:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:33:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 33, 53, 760282), True, datetime.datetime(2024, 4, 22, 4, 33, 53, 760282), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:33:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:33:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:33:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:34:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:33:56,677 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:33:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:33:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:34:05.871852+00:00 (in 8.998290 seconds)
securityworker stdout | 2024-04-22 04:33:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:34:26 UTC)" (scheduled at 2024-04-22 04:33:56.873109+00:00)
securityworker stdout | 2024-04-22 04:33:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:33:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:33:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:33:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:33:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:33:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:33:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:33:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:33:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:33:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:33:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:33:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:33:56,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 28, 56, 881191), 1, 2])
securityworker stdout | 2024-04-22 04:33:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:33:56,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:33:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 28, 56, 881191), 1, 2])
securityworker stdout | 2024-04-22 04:33:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:33:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:33:56,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:33:56,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:33:56,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:33:56,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:33:56,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:33:56,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:33:56,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:33:56,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:34:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:33:58,453 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:33:59,786 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:33:59,838 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:34:00,590 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:34:00,653 [282] [DEBUG] [app] Starting request: urn:request:bb3498a0-f484-43f2-ad52-4597f72da56a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:34:00,653 [278] [DEBUG] [app] Starting request: urn:request:67b6a08d-6cbc-4835-b888-c1e9236cb37f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:34:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:34:00,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:34:00,656 [284] [DEBUG] [app] Starting request: urn:request:261450b4-ac5c-4458-9a9b-e17b07a130d8 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:34:00,656 [284] [DEBUG] [app] Ending request: urn:request:261450b4-ac5c-4458-9a9b-e17b07a130d8 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:261450b4-ac5c-4458-9a9b-e17b07a130d8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:34:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:34:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:34:00,657 [292] [DEBUG] [app] Starting request: urn:request:3c5da305-f20a-4985-9dc6-f2765abb15d9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:34:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:34:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 04:34:00,657 [292] [DEBUG] [app] Ending request: urn:request:3c5da305-f20a-4985-9dc6-f2765abb15d9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:3c5da305-f20a-4985-9dc6-f2765abb15d9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:34:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:34:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:34:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:34:00,658 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:34:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:34:00,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:34:00,660 [279] [DEBUG] [app] Starting request: urn:request:2dff5f2e-ba37-4a02-a335-42bb3e02f705 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:34:00,660 [279] [DEBUG] [app] Ending request: urn:request:2dff5f2e-ba37-4a02-a335-42bb3e02f705 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:2dff5f2e-ba37-4a02-a335-42bb3e02f705', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:34:00,661 [281] [DEBUG] [app] Starting request: urn:request:beaf63e5-3df3-4fb8-9aca-48b8bcb232ad (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:34:00,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:34:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:34:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:34:00,661 [281] [DEBUG] [app] Ending request: urn:request:beaf63e5-3df3-4fb8-9aca-48b8bcb232ad (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:beaf63e5-3df3-4fb8-9aca-48b8bcb232ad', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:34:00,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:34:00,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:34:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:34:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:34:00,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:34:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:34:00,662 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:34:00,662 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:34:00,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:34:00,675 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:34:00,675 [282] [DEBUG] [app] Ending request: urn:request:bb3498a0-f484-43f2-ad52-4597f72da56a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:bb3498a0-f484-43f2-ad52-4597f72da56a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:34:00,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:34:00,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:34:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:34:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 04:34:00,683 [278] [DEBUG] [app] Ending request: urn:request:67b6a08d-6cbc-4835-b888-c1e9236cb37f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:67b6a08d-6cbc-4835-b888-c1e9236cb37f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:34:00,683 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:34:00,683 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:34:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:34:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.031 118 0.031)
gunicorn-web stdout | 2024-04-22 04:34:00,716 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:34:00,773 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:34:00,862 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
quotatotalworker stdout | 2024-04-22 04:34:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:34:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:34:16.054492+00:00 (in 14.999426 seconds)
quotatotalworker stdout | 2024-04-22 04:34:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:34:16 UTC)" (scheduled at 2024-04-22 04:34:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:34:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:34:01,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:34:01,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:34:16 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:34:01,463 [282] [DEBUG] [app] Starting request: urn:request:9b8cdbbc-0bab-4062-8b7e-63597109d7a4 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:34:01,463 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:34:01,463 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:34:01,464 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:34:01,473 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:34:01,473 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:34:01,473 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:34:01,473 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:34:01,473 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:34:01,473 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:34:01,473 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:34:01,474 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:34:01,476 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:34:01,482 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:34:01,483 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:34:01,488 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:34:01,492 [282] [DEBUG] [app] Ending request: urn:request:9b8cdbbc-0bab-4062-8b7e-63597109d7a4 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:9b8cdbbc-0bab-4062-8b7e-63597109d7a4', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:34:01,492 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:34:01,493 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:34:01 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:34:01 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.032 1536 0.032)
teamsyncworker stdout | 2024-04-22 04:34:01,665 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:34:01,785 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
securityscanningnotificationworker stdout | 2024-04-22 04:34:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:34:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:34:16.552337+00:00 (in 13.995584 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:34:02,557 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:35:02 UTC)" (scheduled at 2024-04-22 04:34:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:34:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:34:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:35:02 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:34:02,703 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:34:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:34:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:34:13.759375+00:00 (in 9.999421 seconds)
notificationworker stdout | 2024-04-22 04:34:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:34:13 UTC)" (scheduled at 2024-04-22 04:34:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:34:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:34:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 34, 3, 760265), True, datetime.datetime(2024, 4, 22, 4, 34, 3, 760265), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:34:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:34:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:34:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:34:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:34:04,398 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:34:05,163 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:34:05,168 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:34:05,171 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
buildlogsarchiver stdout | 2024-04-22 04:34:05,737 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:34:05,764 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
securityworker stdout | 2024-04-22 04:34:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:34:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:34:26.873109+00:00 (in 21.000728 seconds)
securityworker stdout | 2024-04-22 04:34:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:34:35 UTC)" (scheduled at 2024-04-22 04:34:05.871852+00:00)
securityworker stdout | 2024-04-22 04:34:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:34:05,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:34:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:34:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:34:05,885 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:34:05,886 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:34:35 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:34:06,186 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
repositorygcworker stdout | 2024-04-22 04:34:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:34:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:34:13.555667+00:00 (in 7.002674 seconds)
repositorygcworker stdout | 2024-04-22 04:34:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:35:06 UTC)" (scheduled at 2024-04-22 04:34:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:34:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:34:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 34, 6, 553408), True, datetime.datetime(2024, 4, 22, 4, 34, 6, 553408), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:34:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:34:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:34:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:35:06 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:34:07,144 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:34:08,259 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:34:08,365 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:34:08,700 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:34:09,582 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
queuecleanupworker stdout | 2024-04-22 04:34:10,816 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
securityworker stdout | 2024-04-22 04:34:10,822 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
manifestbackfillworker stdout | 2024-04-22 04:34:11,258 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
autopruneworker stdout | 2024-04-22 04:34:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:34:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:34:41.264267+00:00 (in 29.999579 seconds)
autopruneworker stdout | 2024-04-22 04:34:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:34:41 UTC)" (scheduled at 2024-04-22 04:34:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:34:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713760391271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:34:11,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:34:11,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:34:11,275 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:34:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:34:11,286 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
gunicorn-registry stdout | 2024-04-22 04:34:11,567 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:34:11,573 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:34:11,584 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:34:11,597 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:34:11,601 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:34:11,604 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:34:11,607 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:34:11,610 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:34:11,613 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
storagereplication stdout | 2024-04-22 04:34:12,723 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:34:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:34:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:35:06.552482+00:00 (in 52.996379 seconds)
repositorygcworker stdout | 2024-04-22 04:34:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:35:13 UTC)" (scheduled at 2024-04-22 04:34:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:34:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:34:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:35:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:34:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:34:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:34:19.762424+00:00 (in 6.002584 seconds)
notificationworker stdout | 2024-04-22 04:34:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:34:23 UTC)" (scheduled at 2024-04-22 04:34:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:34:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:34:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 34, 13, 760085), True, datetime.datetime(2024, 4, 22, 4, 34, 13, 760085), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:34:13,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:34:13,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:34:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:34:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:34:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:34:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:34:44.952062+00:00 (in 29.999529 seconds)
gcworker stdout | 2024-04-22 04:34:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:34:44 UTC)" (scheduled at 2024-04-22 04:34:14.952062+00:00)
gcworker stdout | 2024-04-22 04:34:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712550854952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:34:14,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:34:14,964 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:34:14,964 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:34:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:34:15,653 [281] [DEBUG] [app] Starting request: urn:request:753d3043-2c24-4f16-bf76-c1ab549e05e8 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:34:15,653 [282] [DEBUG] [app] Starting request: urn:request:afdbd760-cecb-4fa1-88a9-351b7e048c06 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:34:15,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:34:15,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:34:15,656 [284] [DEBUG] [app] Starting request: urn:request:0840d089-214f-45ee-a3ee-a9367095b908 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:34:15,656 [290] [DEBUG] [app] Starting request: urn:request:ec3223f6-1584-44ae-836a-73eeb32a1671 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:34:15,656 [284] [DEBUG] [app] Ending request: urn:request:0840d089-214f-45ee-a3ee-a9367095b908 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:0840d089-214f-45ee-a3ee-a9367095b908', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:34:15,656 [290] [DEBUG] [app] Ending request: urn:request:ec3223f6-1584-44ae-836a-73eeb32a1671 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:ec3223f6-1584-44ae-836a-73eeb32a1671', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:34:15,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:34:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:34:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:34:15,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:34:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:34:15,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:34:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:34:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:34:15,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:34:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:34:15,659 [281] [DEBUG] [app] Starting request: urn:request:5b8cba2c-cc28-4717-877a-04a5fa891e60 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:34:15,659 [281] [DEBUG] [app] Ending request: urn:request:5b8cba2c-cc28-4717-877a-04a5fa891e60 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:5b8cba2c-cc28-4717-877a-04a5fa891e60', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:34:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:34:15,659 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:34:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:34:15,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:34:15,660 [279] [DEBUG] [app] Starting request: urn:request:6cbbc2e3-b22b-49c2-b459-91e161232564 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:34:15,660 [279] [DEBUG] [app] Ending request: urn:request:6cbbc2e3-b22b-49c2-b459-91e161232564 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:6cbbc2e3-b22b-49c2-b459-91e161232564', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:34:15,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:34:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:34:15,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:34:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:34:15,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:34:15,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:34:15,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:34:15,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:34:15,673 [281] [DEBUG] [app] Ending request: urn:request:753d3043-2c24-4f16-bf76-c1ab549e05e8 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:753d3043-2c24-4f16-bf76-c1ab549e05e8', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:34:15,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:34:15,674 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:34:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:34:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:34:15,674 [282] [DEBUG] [app] Ending request: urn:request:afdbd760-cecb-4fa1-88a9-351b7e048c06 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:afdbd760-cecb-4fa1-88a9-351b7e048c06', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:34:15,674 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:34:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:34:15,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:34:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:34:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:34:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:34:31.054492+00:00 (in 14.999490 seconds)
quotatotalworker stdout | 2024-04-22 04:34:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:34:31 UTC)" (scheduled at 2024-04-22 04:34:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:34:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:34:16,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:34:16,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:34:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:34:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:34:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:35:02.556208+00:00 (in 46.003273 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:34:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:35:16 UTC)" (scheduled at 2024-04-22 04:34:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:34:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:34:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 34, 16, 553399), True, datetime.datetime(2024, 4, 22, 4, 34, 16, 553399), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:34:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:34:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:34:16,565 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:35:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:34:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:34:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:34:47.052354+00:00 (in 29.999464 seconds)
buildlogsarchiver stdout | 2024-04-22 04:34:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:34:47 UTC)" (scheduled at 2024-04-22 04:34:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:34:17,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 34, 17, 53550), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:34:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:34:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:34:17,065 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:34:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:34:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:34:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:34:23.759375+00:00 (in 3.996410 seconds)
notificationworker stdout | 2024-04-22 04:34:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:35:19 UTC)" (scheduled at 2024-04-22 04:34:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:34:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:34:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:35:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:34:21,914 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
namespacegcworker stdout | 2024-04-22 04:34:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:34:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:34:43.057186+00:00 (in 20.997674 seconds)
namespacegcworker stdout | 2024-04-22 04:34:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:35:22 UTC)" (scheduled at 2024-04-22 04:34:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:34:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:34:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:35:22 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:34:22,999 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:34:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:34:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:34:33.759375+00:00 (in 9.999463 seconds)
notificationworker stdout | 2024-04-22 04:34:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:34:33 UTC)" (scheduled at 2024-04-22 04:34:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:34:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:34:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 34, 23, 760194), True, datetime.datetime(2024, 4, 22, 4, 34, 23, 760194), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:34:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:34:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:34:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:34:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:34:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:34:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:35:24.361582+00:00 (in 59.999471 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:34:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:35:24 UTC)" (scheduled at 2024-04-22 04:34:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:34:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:34:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:34:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:35:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:34:26,697 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:34:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:34:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:34:35.871852+00:00 (in 8.998210 seconds)
securityworker stdout | 2024-04-22 04:34:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:34:56 UTC)" (scheduled at 2024-04-22 04:34:26.873109+00:00)
securityworker stdout | 2024-04-22 04:34:26,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:34:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:34:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:34:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:34:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:34:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:34:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:34:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:34:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:34:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:34:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:34:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:34:26,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 29, 26, 881021), 1, 2])
securityworker stdout | 2024-04-22 04:34:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:34:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:34:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 29, 26, 881021), 1, 2])
securityworker stdout | 2024-04-22 04:34:26,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:34:26,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:34:26,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:34:26,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:34:26,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:34:26,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:34:26,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:34:26,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:34:26,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:34:26,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:34:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:34:28,486 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:34:29,822 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:34:29,874 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:34:30,598 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:34:30,653 [281] [DEBUG] [app] Starting request: urn:request:63adccd5-78d3-4fc2-8f89-f9e4da49e481 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:34:30,653 [278] [DEBUG] [app] Starting request: urn:request:0e82f290-fa54-42ca-8591-8fb93ae94035 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:34:30,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:34:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:34:30,656 [284] [DEBUG] [app] Starting request: urn:request:07c83074-965d-4138-b7cb-622808f1e0a8 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:34:30,656 [292] [DEBUG] [app] Starting request: urn:request:28cde039-c6ca-496a-9b98-5098d2a355f7 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:34:30,656 [284] [DEBUG] [app] Ending request: urn:request:07c83074-965d-4138-b7cb-622808f1e0a8 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:07c83074-965d-4138-b7cb-622808f1e0a8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:34:30,656 [292] [DEBUG] [app] Ending request: urn:request:28cde039-c6ca-496a-9b98-5098d2a355f7 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:28cde039-c6ca-496a-9b98-5098d2a355f7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:34:30,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:34:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:34:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:34:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:34:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:34:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:34:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:34:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:34:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:34:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:34:30,659 [282] [DEBUG] [app] Starting request: urn:request:27669cdf-11ff-4169-a225-e3177726b3db (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:34:30,659 [282] [DEBUG] [app] Ending request: urn:request:27669cdf-11ff-4169-a225-e3177726b3db (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:27669cdf-11ff-4169-a225-e3177726b3db', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:34:30,660 [279] [DEBUG] [app] Starting request: urn:request:072f30a5-bf27-4261-ab3e-9d5b2b60525d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:34:30,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:34:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:34:30,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:34:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:34:30,660 [279] [DEBUG] [app] Ending request: urn:request:072f30a5-bf27-4261-ab3e-9d5b2b60525d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:072f30a5-bf27-4261-ab3e-9d5b2b60525d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:34:30,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:34:30,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:34:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:34:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:34:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:34:30,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:34:30,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:34:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:34:30,671 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:34:30,674 [281] [DEBUG] [app] Ending request: urn:request:63adccd5-78d3-4fc2-8f89-f9e4da49e481 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:63adccd5-78d3-4fc2-8f89-f9e4da49e481', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:34:30,674 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:34:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:34:30,674 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:34:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:34:30,674 [278] [DEBUG] [app] Ending request: urn:request:0e82f290-fa54-42ca-8591-8fb93ae94035 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:0e82f290-fa54-42ca-8591-8fb93ae94035', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:34:30,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:34:30,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:34:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:34:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:34:30,727 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:34:30,784 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:34:30,874 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
quotatotalworker stdout | 2024-04-22 04:34:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:34:31,054 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:34:46.054492+00:00 (in 14.999526 seconds)
quotatotalworker stdout | 2024-04-22 04:34:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:34:46 UTC)" (scheduled at 2024-04-22 04:34:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:34:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:34:31,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:34:31,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:34:46 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:34:31,690 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:34:31,801 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
gunicorn-web stdout | 2024-04-22 04:34:31,862 [282] [DEBUG] [app] Starting request: urn:request:eb24946e-549e-444b-a6db-d38f93608f62 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:34:31,863 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:34:31,863 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:34:31,863 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:34:31,872 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:34:31,872 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:34:31,872 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:34:31,872 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:34:31,872 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:34:31,872 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:34:31,872 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:34:31,872 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:34:31,874 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:34:31,881 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:34:31,881 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:34:31,886 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:34:31,890 [282] [DEBUG] [app] Ending request: urn:request:eb24946e-549e-444b-a6db-d38f93608f62 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:eb24946e-549e-444b-a6db-d38f93608f62', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:34:31,890 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:34:31,891 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:34:31 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:34:31 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1555 0.030)
quotaregistrysizeworker stdout | 2024-04-22 04:34:32,714 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:34:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:34:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:34:43.759375+00:00 (in 9.999465 seconds)
notificationworker stdout | 2024-04-22 04:34:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:34:43 UTC)" (scheduled at 2024-04-22 04:34:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:34:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:34:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 34, 33, 760277), True, datetime.datetime(2024, 4, 22, 4, 34, 33, 760277), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:34:33,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:34:33,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:34:33,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:34:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:34:34,434 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:34:35,172 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:34:35,176 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:34:35,178 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
buildlogsarchiver stdout | 2024-04-22 04:34:35,760 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:34:35,774 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
securityworker stdout | 2024-04-22 04:34:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:34:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:34:56.873109+00:00 (in 21.000807 seconds)
securityworker stdout | 2024-04-22 04:34:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:35:05 UTC)" (scheduled at 2024-04-22 04:34:35.871852+00:00)
securityworker stdout | 2024-04-22 04:34:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:34:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:34:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:34:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:34:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:34:35,888 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:34:35,890 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:34:35,891 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:34:35,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 29, 35, 876396), 1, 2])
securityworker stdout | 2024-04-22 04:34:35,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:34:35,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:34:35,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 29, 35, 876396), 1, 2])
securityworker stdout | 2024-04-22 04:34:35,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:34:35,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:34:35,896 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:34:35,896 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:35:05 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:34:36,221 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
logrotateworker stdout | 2024-04-22 04:34:37,169 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:34:38,295 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:34:38,401 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:34:38,735 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
exportactionlogsworker stdout | 2024-04-22 04:34:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:34:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:34:41.564959+00:00 (in 1.997526 seconds)
exportactionlogsworker stdout | 2024-04-22 04:34:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:35:39 UTC)" (scheduled at 2024-04-22 04:34:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:34:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:34:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:35:39 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 04:34:39,620 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:34:40,832 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:34:40,838 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
autopruneworker stdout | 2024-04-22 04:34:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:34:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:35:11.264267+00:00 (in 29.999527 seconds)
autopruneworker stdout | 2024-04-22 04:34:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:35:11 UTC)" (scheduled at 2024-04-22 04:34:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:34:41,271 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713760421271, None, 1, 0])
manifestbackfillworker stdout | 2024-04-22 04:34:41,271 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
autopruneworker stdout | 2024-04-22 04:34:41,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:34:41,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:34:41,275 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:35:11 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:34:41,321 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
exportactionlogsworker stdout | 2024-04-22 04:34:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:34:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:35:39.566970+00:00 (in 58.001527 seconds)
exportactionlogsworker stdout | 2024-04-22 04:34:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:35:41 UTC)" (scheduled at 2024-04-22 04:34:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:34:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:34:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 34, 41, 565851), True, datetime.datetime(2024, 4, 22, 4, 34, 41, 565851), 0, 'exportactionlogs/%', 50, 1, 0])
gunicorn-registry stdout | 2024-04-22 04:34:41,573 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
exportactionlogsworker stdout | 2024-04-22 04:34:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:34:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:34:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:35:41 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:34:41,581 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:34:41,590 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:34:41,608 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:34:41,610 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:34:41,613 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:34:41,616 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:34:41,622 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:34:41,624 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
storagereplication stdout | 2024-04-22 04:34:42,748 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
namespacegcworker stdout | 2024-04-22 04:34:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:34:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:35:22.058978+00:00 (in 39.001317 seconds)
namespacegcworker stdout | 2024-04-22 04:34:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:35:43 UTC)" (scheduled at 2024-04-22 04:34:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:34:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:34:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 34, 43, 58036), True, datetime.datetime(2024, 4, 22, 4, 34, 43, 58036), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:34:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:34:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:34:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:35:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:34:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:34:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:34:53.759375+00:00 (in 9.999478 seconds)
notificationworker stdout | 2024-04-22 04:34:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:34:53 UTC)" (scheduled at 2024-04-22 04:34:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:34:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:34:43,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 34, 43, 760169), True, datetime.datetime(2024, 4, 22, 4, 34, 43, 760169), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:34:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:34:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:34:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:34:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:34:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:34:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:35:14.952062+00:00 (in 29.999522 seconds)
gcworker stdout | 2024-04-22 04:34:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:35:14 UTC)" (scheduled at 2024-04-22 04:34:44.952062+00:00)
gcworker stdout | 2024-04-22 04:34:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712550884952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:34:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:34:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:34:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:35:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:34:45,653 [279] [DEBUG] [app] Starting request: urn:request:5fd14cf3-42a4-4d50-90b5-c5c1a82fdc55 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:34:45,653 [278] [DEBUG] [app] Starting request: urn:request:d9ad6029-aba9-4963-aec6-504e4f3b1466 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:34:45,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:34:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:34:45,656 [289] [DEBUG] [app] Starting request: urn:request:4c70f851-ad2c-4dea-90bc-e25f3455927e (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:34:45,656 [284] [DEBUG] [app] Starting request: urn:request:0bd7af70-087a-4969-838a-c0c45219a35a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:34:45,657 [284] [DEBUG] [app] Ending request: urn:request:0bd7af70-087a-4969-838a-c0c45219a35a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:0bd7af70-087a-4969-838a-c0c45219a35a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:34:45,657 [289] [DEBUG] [app] Ending request: urn:request:4c70f851-ad2c-4dea-90bc-e25f3455927e (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:4c70f851-ad2c-4dea-90bc-e25f3455927e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:34:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:34:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:34:45,657 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:34:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:34:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:34:45,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:34:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:34:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:34:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:34:45,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:34:45,659 [278] [DEBUG] [app] Starting request: urn:request:d13b7baf-66a3-42ac-9fb4-e0a317ca269d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:34:45,660 [278] [DEBUG] [app] Ending request: urn:request:d13b7baf-66a3-42ac-9fb4-e0a317ca269d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d13b7baf-66a3-42ac-9fb4-e0a317ca269d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:34:45,660 [282] [DEBUG] [app] Starting request: urn:request:65e797de-1641-4669-b368-5c39a2be1dcb (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:34:45,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:34:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:34:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:34:45,660 [282] [DEBUG] [app] Ending request: urn:request:65e797de-1641-4669-b368-5c39a2be1dcb (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:65e797de-1641-4669-b368-5c39a2be1dcb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:34:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:34:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:34:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:34:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:34:45,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:34:45,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:34:45,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:34:45,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:34:45,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:34:45,674 [278] [DEBUG] [app] Ending request: urn:request:d9ad6029-aba9-4963-aec6-504e4f3b1466 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:d9ad6029-aba9-4963-aec6-504e4f3b1466', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:34:45,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:34:45,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:34:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:34:45,674 [279] [DEBUG] [app] Ending request: urn:request:5fd14cf3-42a4-4d50-90b5-c5c1a82fdc55 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:5fd14cf3-42a4-4d50-90b5-c5c1a82fdc55', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:34:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:34:45,675 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:34:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:34:45,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:34:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:34:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:34:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:35:01.054492+00:00 (in 14.999475 seconds)
quotatotalworker stdout | 2024-04-22 04:34:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:35:01 UTC)" (scheduled at 2024-04-22 04:34:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:34:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:34:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:34:46,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:35:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:34:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:34:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:35:17.052354+00:00 (in 29.999484 seconds)
buildlogsarchiver stdout | 2024-04-22 04:34:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:35:17 UTC)" (scheduled at 2024-04-22 04:34:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:34:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 34, 47, 53081), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:34:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:34:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:34:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:35:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:34:51,950 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:34:53,008 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:34:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:34:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:35:03.759375+00:00 (in 9.999486 seconds)
notificationworker stdout | 2024-04-22 04:34:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:35:03 UTC)" (scheduled at 2024-04-22 04:34:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:34:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:34:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 34, 53, 760164), True, datetime.datetime(2024, 4, 22, 4, 34, 53, 760164), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:34:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:34:53,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:34:53,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:35:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:34:56,729 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:34:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:34:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:35:05.871852+00:00 (in 8.998302 seconds)
securityworker stdout | 2024-04-22 04:34:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:35:26 UTC)" (scheduled at 2024-04-22 04:34:56.873109+00:00)
securityworker stdout | 2024-04-22 04:34:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:34:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:34:56,875 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:34:56,875 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:34:56,875 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:34:56,875 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:34:56,875 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:34:56,878 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:34:56,879 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:34:56,888 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:34:56,891 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:34:56,891 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:34:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 29, 56, 879236), 1, 2])
securityworker stdout | 2024-04-22 04:34:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:34:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:34:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 29, 56, 879236), 1, 2])
securityworker stdout | 2024-04-22 04:34:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:34:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:34:56,896 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:34:56,896 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:34:56,896 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:34:56,896 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:34:56,896 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:34:56,897 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:34:56,897 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:34:56,897 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:35:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:34:58,500 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:34:59,848 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:34:59,911 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:35:00,606 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:35:00,653 [281] [DEBUG] [app] Starting request: urn:request:10615f43-392a-4805-a902-a573bebbfe34 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:35:00,653 [279] [DEBUG] [app] Starting request: urn:request:b48a13f7-5869-4472-a530-8bea18a946fc (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:35:00,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:35:00,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:35:00,656 [292] [DEBUG] [app] Starting request: urn:request:5b3486d1-cfa2-4c1b-b19b-3e2df5d1a541 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:35:00,656 [291] [DEBUG] [app] Starting request: urn:request:ae022f35-f9c8-43d2-928d-1e07be21b8ac (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:35:00,657 [292] [DEBUG] [app] Ending request: urn:request:5b3486d1-cfa2-4c1b-b19b-3e2df5d1a541 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5b3486d1-cfa2-4c1b-b19b-3e2df5d1a541', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:35:00,657 [291] [DEBUG] [app] Ending request: urn:request:ae022f35-f9c8-43d2-928d-1e07be21b8ac (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:ae022f35-f9c8-43d2-928d-1e07be21b8ac', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:35:00,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:35:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:35:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:35:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:35:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:35:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:35:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:35:00,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:35:00,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:35:00,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:35:00,659 [281] [DEBUG] [app] Starting request: urn:request:eda42b44-d319-4e22-9a50-e0484df457ff (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:35:00,660 [281] [DEBUG] [app] Ending request: urn:request:eda42b44-d319-4e22-9a50-e0484df457ff (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:eda42b44-d319-4e22-9a50-e0484df457ff', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:35:00,660 [278] [DEBUG] [app] Starting request: urn:request:b0c1a294-7cb7-4739-88c1-7ecde7314051 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:35:00,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:35:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:35:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:35:00,660 [278] [DEBUG] [app] Ending request: urn:request:b0c1a294-7cb7-4739-88c1-7ecde7314051 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b0c1a294-7cb7-4739-88c1-7ecde7314051', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:35:00,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:35:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:35:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:35:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:35:00,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:35:00,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:35:00,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:35:00,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:35:00,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:35:00,674 [281] [DEBUG] [app] Ending request: urn:request:10615f43-392a-4805-a902-a573bebbfe34 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:10615f43-392a-4805-a902-a573bebbfe34', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:35:00,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:35:00,674 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:35:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:35:00,674 [279] [DEBUG] [app] Ending request: urn:request:b48a13f7-5869-4472-a530-8bea18a946fc (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b48a13f7-5869-4472-a530-8bea18a946fc', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:35:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:35:00,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:35:00,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:35:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:35:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:35:00,683 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:35:00,737 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:35:00,796 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:35:00,887 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
quotatotalworker stdout | 2024-04-22 04:35:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:35:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:35:16.054492+00:00 (in 14.999475 seconds)
quotatotalworker stdout | 2024-04-22 04:35:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:35:16 UTC)" (scheduled at 2024-04-22 04:35:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:35:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:35:01,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:35:01,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:35:16 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:35:01,726 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:35:01,837 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
securityscanningnotificationworker stdout | 2024-04-22 04:35:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:35:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:35:16.552337+00:00 (in 13.995585 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:35:02,557 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:36:02 UTC)" (scheduled at 2024-04-22 04:35:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:35:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:35:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:36:02 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:35:02,750 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 04:35:03,131 [281] [DEBUG] [app] Starting request: urn:request:31c9722c-f564-419e-a02e-7e72327e6c8c (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:35:03,131 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:35:03,131 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:35:03,131 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:35:03,141 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:35:03,141 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:35:03,141 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:35:03,141 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:35:03,141 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:35:03,141 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:35:03,141 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:35:03,141 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:35:03,143 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:35:03,150 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:35:03,151 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:35:03,155 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:35:03,159 [281] [DEBUG] [app] Ending request: urn:request:31c9722c-f564-419e-a02e-7e72327e6c8c (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:31c9722c-f564-419e-a02e-7e72327e6c8c', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:35:03,160 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:35:03,160 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:35:03 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:35:03 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.031 1536 0.031)
notificationworker stdout | 2024-04-22 04:35:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:35:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:35:13.759375+00:00 (in 9.999461 seconds)
notificationworker stdout | 2024-04-22 04:35:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:35:13 UTC)" (scheduled at 2024-04-22 04:35:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:35:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:35:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 35, 3, 760256), True, datetime.datetime(2024, 4, 22, 4, 35, 3, 760256), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:35:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:35:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:35:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:35:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:35:04,451 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:35:05,179 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:35:05,183 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:35:05,185 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
buildlogsarchiver stdout | 2024-04-22 04:35:05,797 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:35:05,809 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
securityworker stdout | 2024-04-22 04:35:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:35:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:35:26.873109+00:00 (in 21.000766 seconds)
securityworker stdout | 2024-04-22 04:35:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:35:35 UTC)" (scheduled at 2024-04-22 04:35:05.871852+00:00)
securityworker stdout | 2024-04-22 04:35:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:35:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:35:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:35:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:35:05,884 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:35:05,885 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:35:35 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:35:06,255 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
repositorygcworker stdout | 2024-04-22 04:35:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:35:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:35:13.555667+00:00 (in 7.002743 seconds)
repositorygcworker stdout | 2024-04-22 04:35:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:36:06 UTC)" (scheduled at 2024-04-22 04:35:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:35:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:35:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 35, 6, 553299), True, datetime.datetime(2024, 4, 22, 4, 35, 6, 553299), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:35:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:35:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:35:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:36:06 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:35:07,187 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:35:08,313 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:35:08,422 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:35:08,747 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:35:09,642 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:35:10,860 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:35:10,873 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
autopruneworker stdout | 2024-04-22 04:35:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:35:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:35:41.264267+00:00 (in 29.999386 seconds)
autopruneworker stdout | 2024-04-22 04:35:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:35:41 UTC)" (scheduled at 2024-04-22 04:35:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:35:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713760451271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:35:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:35:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:35:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:35:41 UTC)" executed successfully
manifestbackfillworker stdout | 2024-04-22 04:35:11,287 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:35:11,357 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
gunicorn-registry stdout | 2024-04-22 04:35:11,585 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:35:11,593 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:35:11,601 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:35:11,617 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:35:11,619 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:35:11,622 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:35:11,627 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:35:11,631 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:35:11,635 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
storagereplication stdout | 2024-04-22 04:35:12,784 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:35:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:35:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:36:06.552482+00:00 (in 52.996374 seconds)
repositorygcworker stdout | 2024-04-22 04:35:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:36:13 UTC)" (scheduled at 2024-04-22 04:35:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:35:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:35:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:36:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:35:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:35:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:35:19.762424+00:00 (in 6.002524 seconds)
notificationworker stdout | 2024-04-22 04:35:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:35:23 UTC)" (scheduled at 2024-04-22 04:35:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:35:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:35:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 35, 13, 760183), True, datetime.datetime(2024, 4, 22, 4, 35, 13, 760183), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:35:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:35:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:35:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:35:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:35:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:35:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:35:44.952062+00:00 (in 29.999516 seconds)
gcworker stdout | 2024-04-22 04:35:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:35:44 UTC)" (scheduled at 2024-04-22 04:35:14.952062+00:00)
gcworker stdout | 2024-04-22 04:35:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712550914952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:35:14,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:35:14,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:35:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:35:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:35:15,504 [278] [DEBUG] [app] Starting request: urn:request:311a84d0-4cc0-4d4d-978f-cb846eb31047 (/api/v1/user/notifications) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:35:15,504 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:35:15,504 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:35:15,504 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:35:15,514 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:35:15,514 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:35:15,514 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:35:15,514 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:35:15,514 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:35:15,514 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:35:15,514 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:35:15,514 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:35:15,516 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."dismissed" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."dismissed" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', [False, 1, False, 1, 'admin', 6])
gunicorn-web stdout | 2024-04-22 04:35:15,521 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:35:15,523 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:35:15,525 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:35:15,527 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:35:15,530 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:35:15,532 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:35:15,534 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:35:15,536 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:35:15,538 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:35:15,540 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [10, 1, 0])
gunicorn-web stdout | 2024-04-22 04:35:15,542 [278] [DEBUG] [app] Ending request: urn:request:311a84d0-4cc0-4d4d-978f-cb846eb31047 (/api/v1/user/notifications) {'endpoint': 'api.usernotificationlist', 'request_id': 'urn:request:311a84d0-4cc0-4d4d-978f-cb846eb31047', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/notifications', 'path': '/api/v1/user/notifications', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:35:15,543 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:35:15,543 [278] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:35:15 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 3386 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:35:15 +0000] "GET /api/v1/user/notifications HTTP/1.1" 200 3386 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.041 1530 0.041)
gunicorn-web stdout | 2024-04-22 04:35:15,653 [278] [DEBUG] [app] Starting request: urn:request:28d99312-611c-403b-a226-d36a02f3615a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:35:15,653 [279] [DEBUG] [app] Starting request: urn:request:d84c8727-9c76-4383-abf0-4392c6843b17 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:35:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:35:15,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:35:15,656 [284] [DEBUG] [app] Starting request: urn:request:8955571c-3d66-4606-9dff-2915f7d44bcb (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:35:15,656 [284] [DEBUG] [app] Ending request: urn:request:8955571c-3d66-4606-9dff-2915f7d44bcb (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:8955571c-3d66-4606-9dff-2915f7d44bcb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:35:15,656 [292] [DEBUG] [app] Starting request: urn:request:2fe00c77-d033-4572-8885-692a831d9499 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:35:15,656 [292] [DEBUG] [app] Ending request: urn:request:2fe00c77-d033-4572-8885-692a831d9499 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:2fe00c77-d033-4572-8885-692a831d9499', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:35:15,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:35:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:35:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:35:15,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:35:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:35:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:35:15,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:35:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:35:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:35:15,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:35:15,659 [281] [DEBUG] [app] Starting request: urn:request:ceb16210-1b88-46d2-89a8-bd671fd347fe (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:35:15,659 [278] [DEBUG] [app] Starting request: urn:request:77608fcd-37aa-4d0d-bb72-18238e670d60 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:35:15,659 [278] [DEBUG] [app] Ending request: urn:request:77608fcd-37aa-4d0d-bb72-18238e670d60 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:77608fcd-37aa-4d0d-bb72-18238e670d60', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:35:15,659 [281] [DEBUG] [app] Ending request: urn:request:ceb16210-1b88-46d2-89a8-bd671fd347fe (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:ceb16210-1b88-46d2-89a8-bd671fd347fe', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:35:15,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:35:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:35:15,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:35:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:35:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:35:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:35:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:35:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:35:15,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:35:15,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:35:15,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:35:15,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:35:15,673 [279] [DEBUG] [app] Ending request: urn:request:d84c8727-9c76-4383-abf0-4392c6843b17 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:d84c8727-9c76-4383-abf0-4392c6843b17', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:35:15,674 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:35:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:35:15,674 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:35:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:35:15,674 [278] [DEBUG] [app] Ending request: urn:request:28d99312-611c-403b-a226-d36a02f3615a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:28d99312-611c-403b-a226-d36a02f3615a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:35:15,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:35:15,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:35:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:35:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.023)
quotatotalworker stdout | 2024-04-22 04:35:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:35:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:35:31.054492+00:00 (in 14.999491 seconds)
quotatotalworker stdout | 2024-04-22 04:35:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:35:31 UTC)" (scheduled at 2024-04-22 04:35:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:35:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:35:16,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:35:16,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:35:31 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:35:16,219 [281] [DEBUG] [app] Starting request: urn:request:e1668816-562b-4cce-a922-43ca81725819 (/api/v1/user/apptoken) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:35:16,219 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:35:16,219 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:35:16,220 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:35:16,228 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:35:16,228 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:35:16,228 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:35:16,228 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:35:16,228 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:35:16,228 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:35:16,228 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:35:16,228 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:35:16,229 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."uuid", "t1"."title", "t1"."token_name", "t1"."token_secret", "t1"."created", "t1"."expiration", "t1"."last_accessed" FROM "appspecificauthtoken" AS "t1" WHERE ((("t1"."user_id" = %s) AND ("t1"."expiration" <= %s)) AND ("t1"."expiration" > %s))', [1, datetime.datetime(2024, 4, 24, 23, 47, 16, 228940), datetime.datetime(2024, 4, 22, 4, 35, 16, 228979)])
gunicorn-web stdout | 2024-04-22 04:35:16,231 [281] [DEBUG] [app] Ending request: urn:request:e1668816-562b-4cce-a922-43ca81725819 (/api/v1/user/apptoken) {'endpoint': 'api.apptokens', 'request_id': 'urn:request:e1668816-562b-4cce-a922-43ca81725819', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/apptoken?expiring=true', 'path': '/api/v1/user/apptoken', 'parameters': {'expiring': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:35:16,232 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:35:16,232 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:35:16 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:35:16 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.1" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.014 1520 0.014)
securityscanningnotificationworker stdout | 2024-04-22 04:35:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:35:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:36:02.556208+00:00 (in 46.003306 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:35:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:36:16 UTC)" (scheduled at 2024-04-22 04:35:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:35:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:35:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 35, 16, 553349), True, datetime.datetime(2024, 4, 22, 4, 35, 16, 553349), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:35:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:35:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:35:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:36:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:35:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:35:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:35:47.052354+00:00 (in 29.999472 seconds)
buildlogsarchiver stdout | 2024-04-22 04:35:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:35:47 UTC)" (scheduled at 2024-04-22 04:35:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:35:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 35, 17, 53238), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:35:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:35:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:35:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:35:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:35:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:35:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:35:23.759375+00:00 (in 3.996419 seconds)
notificationworker stdout | 2024-04-22 04:35:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:36:19 UTC)" (scheduled at 2024-04-22 04:35:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:35:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:35:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:36:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:35:21,986 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
namespacegcworker stdout | 2024-04-22 04:35:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:35:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:35:43.057186+00:00 (in 20.997723 seconds)
namespacegcworker stdout | 2024-04-22 04:35:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:36:22 UTC)" (scheduled at 2024-04-22 04:35:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:35:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:35:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:36:22 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:35:23,044 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:35:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:35:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:35:33.759375+00:00 (in 9.999485 seconds)
notificationworker stdout | 2024-04-22 04:35:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:35:33 UTC)" (scheduled at 2024-04-22 04:35:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:35:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:35:23,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 35, 23, 760165), True, datetime.datetime(2024, 4, 22, 4, 35, 23, 760165), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:35:23,784 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:35:23,784 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:35:23,784 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:35:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:35:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:35:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:36:24.361582+00:00 (in 59.999482 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:35:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:36:24 UTC)" (scheduled at 2024-04-22 04:35:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:35:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:35:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:35:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:36:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:35:26,747 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:35:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:35:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:35:35.871852+00:00 (in 8.998251 seconds)
securityworker stdout | 2024-04-22 04:35:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:35:56 UTC)" (scheduled at 2024-04-22 04:35:26.873109+00:00)
securityworker stdout | 2024-04-22 04:35:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:35:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:35:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:35:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:35:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:35:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:35:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:35:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:35:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:35:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:35:26,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:35:26,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:35:26,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 30, 26, 880899), 1, 2])
securityworker stdout | 2024-04-22 04:35:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:35:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:35:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 30, 26, 880899), 1, 2])
securityworker stdout | 2024-04-22 04:35:26,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:35:26,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:35:26,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:35:26,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:35:26,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:35:26,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:35:26,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:35:26,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:35:26,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:35:26,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:35:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:35:28,536 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:35:29,885 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:35:29,936 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:35:30,614 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:35:30,653 [279] [DEBUG] [app] Starting request: urn:request:31ba4dcb-0295-496f-8d19-c289c2dff55a (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:35:30,653 [282] [DEBUG] [app] Starting request: urn:request:f6b9b261-4dcb-4ffa-a9eb-57ac67db4107 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:35:30,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:35:30,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:35:30,656 [291] [DEBUG] [app] Starting request: urn:request:125f17f2-c009-4738-b464-2eae9a38a289 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:35:30,656 [284] [DEBUG] [app] Starting request: urn:request:4f8ca35d-90e6-4910-924d-ceb4e06f36a9 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:35:30,657 [291] [DEBUG] [app] Ending request: urn:request:125f17f2-c009-4738-b464-2eae9a38a289 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:125f17f2-c009-4738-b464-2eae9a38a289', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:35:30,657 [284] [DEBUG] [app] Ending request: urn:request:4f8ca35d-90e6-4910-924d-ceb4e06f36a9 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:4f8ca35d-90e6-4910-924d-ceb4e06f36a9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:35:30,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:35:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:35:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:35:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:35:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:35:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:35:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:35:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:35:30,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:35:30,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:35:30,659 [279] [DEBUG] [app] Starting request: urn:request:b86365fd-37d9-46bc-baa4-2f962fe8c311 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:35:30,660 [279] [DEBUG] [app] Ending request: urn:request:b86365fd-37d9-46bc-baa4-2f962fe8c311 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b86365fd-37d9-46bc-baa4-2f962fe8c311', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:35:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:35:30,660 [278] [DEBUG] [app] Starting request: urn:request:a8e1ad53-b71b-4630-b43b-321c64cb124d (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:35:30,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:35:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:35:30,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:35:30,660 [278] [DEBUG] [app] Ending request: urn:request:a8e1ad53-b71b-4630-b43b-321c64cb124d (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:a8e1ad53-b71b-4630-b43b-321c64cb124d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:35:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:35:30,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:35:30,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:35:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:35:30,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:35:30,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:35:30,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:35:30,668 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:35:30,675 [282] [DEBUG] [app] Ending request: urn:request:f6b9b261-4dcb-4ffa-a9eb-57ac67db4107 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f6b9b261-4dcb-4ffa-a9eb-57ac67db4107', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:35:30,675 [279] [DEBUG] [app] Ending request: urn:request:31ba4dcb-0295-496f-8d19-c289c2dff55a (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:31ba4dcb-0295-496f-8d19-c289c2dff55a', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:35:30,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:35:30,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:35:30,676 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:35:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:35:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:35:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 04:35:30,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:35:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:35:30,692 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:35:30,748 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:35:30,806 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:35:30,900 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
quotatotalworker stdout | 2024-04-22 04:35:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:35:31,054 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:35:46.054492+00:00 (in 14.999547 seconds)
quotatotalworker stdout | 2024-04-22 04:35:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:35:46 UTC)" (scheduled at 2024-04-22 04:35:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:35:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:35:31,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:35:31,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:35:46 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:35:31,763 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:35:31,873 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotaregistrysizeworker stdout | 2024-04-22 04:35:32,757 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
gunicorn-web stdout | 2024-04-22 04:35:33,531 [281] [DEBUG] [app] Starting request: urn:request:ca05d3d2-e2f7-42f8-9629-3e935d9b8d56 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:35:33,531 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:35:33,531 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:35:33,532 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:35:33,541 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:35:33,541 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:35:33,541 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:35:33,541 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:35:33,541 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:35:33,541 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:35:33,541 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:35:33,541 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:35:33,543 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:35:33,549 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:35:33,550 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:35:33,555 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:35:33,559 [281] [DEBUG] [app] Ending request: urn:request:ca05d3d2-e2f7-42f8-9629-3e935d9b8d56 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:ca05d3d2-e2f7-42f8-9629-3e935d9b8d56', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:35:33,559 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:35:33,559 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:35:33 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:35:33 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.029 1536 0.029)
notificationworker stdout | 2024-04-22 04:35:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:35:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:35:43.759375+00:00 (in 9.999471 seconds)
notificationworker stdout | 2024-04-22 04:35:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:35:43 UTC)" (scheduled at 2024-04-22 04:35:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:35:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:35:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 35, 33, 760228), True, datetime.datetime(2024, 4, 22, 4, 35, 33, 760228), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:35:33,778 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:35:33,779 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:35:33,779 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:35:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:35:34,469 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:35:35,187 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:35:35,191 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:35:35,194 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
buildlogsarchiver stdout | 2024-04-22 04:35:35,817 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:35:35,838 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
securityworker stdout | 2024-04-22 04:35:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:35:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:35:56.873109+00:00 (in 21.000807 seconds)
securityworker stdout | 2024-04-22 04:35:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:36:05 UTC)" (scheduled at 2024-04-22 04:35:35.871852+00:00)
securityworker stdout | 2024-04-22 04:35:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:35:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:35:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:35:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:35:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:35:35,887 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:35:35,890 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:35:35,890 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:35:35,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 30, 35, 876135), 1, 2])
securityworker stdout | 2024-04-22 04:35:35,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:35:35,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:35:35,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 30, 35, 876135), 1, 2])
securityworker stdout | 2024-04-22 04:35:35,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:35:35,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:35:35,895 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:35:35,895 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:36:05 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:35:36,292 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
logrotateworker stdout | 2024-04-22 04:35:37,201 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:35:38,325 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:35:38,458 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:35:38,786 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
exportactionlogsworker stdout | 2024-04-22 04:35:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:35:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:35:41.564959+00:00 (in 1.997468 seconds)
exportactionlogsworker stdout | 2024-04-22 04:35:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:36:39 UTC)" (scheduled at 2024-04-22 04:35:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:35:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:35:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:36:39 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 04:35:39,677 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:35:40,896 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:35:40,905 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
autopruneworker stdout | 2024-04-22 04:35:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:35:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:36:11.264267+00:00 (in 29.999464 seconds)
autopruneworker stdout | 2024-04-22 04:35:41,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:36:11 UTC)" (scheduled at 2024-04-22 04:35:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:35:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713760481271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:35:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:35:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:35:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:36:11 UTC)" executed successfully
manifestbackfillworker stdout | 2024-04-22 04:35:41,309 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:35:41,392 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
exportactionlogsworker stdout | 2024-04-22 04:35:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:35:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:36:39.566970+00:00 (in 58.001501 seconds)
exportactionlogsworker stdout | 2024-04-22 04:35:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:36:41 UTC)" (scheduled at 2024-04-22 04:35:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:35:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:35:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 35, 41, 565905), True, datetime.datetime(2024, 4, 22, 4, 35, 41, 565905), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:35:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:35:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:35:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:36:41 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:35:41,598 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:35:41,601 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:35:41,612 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:35:41,626 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:35:41,628 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:35:41,633 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:35:41,637 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:35:41,641 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:35:41,645 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
storagereplication stdout | 2024-04-22 04:35:42,815 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
namespacegcworker stdout | 2024-04-22 04:35:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:35:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:36:22.058978+00:00 (in 39.001272 seconds)
namespacegcworker stdout | 2024-04-22 04:35:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:36:43 UTC)" (scheduled at 2024-04-22 04:35:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:35:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:35:43,059 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 35, 43, 58143), True, datetime.datetime(2024, 4, 22, 4, 35, 43, 58143), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:35:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:35:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:35:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:36:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:35:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:35:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:35:53.759375+00:00 (in 9.999490 seconds)
notificationworker stdout | 2024-04-22 04:35:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:35:53 UTC)" (scheduled at 2024-04-22 04:35:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:35:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:35:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 35, 43, 760153), True, datetime.datetime(2024, 4, 22, 4, 35, 43, 760153), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:35:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:35:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:35:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:35:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:35:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:35:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:36:14.952062+00:00 (in 29.999539 seconds)
gcworker stdout | 2024-04-22 04:35:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:36:14 UTC)" (scheduled at 2024-04-22 04:35:44.952062+00:00)
gcworker stdout | 2024-04-22 04:35:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712550944952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:35:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:35:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:35:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:36:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:35:45,653 [279] [DEBUG] [app] Starting request: urn:request:57ee71ac-f68e-4b97-a5f0-9573fccfd7cc (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:35:45,653 [282] [DEBUG] [app] Starting request: urn:request:ea0d64a3-f0ad-4117-b346-d8957e5bb77b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:35:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:35:45,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:35:45,656 [292] [DEBUG] [app] Starting request: urn:request:7f020540-d9bb-4bae-9f68-57ab55e88879 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:35:45,656 [289] [DEBUG] [app] Starting request: urn:request:cfb626ca-33f5-4b0a-b32a-e8fa77005a0c (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:35:45,656 [289] [DEBUG] [app] Ending request: urn:request:cfb626ca-33f5-4b0a-b32a-e8fa77005a0c (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:cfb626ca-33f5-4b0a-b32a-e8fa77005a0c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:35:45,656 [292] [DEBUG] [app] Ending request: urn:request:7f020540-d9bb-4bae-9f68-57ab55e88879 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7f020540-d9bb-4bae-9f68-57ab55e88879', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:35:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:35:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:35:45,657 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:35:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:35:45,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:35:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:35:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:35:45,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:35:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:35:45,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:35:45,659 [279] [DEBUG] [app] Starting request: urn:request:60852d73-1c6d-461c-a451-00470b577718 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:35:45,659 [279] [DEBUG] [app] Ending request: urn:request:60852d73-1c6d-461c-a451-00470b577718 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:60852d73-1c6d-461c-a451-00470b577718', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:35:45,659 [278] [DEBUG] [app] Starting request: urn:request:c452d5ec-3398-4867-8fcd-dfc48a0fa197 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:35:45,659 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:35:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:35:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.000 159 0.000)
gunicorn-web stdout | 2024-04-22 04:35:45,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:35:45,660 [278] [DEBUG] [app] Ending request: urn:request:c452d5ec-3398-4867-8fcd-dfc48a0fa197 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:c452d5ec-3398-4867-8fcd-dfc48a0fa197', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:35:45,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:35:45,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:35:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:35:45,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:35:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.001)
gunicorn-web stdout | 2024-04-22 04:35:45,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:35:45,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:35:45,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:35:45,673 [279] [DEBUG] [app] Ending request: urn:request:57ee71ac-f68e-4b97-a5f0-9573fccfd7cc (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:57ee71ac-f68e-4b97-a5f0-9573fccfd7cc', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:35:45,673 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:35:45,674 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:35:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:35:45,674 [282] [DEBUG] [app] Ending request: urn:request:ea0d64a3-f0ad-4117-b346-d8957e5bb77b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:ea0d64a3-f0ad-4117-b346-d8957e5bb77b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:35:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:35:45,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:35:45,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:35:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:35:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
quotatotalworker stdout | 2024-04-22 04:35:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:35:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:36:01.054492+00:00 (in 14.999484 seconds)
quotatotalworker stdout | 2024-04-22 04:35:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:36:01 UTC)" (scheduled at 2024-04-22 04:35:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:35:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:35:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:35:46,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:36:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:35:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:35:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:36:17.052354+00:00 (in 29.999459 seconds)
buildlogsarchiver stdout | 2024-04-22 04:35:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:36:17 UTC)" (scheduled at 2024-04-22 04:35:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:35:47,054 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 35, 47, 53270), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:35:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:35:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:35:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:36:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:35:52,010 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:35:53,072 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:35:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:35:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:36:03.759375+00:00 (in 9.999489 seconds)
notificationworker stdout | 2024-04-22 04:35:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:36:03 UTC)" (scheduled at 2024-04-22 04:35:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:35:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:35:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 35, 53, 760264), True, datetime.datetime(2024, 4, 22, 4, 35, 53, 760264), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:35:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:35:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:35:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:36:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:35:56,781 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:35:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:35:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:36:05.871852+00:00 (in 8.998263 seconds)
securityworker stdout | 2024-04-22 04:35:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:36:26 UTC)" (scheduled at 2024-04-22 04:35:56.873109+00:00)
securityworker stdout | 2024-04-22 04:35:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:35:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:35:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:35:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:35:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:35:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:35:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:35:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:35:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:35:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:35:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:35:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:35:56,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 30, 56, 881027), 1, 2])
securityworker stdout | 2024-04-22 04:35:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:35:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:35:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 30, 56, 881027), 1, 2])
securityworker stdout | 2024-04-22 04:35:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:35:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:35:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:35:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:35:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:35:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:35:56,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:35:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:35:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:35:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:36:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:35:58,573 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:35:59,922 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:35:59,972 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:36:00,622 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:36:00,653 [279] [DEBUG] [app] Starting request: urn:request:0f540a25-cc11-4178-b06d-f06ea0205aee (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:36:00,653 [281] [DEBUG] [app] Starting request: urn:request:58caa902-baa2-4bf0-949b-4baa5021e82e (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:36:00,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:36:00,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:36:00,656 [284] [DEBUG] [app] Starting request: urn:request:27ae38b1-1bf0-4fc5-a6d8-5552aa678b03 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:36:00,656 [292] [DEBUG] [app] Starting request: urn:request:441afe8c-4124-4216-a9d3-2fec04406db8 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:36:00,656 [284] [DEBUG] [app] Ending request: urn:request:27ae38b1-1bf0-4fc5-a6d8-5552aa678b03 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:27ae38b1-1bf0-4fc5-a6d8-5552aa678b03', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:36:00,657 [292] [DEBUG] [app] Ending request: urn:request:441afe8c-4124-4216-a9d3-2fec04406db8 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:441afe8c-4124-4216-a9d3-2fec04406db8', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:36:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:36:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:36:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:36:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:36:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:36:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:36:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:36:00,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:36:00,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:36:00,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:36:00,660 [278] [DEBUG] [app] Starting request: urn:request:352abb8e-c756-47f9-8e1a-1d5f684a1385 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:36:00,660 [282] [DEBUG] [app] Starting request: urn:request:091e491f-034e-4b8f-9710-cc1a2e5d4d8f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:36:00,660 [278] [DEBUG] [app] Ending request: urn:request:352abb8e-c756-47f9-8e1a-1d5f684a1385 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:352abb8e-c756-47f9-8e1a-1d5f684a1385', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:36:00,660 [282] [DEBUG] [app] Ending request: urn:request:091e491f-034e-4b8f-9710-cc1a2e5d4d8f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:091e491f-034e-4b8f-9710-cc1a2e5d4d8f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:36:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:36:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:36:00,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:36:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:36:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:36:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 04:36:00,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:36:00,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:36:00,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:36:00,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:36:00,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:36:00,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:36:00,675 [279] [DEBUG] [app] Ending request: urn:request:0f540a25-cc11-4178-b06d-f06ea0205aee (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:0f540a25-cc11-4178-b06d-f06ea0205aee', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:36:00,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:36:00,675 [281] [DEBUG] [app] Ending request: urn:request:58caa902-baa2-4bf0-949b-4baa5021e82e (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:58caa902-baa2-4bf0-949b-4baa5021e82e', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:36:00,676 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:36:00,676 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:36:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:36:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:36:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 04:36:00,676 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:36:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:36:00,702 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:36:00,757 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:36:00,816 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:36:00,912 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
quotatotalworker stdout | 2024-04-22 04:36:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:36:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:36:16.054492+00:00 (in 14.999500 seconds)
quotatotalworker stdout | 2024-04-22 04:36:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:36:16 UTC)" (scheduled at 2024-04-22 04:36:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:36:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:36:01,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:36:01,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:36:16 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:36:01,776 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:36:01,910 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
securityscanningnotificationworker stdout | 2024-04-22 04:36:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:36:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:36:16.552337+00:00 (in 13.995603 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:36:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:37:02 UTC)" (scheduled at 2024-04-22 04:36:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:36:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:36:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:37:02 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:36:02,769 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:36:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:36:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:36:13.759375+00:00 (in 9.999442 seconds)
notificationworker stdout | 2024-04-22 04:36:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:36:13 UTC)" (scheduled at 2024-04-22 04:36:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:36:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:36:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 36, 3, 760231), True, datetime.datetime(2024, 4, 22, 4, 36, 3, 760231), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:36:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:36:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:36:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:36:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:36:04,500 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-web stdout | 2024-04-22 04:36:04,665 [282] [DEBUG] [app] Starting request: urn:request:adfcff61-c75e-4fa6-a9af-6521824608b9 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:36:04,665 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:36:04,665 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:36:04,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:36:04,675 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:36:04,675 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:36:04,675 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:36:04,675 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:36:04,675 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:36:04,675 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:36:04,675 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:36:04,675 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:36:04,677 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:36:04,684 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:36:04,685 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:36:04,689 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:36:04,693 [282] [DEBUG] [app] Ending request: urn:request:adfcff61-c75e-4fa6-a9af-6521824608b9 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:adfcff61-c75e-4fa6-a9af-6521824608b9', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:36:04,693 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:36:04 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1536 0.030)
gunicorn-web stdout | 2024-04-22 04:36:04,694 [282] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:36:04 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
gunicorn-secscan stdout | 2024-04-22 04:36:05,197 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:36:05,200 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:36:05,203 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
buildlogsarchiver stdout | 2024-04-22 04:36:05,853 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
securityworker stdout | 2024-04-22 04:36:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:36:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:36:26.873109+00:00 (in 21.000818 seconds)
securityworker stdout | 2024-04-22 04:36:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:36:35 UTC)" (scheduled at 2024-04-22 04:36:05.871852+00:00)
securityworker stdout | 2024-04-22 04:36:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:36:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
gcworker stdout | 2024-04-22 04:36:05,873 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
securityworker stdout | 2024-04-22 04:36:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:36:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:36:05,885 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:36:05,885 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:36:35 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:36:06,300 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
repositorygcworker stdout | 2024-04-22 04:36:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:36:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:36:13.555667+00:00 (in 7.002678 seconds)
repositorygcworker stdout | 2024-04-22 04:36:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:37:06 UTC)" (scheduled at 2024-04-22 04:36:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:36:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:36:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 36, 6, 553377), True, datetime.datetime(2024, 4, 22, 4, 36, 6, 553377), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:36:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:36:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:36:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:37:06 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:36:07,214 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:36:08,350 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:36:08,486 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:36:08,817 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:36:09,713 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:36:10,915 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:36:10,941 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
autopruneworker stdout | 2024-04-22 04:36:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:36:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:36:41.264267+00:00 (in 29.999495 seconds)
autopruneworker stdout | 2024-04-22 04:36:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:36:41 UTC)" (scheduled at 2024-04-22 04:36:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:36:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713760511271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:36:11,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:36:11,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:36:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:36:41 UTC)" executed successfully
manifestbackfillworker stdout | 2024-04-22 04:36:11,345 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:36:11,428 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
gunicorn-registry stdout | 2024-04-22 04:36:11,609 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:36:11,612 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:36:11,622 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:36:11,634 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:36:11,639 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:36:11,645 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:36:11,648 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:36:11,650 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:36:11,654 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
storagereplication stdout | 2024-04-22 04:36:12,841 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:36:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:36:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:36:51.555445+00:00 (in 37.999357 seconds)
repositorygcworker stdout | 2024-04-22 04:36:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:37:13 UTC)" (scheduled at 2024-04-22 04:36:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:36:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:36:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:37:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:36:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:36:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:36:19.762424+00:00 (in 6.002596 seconds)
notificationworker stdout | 2024-04-22 04:36:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:36:23 UTC)" (scheduled at 2024-04-22 04:36:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:36:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:36:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 36, 13, 760112), True, datetime.datetime(2024, 4, 22, 4, 36, 13, 760112), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:36:13,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:36:13,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:36:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:36:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:36:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:36:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:36:44.952062+00:00 (in 29.999532 seconds)
gcworker stdout | 2024-04-22 04:36:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:36:44 UTC)" (scheduled at 2024-04-22 04:36:14.952062+00:00)
gcworker stdout | 2024-04-22 04:36:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712550974952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:36:14,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:36:14,964 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:36:14,964 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:36:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:36:15,652 [278] [DEBUG] [app] Starting request: urn:request:85d28f67-5f62-4768-975d-e7bfda20eea4 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:36:15,652 [281] [DEBUG] [app] Starting request: urn:request:870b9e19-3ba8-4451-9897-9736cd7178e5 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:36:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:36:15,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:36:15,656 [290] [DEBUG] [app] Starting request: urn:request:6d514796-ede3-48cd-9937-b8b22d0da6a7 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:36:15,656 [284] [DEBUG] [app] Starting request: urn:request:595d361d-54e9-4fa8-aa87-8ad1ce18ae02 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:36:15,656 [290] [DEBUG] [app] Ending request: urn:request:6d514796-ede3-48cd-9937-b8b22d0da6a7 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:6d514796-ede3-48cd-9937-b8b22d0da6a7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:36:15,656 [284] [DEBUG] [app] Ending request: urn:request:595d361d-54e9-4fa8-aa87-8ad1ce18ae02 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:595d361d-54e9-4fa8-aa87-8ad1ce18ae02', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:36:15,656 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:36:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:36:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:36:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:36:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:36:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:36:15,656 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:36:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:36:15,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:36:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:36:15,659 [281] [DEBUG] [app] Starting request: urn:request:d7c66235-949b-4b2b-aac9-dea1cca4ed2f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:36:15,659 [281] [DEBUG] [app] Ending request: urn:request:d7c66235-949b-4b2b-aac9-dea1cca4ed2f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d7c66235-949b-4b2b-aac9-dea1cca4ed2f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:36:15,659 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:36:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:36:15,659 [279] [DEBUG] [app] Starting request: urn:request:4c0a0da9-5b3f-41be-83e9-e5ef4c1cf06e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:36:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:36:15,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:36:15,660 [279] [DEBUG] [app] Ending request: urn:request:4c0a0da9-5b3f-41be-83e9-e5ef4c1cf06e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:4c0a0da9-5b3f-41be-83e9-e5ef4c1cf06e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:36:15,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:36:15,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:36:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:36:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:36:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:36:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:36:15,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:36:15,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:36:15,673 [281] [DEBUG] [app] Ending request: urn:request:870b9e19-3ba8-4451-9897-9736cd7178e5 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:870b9e19-3ba8-4451-9897-9736cd7178e5', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:36:15,673 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:36:15,673 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:36:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:36:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.021 118 0.021)
gunicorn-web stdout | 2024-04-22 04:36:15,674 [278] [DEBUG] [app] Ending request: urn:request:85d28f67-5f62-4768-975d-e7bfda20eea4 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:85d28f67-5f62-4768-975d-e7bfda20eea4', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:36:15,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:36:15,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:36:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:36:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
quotatotalworker stdout | 2024-04-22 04:36:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:36:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:36:31.054492+00:00 (in 14.999497 seconds)
quotatotalworker stdout | 2024-04-22 04:36:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:36:31 UTC)" (scheduled at 2024-04-22 04:36:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:36:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:36:16,064 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:36:16,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:36:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:36:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:36:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:37:02.556208+00:00 (in 46.003280 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:36:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:37:16 UTC)" (scheduled at 2024-04-22 04:36:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:36:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:36:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 36, 16, 553338), True, datetime.datetime(2024, 4, 22, 4, 36, 16, 553338), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:36:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:36:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:36:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:37:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:36:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:36:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:36:47.052354+00:00 (in 29.999433 seconds)
buildlogsarchiver stdout | 2024-04-22 04:36:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:36:47 UTC)" (scheduled at 2024-04-22 04:36:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:36:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 36, 17, 53299), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:36:17,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:36:17,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:36:17,063 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:36:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:36:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:36:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:36:23.759375+00:00 (in 3.996419 seconds)
notificationworker stdout | 2024-04-22 04:36:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:37:19 UTC)" (scheduled at 2024-04-22 04:36:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:36:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:36:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:37:19 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:36:22,046 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
namespacegcworker stdout | 2024-04-22 04:36:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:36:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:36:43.057186+00:00 (in 20.997709 seconds)
namespacegcworker stdout | 2024-04-22 04:36:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:37:22 UTC)" (scheduled at 2024-04-22 04:36:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:36:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:36:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:37:22 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:36:23,109 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:36:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:36:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:36:33.759375+00:00 (in 9.999491 seconds)
notificationworker stdout | 2024-04-22 04:36:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:36:33 UTC)" (scheduled at 2024-04-22 04:36:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:36:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:36:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 36, 23, 760131), True, datetime.datetime(2024, 4, 22, 4, 36, 23, 760131), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:36:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:36:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:36:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:36:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:36:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:36:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:37:24.361582+00:00 (in 59.999458 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:36:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:37:24 UTC)" (scheduled at 2024-04-22 04:36:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:36:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:36:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:36:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:37:24 UTC)" executed successfully
builder stdout | 2024-04-22 04:36:26,804 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:36:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:36:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:36:35.871852+00:00 (in 8.998261 seconds)
securityworker stdout | 2024-04-22 04:36:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:36:56 UTC)" (scheduled at 2024-04-22 04:36:26.873109+00:00)
securityworker stdout | 2024-04-22 04:36:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:36:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:36:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:36:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:36:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:36:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:36:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:36:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:36:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:36:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:36:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:36:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:36:26,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 31, 26, 881208), 1, 2])
securityworker stdout | 2024-04-22 04:36:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:36:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:36:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 31, 26, 881208), 1, 2])
securityworker stdout | 2024-04-22 04:36:26,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:36:26,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:36:26,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:36:26,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:36:26,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:36:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:36:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:36:26,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:36:26,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:36:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:36:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:36:28,609 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:36:29,944 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:36:30,008 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:36:30,629 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:36:30,653 [282] [DEBUG] [app] Starting request: urn:request:a9604035-d235-4992-9837-94ce1ed92ed4 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:36:30,653 [281] [DEBUG] [app] Starting request: urn:request:a9fbdd7b-b70b-4d67-935f-e4c7b0c5deef (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:36:30,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:36:30,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:36:30,656 [291] [DEBUG] [app] Starting request: urn:request:ce412b24-717c-4540-bf95-65da1348f80f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:36:30,656 [285] [DEBUG] [app] Starting request: urn:request:aebed5ee-b685-47db-804d-7bd8b1149d7a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:36:30,656 [285] [DEBUG] [app] Ending request: urn:request:aebed5ee-b685-47db-804d-7bd8b1149d7a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:aebed5ee-b685-47db-804d-7bd8b1149d7a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:36:30,656 [291] [DEBUG] [app] Ending request: urn:request:ce412b24-717c-4540-bf95-65da1348f80f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:ce412b24-717c-4540-bf95-65da1348f80f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:36:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:36:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:36:30,657 [285] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:36:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:36:30,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:36:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:36:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:36:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:36:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:36:30,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:36:30,660 [281] [DEBUG] [app] Starting request: urn:request:154a70ce-9739-40e2-b3ef-4a5f4e9ec3cd (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:36:30,660 [279] [DEBUG] [app] Starting request: urn:request:eb5b70b8-64a6-4a1e-85c3-4568b631bef9 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:36:30,660 [281] [DEBUG] [app] Ending request: urn:request:154a70ce-9739-40e2-b3ef-4a5f4e9ec3cd (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:154a70ce-9739-40e2-b3ef-4a5f4e9ec3cd', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:36:30,660 [279] [DEBUG] [app] Ending request: urn:request:eb5b70b8-64a6-4a1e-85c3-4568b631bef9 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:eb5b70b8-64a6-4a1e-85c3-4568b631bef9', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:36:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:36:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:36:30,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:36:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:36:30,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:36:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:36:30,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:36:30,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:36:30,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:36:30,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:36:30,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:36:30,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:36:30,675 [282] [DEBUG] [app] Ending request: urn:request:a9604035-d235-4992-9837-94ce1ed92ed4 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a9604035-d235-4992-9837-94ce1ed92ed4', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:36:30,675 [281] [DEBUG] [app] Ending request: urn:request:a9fbdd7b-b70b-4d67-935f-e4c7b0c5deef (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a9fbdd7b-b70b-4d67-935f-e4c7b0c5deef', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:36:30,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:36:30,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:36:30,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:36:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:36:30,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:36:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:36:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:36:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:36:30,712 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:36:30,769 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:36:30,828 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:36:30,924 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
quotatotalworker stdout | 2024-04-22 04:36:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:36:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:36:46.054492+00:00 (in 14.999466 seconds)
quotatotalworker stdout | 2024-04-22 04:36:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:36:46 UTC)" (scheduled at 2024-04-22 04:36:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:36:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:36:31,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:36:31,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:36:46 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:36:31,812 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:36:31,919 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotaregistrysizeworker stdout | 2024-04-22 04:36:32,806 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:36:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:36:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:36:43.759375+00:00 (in 9.999544 seconds)
notificationworker stdout | 2024-04-22 04:36:33,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:36:43 UTC)" (scheduled at 2024-04-22 04:36:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:36:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:36:33,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 36, 33, 760119), True, datetime.datetime(2024, 4, 22, 4, 36, 33, 760119), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:36:33,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:36:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:36:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:36:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:36:34,535 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-web stdout | 2024-04-22 04:36:35,057 [281] [DEBUG] [app] Starting request: urn:request:4c3b3860-0750-4c84-9f25-5be280f6c002 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:36:35,057 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:36:35,058 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:36:35,058 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:36:35,072 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:36:35,073 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:36:35,073 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:36:35,073 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:36:35,073 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:36:35,073 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:36:35,073 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:36:35,073 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:36:35,075 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:36:35,081 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:36:35,082 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:36:35,086 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:36:35,091 [281] [DEBUG] [app] Ending request: urn:request:4c3b3860-0750-4c84-9f25-5be280f6c002 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:4c3b3860-0750-4c84-9f25-5be280f6c002', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:36:35,091 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:36:35,091 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:36:35 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:36:35 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.035 1555 0.035)
gunicorn-secscan stdout | 2024-04-22 04:36:35,204 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:36:35,209 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:36:35,212 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
securityworker stdout | 2024-04-22 04:36:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:36:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:36:56.873109+00:00 (in 21.000736 seconds)
securityworker stdout | 2024-04-22 04:36:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:37:05 UTC)" (scheduled at 2024-04-22 04:36:35.871852+00:00)
securityworker stdout | 2024-04-22 04:36:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:36:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:36:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:36:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
buildlogsarchiver stdout | 2024-04-22 04:36:35,878 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
securityworker stdout | 2024-04-22 04:36:35,895 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:36:35,898 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:36:35,900 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:36:35,900 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:36:35,901 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 31, 35, 876319), 1, 2])
securityworker stdout | 2024-04-22 04:36:35,903 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:36:35,903 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:36:35,904 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 31, 35, 876319), 1, 2])
gcworker stdout | 2024-04-22 04:36:35,904 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
securityworker stdout | 2024-04-22 04:36:35,906 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:36:35,906 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:36:35,906 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:36:35,906 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:37:05 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:36:36,314 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
logrotateworker stdout | 2024-04-22 04:36:37,232 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:36:38,375 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:36:38,514 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:36:38,833 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
exportactionlogsworker stdout | 2024-04-22 04:36:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:36:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:36:41.564959+00:00 (in 1.997469 seconds)
exportactionlogsworker stdout | 2024-04-22 04:36:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:37:39 UTC)" (scheduled at 2024-04-22 04:36:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:36:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:36:39,568 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:37:39 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 04:36:39,749 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:36:40,951 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:36:40,975 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
autopruneworker stdout | 2024-04-22 04:36:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:36:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:37:11.264267+00:00 (in 29.999513 seconds)
autopruneworker stdout | 2024-04-22 04:36:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:37:11 UTC)" (scheduled at 2024-04-22 04:36:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:36:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713760541272, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:36:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:36:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:36:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:37:11 UTC)" executed successfully
manifestbackfillworker stdout | 2024-04-22 04:36:41,377 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:36:41,463 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
exportactionlogsworker stdout | 2024-04-22 04:36:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:36:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:36:53.566665+00:00 (in 12.001244 seconds)
exportactionlogsworker stdout | 2024-04-22 04:36:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:37:41 UTC)" (scheduled at 2024-04-22 04:36:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:36:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:36:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 36, 41, 565860), True, datetime.datetime(2024, 4, 22, 4, 36, 41, 565860), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:36:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:36:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:36:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:37:41 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:36:41,620 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:36:41,623 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:36:41,631 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:36:41,645 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:36:41,648 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:36:41,655 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:36:41,659 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:36:41,662 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:36:41,665 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
storagereplication stdout | 2024-04-22 04:36:42,873 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
namespacegcworker stdout | 2024-04-22 04:36:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:36:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:37:22.058978+00:00 (in 39.001361 seconds)
namespacegcworker stdout | 2024-04-22 04:36:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:37:43 UTC)" (scheduled at 2024-04-22 04:36:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:36:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:36:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 36, 43, 58029), True, datetime.datetime(2024, 4, 22, 4, 36, 43, 58029), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:36:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:36:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:36:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:37:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:36:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:36:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:36:53.759375+00:00 (in 9.999524 seconds)
notificationworker stdout | 2024-04-22 04:36:43,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:36:53 UTC)" (scheduled at 2024-04-22 04:36:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:36:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:36:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 36, 43, 760097), True, datetime.datetime(2024, 4, 22, 4, 36, 43, 760097), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:36:43,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:36:43,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:36:43,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:36:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:36:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:36:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:37:14.952062+00:00 (in 29.999555 seconds)
gcworker stdout | 2024-04-22 04:36:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:37:14 UTC)" (scheduled at 2024-04-22 04:36:44.952062+00:00)
gcworker stdout | 2024-04-22 04:36:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712551004952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:36:44,969 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:36:44,969 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:36:44,969 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:37:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:36:45,653 [279] [DEBUG] [app] Starting request: urn:request:1002c3ca-3a96-4bc4-ad24-f11fa656622c (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:36:45,653 [282] [DEBUG] [app] Starting request: urn:request:a147c193-4ee0-446f-b783-9725d8f369f9 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:36:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:36:45,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:36:45,656 [286] [DEBUG] [app] Starting request: urn:request:5e040a41-59f5-4d7e-832f-4b3157f7f64a (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:36:45,656 [284] [DEBUG] [app] Starting request: urn:request:28cad327-e1c8-4d79-93fe-fdab40e5ff11 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:36:45,657 [286] [DEBUG] [app] Ending request: urn:request:5e040a41-59f5-4d7e-832f-4b3157f7f64a (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5e040a41-59f5-4d7e-832f-4b3157f7f64a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:36:45,657 [284] [DEBUG] [app] Ending request: urn:request:28cad327-e1c8-4d79-93fe-fdab40e5ff11 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:28cad327-e1c8-4d79-93fe-fdab40e5ff11', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:36:45,657 [286] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:36:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:36:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:36:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:36:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:36:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:36:45,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:36:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:36:45,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:36:45,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:36:45,660 [278] [DEBUG] [app] Starting request: urn:request:d4a13fe6-c2ee-441c-b673-c25a194804dc (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:36:45,660 [278] [DEBUG] [app] Ending request: urn:request:d4a13fe6-c2ee-441c-b673-c25a194804dc (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d4a13fe6-c2ee-441c-b673-c25a194804dc', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:36:45,660 [281] [DEBUG] [app] Starting request: urn:request:66d88256-40a8-438e-80dd-74d2d9d2833f (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:36:45,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:36:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:36:45,661 [281] [DEBUG] [app] Ending request: urn:request:66d88256-40a8-438e-80dd-74d2d9d2833f (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:66d88256-40a8-438e-80dd-74d2d9d2833f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:36:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 04:36:45,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:36:45,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:36:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:36:45,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:36:45,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:36:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:36:45,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:36:45,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:36:45,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:36:45,675 [279] [DEBUG] [app] Ending request: urn:request:1002c3ca-3a96-4bc4-ad24-f11fa656622c (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:1002c3ca-3a96-4bc4-ad24-f11fa656622c', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:36:45,675 [282] [DEBUG] [app] Ending request: urn:request:a147c193-4ee0-446f-b783-9725d8f369f9 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a147c193-4ee0-446f-b783-9725d8f369f9', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:36:45,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:36:45,675 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:36:45,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:36:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:36:45,676 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:36:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:36:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:36:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.024)
quotatotalworker stdout | 2024-04-22 04:36:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:36:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:37:01.054492+00:00 (in 14.999468 seconds)
quotatotalworker stdout | 2024-04-22 04:36:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:37:01 UTC)" (scheduled at 2024-04-22 04:36:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:36:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:36:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:36:46,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:37:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:36:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:36:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:37:17.052354+00:00 (in 29.999465 seconds)
buildlogsarchiver stdout | 2024-04-22 04:36:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:37:17 UTC)" (scheduled at 2024-04-22 04:36:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:36:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 36, 47, 53259), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:36:47,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:36:47,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:36:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:37:17 UTC)" executed successfully
repositorygcworker stdout | 2024-04-22 04:36:51,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:36:51,555 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:37:06.552482+00:00 (in 14.996583 seconds)
repositorygcworker stdout | 2024-04-22 04:36:51,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:41:51 UTC)" (scheduled at 2024-04-22 04:36:51.555445+00:00)
repositorygcworker stdout | 2024-04-22 04:36:51,556 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 36, 51, 556237), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 04:36:51,566 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 36, 51, 556237), True, datetime.datetime(2024, 4, 22, 4, 36, 51, 556237), 0, 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 04:36:51,568 [90] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 36, 51, 556237), True, datetime.datetime(2024, 4, 22, 4, 36, 51, 556237), 0, 'repositorygc/%', False, datetime.datetime(2024, 4, 22, 4, 36, 51, 556237), 'repositorygc/%'])
repositorygcworker stdout | 2024-04-22 04:36:51,571 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:36:51,571 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:41:51 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:36:52,082 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:36:53,136 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
exportactionlogsworker stdout | 2024-04-22 04:36:53,566 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:36:53,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:37:39.566970+00:00 (in 45.999806 seconds)
exportactionlogsworker stdout | 2024-04-22 04:36:53,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:41:53 UTC)" (scheduled at 2024-04-22 04:36:53.566665+00:00)
exportactionlogsworker stdout | 2024-04-22 04:36:53,568 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 36, 53, 567561), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 04:36:53,583 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 36, 53, 567561), True, datetime.datetime(2024, 4, 22, 4, 36, 53, 567561), 0, 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 04:36:53,586 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 36, 53, 567561), True, datetime.datetime(2024, 4, 22, 4, 36, 53, 567561), 0, 'exportactionlogs/%', False, datetime.datetime(2024, 4, 22, 4, 36, 53, 567561), 'exportactionlogs/%'])
exportactionlogsworker stdout | 2024-04-22 04:36:53,588 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:36:53,588 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:41:53 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:36:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:36:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:37:03.759375+00:00 (in 9.999496 seconds)
notificationworker stdout | 2024-04-22 04:36:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:37:03 UTC)" (scheduled at 2024-04-22 04:36:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:36:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:36:53,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 36, 53, 760170), True, datetime.datetime(2024, 4, 22, 4, 36, 53, 760170), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:36:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:36:53,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:36:53,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:37:03 UTC)" executed successfully
builder stdout | 2024-04-22 04:36:56,840 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:36:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:36:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:37:05.871852+00:00 (in 8.998271 seconds)
securityworker stdout | 2024-04-22 04:36:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:37:26 UTC)" (scheduled at 2024-04-22 04:36:56.873109+00:00)
securityworker stdout | 2024-04-22 04:36:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:36:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:36:56,875 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:36:56,875 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:36:56,875 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:36:56,876 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:36:56,876 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:36:56,878 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:36:56,879 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:36:56,889 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:36:56,891 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:36:56,891 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:36:56,892 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 31, 56, 879446), 1, 2])
securityworker stdout | 2024-04-22 04:36:56,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:36:56,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:36:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 31, 56, 879446), 1, 2])
securityworker stdout | 2024-04-22 04:36:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:36:56,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:36:56,897 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:36:56,897 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:36:56,897 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:36:56,897 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:36:56,897 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:36:56,897 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:36:56,898 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:36:56,898 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:37:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:36:58,639 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:36:59,953 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:37:00,019 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:37:00,637 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:37:00,653 [279] [DEBUG] [app] Starting request: urn:request:af9fe05d-6284-4742-83d5-67b2f1eb636b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:37:00,653 [281] [DEBUG] [app] Starting request: urn:request:d23bd714-3ca6-45d9-9f38-df7ad03bb4f9 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:37:00,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:37:00,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:37:00,656 [291] [DEBUG] [app] Starting request: urn:request:28dd24b7-90d5-4f6c-aa4c-933acc7d42ce (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:37:00,656 [290] [DEBUG] [app] Starting request: urn:request:a65d3529-670a-4e2a-baa1-84d9cf5362dd (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:37:00,656 [290] [DEBUG] [app] Ending request: urn:request:a65d3529-670a-4e2a-baa1-84d9cf5362dd (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:a65d3529-670a-4e2a-baa1-84d9cf5362dd', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:37:00,656 [291] [DEBUG] [app] Ending request: urn:request:28dd24b7-90d5-4f6c-aa4c-933acc7d42ce (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:28dd24b7-90d5-4f6c-aa4c-933acc7d42ce', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:37:00,656 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:37:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:37:00,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:37:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:37:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:37:00,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:37:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:37:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:37:00,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:37:00,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:37:00,659 [281] [DEBUG] [app] Starting request: urn:request:2ae7fc48-cd6e-46dd-8cfc-56ff35ed5236 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:37:00,659 [281] [DEBUG] [app] Ending request: urn:request:2ae7fc48-cd6e-46dd-8cfc-56ff35ed5236 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:2ae7fc48-cd6e-46dd-8cfc-56ff35ed5236', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:37:00,659 [278] [DEBUG] [app] Starting request: urn:request:6280f702-4f19-494e-a278-4e88ddbc0627 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:37:00,659 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:37:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:37:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:37:00,660 [278] [DEBUG] [app] Ending request: urn:request:6280f702-4f19-494e-a278-4e88ddbc0627 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:6280f702-4f19-494e-a278-4e88ddbc0627', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:37:00,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:37:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:37:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:37:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:37:00,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:37:00,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:37:00,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:37:00,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:37:00,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:37:00,674 [279] [DEBUG] [app] Ending request: urn:request:af9fe05d-6284-4742-83d5-67b2f1eb636b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:af9fe05d-6284-4742-83d5-67b2f1eb636b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:37:00,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:37:00,674 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:37:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:37:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:37:00,675 [281] [DEBUG] [app] Ending request: urn:request:d23bd714-3ca6-45d9-9f38-df7ad03bb4f9 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:d23bd714-3ca6-45d9-9f38-df7ad03bb4f9', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:37:00,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:37:00,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:37:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:37:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:37:00,721 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:37:00,781 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:37:00,839 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:37:00,936 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
quotatotalworker stdout | 2024-04-22 04:37:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:37:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:37:16.054492+00:00 (in 14.999478 seconds)
quotatotalworker stdout | 2024-04-22 04:37:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:37:16 UTC)" (scheduled at 2024-04-22 04:37:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:37:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:37:01,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:37:01,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:37:16 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:37:01,850 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:37:01,936 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
securityscanningnotificationworker stdout | 2024-04-22 04:37:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:37:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:37:16.552337+00:00 (in 13.995618 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:37:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:38:02 UTC)" (scheduled at 2024-04-22 04:37:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:37:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:37:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:38:02 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:37:02,838 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:37:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:37:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:37:13.759375+00:00 (in 9.999524 seconds)
notificationworker stdout | 2024-04-22 04:37:03,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:37:13 UTC)" (scheduled at 2024-04-22 04:37:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:37:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:37:03,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 37, 3, 760138), True, datetime.datetime(2024, 4, 22, 4, 37, 3, 760138), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:37:03,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:37:03,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:37:03,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:37:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:37:04,567 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:37:05,211 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:37:05,217 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:37:05,220 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
securityworker stdout | 2024-04-22 04:37:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:37:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:37:26.873109+00:00 (in 21.000752 seconds)
securityworker stdout | 2024-04-22 04:37:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:37:35 UTC)" (scheduled at 2024-04-22 04:37:05.871852+00:00)
securityworker stdout | 2024-04-22 04:37:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:37:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:37:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:37:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:37:05,885 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:37:05,885 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:37:35 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:37:05,895 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:37:05,940 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
gunicorn-web stdout | 2024-04-22 04:37:06,189 [282] [DEBUG] [app] Starting request: urn:request:cf8e05f3-fb86-4d87-a90a-4913ee477f0c (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:37:06,189 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:37:06,189 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:37:06,190 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:37:06,200 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:37:06,200 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:37:06,200 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:37:06,200 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:37:06,200 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:37:06,200 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:37:06,200 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:37:06,200 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:37:06,202 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:37:06,209 [282] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:37:06,210 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:37:06,214 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:37:06,218 [282] [DEBUG] [app] Ending request: urn:request:cf8e05f3-fb86-4d87-a90a-4913ee477f0c (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:cf8e05f3-fb86-4d87-a90a-4913ee477f0c', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:37:06,219 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:37:06,219 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:37:06 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:37:06 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.031 1536 0.031)
exportactionlogsworker stdout | 2024-04-22 04:37:06,351 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
repositorygcworker stdout | 2024-04-22 04:37:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:37:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:37:13.555667+00:00 (in 7.002696 seconds)
repositorygcworker stdout | 2024-04-22 04:37:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:38:06 UTC)" (scheduled at 2024-04-22 04:37:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:37:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:37:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 37, 6, 553353), True, datetime.datetime(2024, 4, 22, 4, 37, 6, 553353), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:37:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:37:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:37:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:38:06 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:37:07,269 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:37:08,411 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:37:08,547 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:37:08,849 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:37:09,786 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:37:10,970 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:37:10,985 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
autopruneworker stdout | 2024-04-22 04:37:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:37:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:37:41.264267+00:00 (in 29.999552 seconds)
autopruneworker stdout | 2024-04-22 04:37:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:37:41 UTC)" (scheduled at 2024-04-22 04:37:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:37:11,271 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713760571271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:37:11,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:37:11,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:37:11,275 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:37:41 UTC)" executed successfully
manifestbackfillworker stdout | 2024-04-22 04:37:11,413 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:37:11,496 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
gunicorn-registry stdout | 2024-04-22 04:37:11,630 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:37:11,634 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:37:11,641 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:37:11,657 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:37:11,660 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:37:11,665 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:37:11,669 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:37:11,672 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:37:11,675 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
storagereplication stdout | 2024-04-22 04:37:12,906 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:37:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:37:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:38:06.552482+00:00 (in 52.996334 seconds)
repositorygcworker stdout | 2024-04-22 04:37:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:38:13 UTC)" (scheduled at 2024-04-22 04:37:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:37:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:37:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:38:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:37:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:37:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:37:19.762424+00:00 (in 6.002569 seconds)
notificationworker stdout | 2024-04-22 04:37:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:37:23 UTC)" (scheduled at 2024-04-22 04:37:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:37:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:37:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 37, 13, 760142), True, datetime.datetime(2024, 4, 22, 4, 37, 13, 760142), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:37:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:37:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:37:13,772 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:37:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:37:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:37:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:37:44.952062+00:00 (in 29.999509 seconds)
gcworker stdout | 2024-04-22 04:37:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:37:44 UTC)" (scheduled at 2024-04-22 04:37:14.952062+00:00)
gcworker stdout | 2024-04-22 04:37:14,953 [68] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."removed_tag_expiration_s" FROM "user" AS "t1" LIMIT %s', [100])
gcworker stdout | 2024-04-22 04:37:14,963 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712551034962, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:37:14,967 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:37:14,967 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:37:14,967 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:37:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:37:15,652 [279] [DEBUG] [app] Starting request: urn:request:fa8a6874-31d6-49ea-8d1c-b20989302b3b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:37:15,652 [281] [DEBUG] [app] Starting request: urn:request:adc52de1-dd24-4205-8cc0-37220f3828ae (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:37:15,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:37:15,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:37:15,656 [289] [DEBUG] [app] Starting request: urn:request:3c93ac80-0817-4e66-8240-91f216ed35a0 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:37:15,656 [291] [DEBUG] [app] Starting request: urn:request:3ba2ba1f-aae7-470c-8fca-faab78ba453f (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:37:15,656 [289] [DEBUG] [app] Ending request: urn:request:3c93ac80-0817-4e66-8240-91f216ed35a0 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:3c93ac80-0817-4e66-8240-91f216ed35a0', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:37:15,656 [291] [DEBUG] [app] Ending request: urn:request:3ba2ba1f-aae7-470c-8fca-faab78ba453f (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:3ba2ba1f-aae7-470c-8fca-faab78ba453f', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:37:15,656 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:37:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:37:15,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:37:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:37:15,656 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:37:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:37:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:37:15,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:37:15,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:37:15,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:37:15,659 [282] [DEBUG] [app] Starting request: urn:request:d1d3140a-917d-433d-b643-a17276c87269 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:37:15,659 [282] [DEBUG] [app] Ending request: urn:request:d1d3140a-917d-433d-b643-a17276c87269 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d1d3140a-917d-433d-b643-a17276c87269', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:37:15,659 [281] [DEBUG] [app] Starting request: urn:request:c8312ba8-4cf0-459f-90b3-cc2516bfd102 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:37:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:37:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:37:15,660 [281] [DEBUG] [app] Ending request: urn:request:c8312ba8-4cf0-459f-90b3-cc2516bfd102 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:c8312ba8-4cf0-459f-90b3-cc2516bfd102', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:37:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:37:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:37:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:37:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:37:15,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:37:15,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:37:15,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:37:15,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:37:15,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:37:15,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:37:15,674 [279] [DEBUG] [app] Ending request: urn:request:fa8a6874-31d6-49ea-8d1c-b20989302b3b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:fa8a6874-31d6-49ea-8d1c-b20989302b3b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:37:15,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:37:15,675 [281] [DEBUG] [app] Ending request: urn:request:adc52de1-dd24-4205-8cc0-37220f3828ae (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:adc52de1-dd24-4205-8cc0-37220f3828ae', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:37:15,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:37:15,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:37:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:37:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:37:15,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:37:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:37:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.023)
quotatotalworker stdout | 2024-04-22 04:37:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:37:16,054 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:37:31.054492+00:00 (in 14.999516 seconds)
quotatotalworker stdout | 2024-04-22 04:37:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:37:31 UTC)" (scheduled at 2024-04-22 04:37:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:37:16,055 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:37:16,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:37:16,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:37:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:37:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:37:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:37:21.555879+00:00 (in 5.002950 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:37:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:38:16 UTC)" (scheduled at 2024-04-22 04:37:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:37:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:37:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 37, 16, 553306), True, datetime.datetime(2024, 4, 22, 4, 37, 16, 553306), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:37:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:37:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:37:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:38:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:37:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:37:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:37:47.052354+00:00 (in 29.999466 seconds)
buildlogsarchiver stdout | 2024-04-22 04:37:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:37:47 UTC)" (scheduled at 2024-04-22 04:37:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:37:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 37, 17, 53250), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:37:17,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:37:17,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:37:17,063 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:37:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:37:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:37:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:37:23.759375+00:00 (in 3.996406 seconds)
notificationworker stdout | 2024-04-22 04:37:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:38:19 UTC)" (scheduled at 2024-04-22 04:37:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:37:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:37:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:38:19 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:37:21,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:37:21,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:38:02.556208+00:00 (in 40.999791 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:37:21,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:42:21 UTC)" (scheduled at 2024-04-22 04:37:21.555879+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:37:21,557 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 37, 21, 556773), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 04:37:21,567 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 37, 21, 556773), True, datetime.datetime(2024, 4, 22, 4, 37, 21, 556773), 0, 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 04:37:21,570 [91] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 37, 21, 556773), True, datetime.datetime(2024, 4, 22, 4, 37, 21, 556773), 0, 'secscanv4/%', False, datetime.datetime(2024, 4, 22, 4, 37, 21, 556773), 'secscanv4/%'])
securityscanningnotificationworker stdout | 2024-04-22 04:37:21,572 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:37:21,572 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:42:21 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:37:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:37:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:37:38.058708+00:00 (in 15.999227 seconds)
namespacegcworker stdout | 2024-04-22 04:37:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:38:22 UTC)" (scheduled at 2024-04-22 04:37:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:37:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:37:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:38:22 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:37:22,118 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:37:23,172 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:37:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:37:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:37:33.759375+00:00 (in 9.999440 seconds)
notificationworker stdout | 2024-04-22 04:37:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:37:33 UTC)" (scheduled at 2024-04-22 04:37:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:37:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:37:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 37, 23, 760251), True, datetime.datetime(2024, 4, 22, 4, 37, 23, 760251), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:37:23,780 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:37:23,780 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:37:23,780 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:37:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:37:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:37:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:38:24.361582+00:00 (in 59.999478 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:37:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:38:24 UTC)" (scheduled at 2024-04-22 04:37:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:37:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:37:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:37:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:38:24 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:37:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:37:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:37:35.871852+00:00 (in 8.998275 seconds)
securityworker stdout | 2024-04-22 04:37:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:37:56 UTC)" (scheduled at 2024-04-22 04:37:26.873109+00:00)
securityworker stdout | 2024-04-22 04:37:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:37:26,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
builder stdout | 2024-04-22 04:37:26,876 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:37:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:37:26,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:37:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:37:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:37:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:37:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:37:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:37:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:37:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:37:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:37:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 32, 26, 880800), 1, 2])
securityworker stdout | 2024-04-22 04:37:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:37:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:37:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 32, 26, 880800), 1, 2])
securityworker stdout | 2024-04-22 04:37:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:37:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:37:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:37:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:37:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:37:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:37:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:37:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:37:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:37:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:37:56 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:37:28,665 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:37:29,979 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:37:30,056 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:37:30,645 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:37:30,653 [279] [DEBUG] [app] Starting request: urn:request:e04790dc-cef8-425e-bdc7-bf1e8c4dab8d (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:37:30,653 [281] [DEBUG] [app] Starting request: urn:request:363b2153-cb08-402e-9e94-ed67e85ed000 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:37:30,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:37:30,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:37:30,656 [292] [DEBUG] [app] Starting request: urn:request:02e13a46-d3d8-44f3-aa2d-5130f9fb1954 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:37:30,656 [289] [DEBUG] [app] Starting request: urn:request:e034a56d-f9e6-49ee-95c6-03f8eb7e82f7 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:37:30,657 [292] [DEBUG] [app] Ending request: urn:request:02e13a46-d3d8-44f3-aa2d-5130f9fb1954 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:02e13a46-d3d8-44f3-aa2d-5130f9fb1954', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:37:30,657 [289] [DEBUG] [app] Ending request: urn:request:e034a56d-f9e6-49ee-95c6-03f8eb7e82f7 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:e034a56d-f9e6-49ee-95c6-03f8eb7e82f7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:37:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:37:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:37:30,657 [289] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:37:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:37:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:37:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:37:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:37:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:37:30,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:37:30,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:37:30,660 [281] [DEBUG] [app] Starting request: urn:request:9ba34959-9368-48f6-b892-5cf4ede727c2 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:37:30,660 [282] [DEBUG] [app] Starting request: urn:request:248231c9-61dc-48db-99e4-e62bee92ad9e (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:37:30,660 [281] [DEBUG] [app] Ending request: urn:request:9ba34959-9368-48f6-b892-5cf4ede727c2 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:9ba34959-9368-48f6-b892-5cf4ede727c2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:37:30,660 [282] [DEBUG] [app] Ending request: urn:request:248231c9-61dc-48db-99e4-e62bee92ad9e (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:248231c9-61dc-48db-99e4-e62bee92ad9e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:37:30,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:37:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:37:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:37:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:37:30,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:37:30,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:37:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:37:30,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:37:30,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:37:30,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:37:30,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:37:30,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:37:30,674 [279] [DEBUG] [app] Ending request: urn:request:e04790dc-cef8-425e-bdc7-bf1e8c4dab8d (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:e04790dc-cef8-425e-bdc7-bf1e8c4dab8d', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:37:30,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:37:30,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:37:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:37:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.023)
gunicorn-web stdout | 2024-04-22 04:37:30,675 [281] [DEBUG] [app] Ending request: urn:request:363b2153-cb08-402e-9e94-ed67e85ed000 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:363b2153-cb08-402e-9e94-ed67e85ed000', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:37:30,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:37:30,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:37:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:37:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:37:30,731 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:37:30,792 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:37:30,849 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:37:30,948 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
quotatotalworker stdout | 2024-04-22 04:37:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:37:31,054 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:37:46.054492+00:00 (in 14.999576 seconds)
quotatotalworker stdout | 2024-04-22 04:37:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:37:46 UTC)" (scheduled at 2024-04-22 04:37:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:37:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:37:31,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:37:31,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:37:46 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:37:31,887 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:37:31,973 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotaregistrysizeworker stdout | 2024-04-22 04:37:32,857 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:37:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:37:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:37:43.759375+00:00 (in 9.999485 seconds)
notificationworker stdout | 2024-04-22 04:37:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:37:43 UTC)" (scheduled at 2024-04-22 04:37:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:37:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:37:33,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 37, 33, 760141), True, datetime.datetime(2024, 4, 22, 4, 37, 33, 760141), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:37:33,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:37:33,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:37:33,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:37:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:37:34,585 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:37:35,220 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:37:35,226 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:37:35,229 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
securityworker stdout | 2024-04-22 04:37:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:37:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:37:56.873109+00:00 (in 21.000736 seconds)
securityworker stdout | 2024-04-22 04:37:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:38:05 UTC)" (scheduled at 2024-04-22 04:37:35.871852+00:00)
securityworker stdout | 2024-04-22 04:37:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:37:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:37:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:37:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:37:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:37:35,888 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:37:35,891 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:37:35,891 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:37:35,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 32, 35, 876373), 1, 2])
securityworker stdout | 2024-04-22 04:37:35,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:37:35,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:37:35,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 32, 35, 876373), 1, 2])
securityworker stdout | 2024-04-22 04:37:35,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:37:35,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:37:35,896 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:37:35,896 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:38:05 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:37:35,904 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:37:35,967 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:37:36,386 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
gunicorn-web stdout | 2024-04-22 04:37:36,577 [278] [DEBUG] [app] Starting request: urn:request:97c9dd03-973b-4cec-a534-c8c1e5c38dfa (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:37:36,577 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:37:36,578 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:37:36,578 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:37:36,588 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:37:36,588 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:37:36,588 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:37:36,588 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:37:36,588 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:37:36,588 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:37:36,588 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:37:36,588 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:37:36,590 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:37:36,597 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:37:36,598 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:37:36,602 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:37:36,606 [278] [DEBUG] [app] Ending request: urn:request:97c9dd03-973b-4cec-a534-c8c1e5c38dfa (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:97c9dd03-973b-4cec-a534-c8c1e5c38dfa', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:37:36,607 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:37:36,607 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:37:36 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:37:36 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.031 1555 0.031)
logrotateworker stdout | 2024-04-22 04:37:37,305 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
namespacegcworker stdout | 2024-04-22 04:37:38,058 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:37:38,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:37:43.057186+00:00 (in 4.997996 seconds)
namespacegcworker stdout | 2024-04-22 04:37:38,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:42:38 UTC)" (scheduled at 2024-04-22 04:37:38.058708+00:00)
namespacegcworker stdout | 2024-04-22 04:37:38,060 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 37, 38, 59566), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 04:37:38,070 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 37, 38, 59566), True, datetime.datetime(2024, 4, 22, 4, 37, 38, 59566), 0, 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 04:37:38,072 [76] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 37, 38, 59566), True, datetime.datetime(2024, 4, 22, 4, 37, 38, 59566), 0, 'namespacegc/%', False, datetime.datetime(2024, 4, 22, 4, 37, 38, 59566), 'namespacegc/%'])
namespacegcworker stdout | 2024-04-22 04:37:38,075 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:37:38,075 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:42:38 UTC)" executed successfully
autopruneworker stdout | 2024-04-22 04:37:38,418 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:37:38,584 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:37:38,878 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
exportactionlogsworker stdout | 2024-04-22 04:37:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:37:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:37:41.564959+00:00 (in 1.997465 seconds)
exportactionlogsworker stdout | 2024-04-22 04:37:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:38:39 UTC)" (scheduled at 2024-04-22 04:37:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:37:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:37:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:38:39 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 04:37:39,823 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:37:41,000 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:37:41,010 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
autopruneworker stdout | 2024-04-22 04:37:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:37:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:38:11.264267+00:00 (in 29.999438 seconds)
autopruneworker stdout | 2024-04-22 04:37:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:38:11 UTC)" (scheduled at 2024-04-22 04:37:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:37:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713760601271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:37:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:37:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:37:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:38:11 UTC)" executed successfully
manifestbackfillworker stdout | 2024-04-22 04:37:41,426 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:37:41,524 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
exportactionlogsworker stdout | 2024-04-22 04:37:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:37:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:38:39.566970+00:00 (in 58.001544 seconds)
exportactionlogsworker stdout | 2024-04-22 04:37:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:38:41 UTC)" (scheduled at 2024-04-22 04:37:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:37:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:37:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 37, 41, 565673), True, datetime.datetime(2024, 4, 22, 4, 37, 41, 565673), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:37:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:37:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:37:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:38:41 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:37:41,639 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:37:41,644 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:37:41,650 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:37:41,669 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:37:41,673 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:37:41,676 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:37:41,679 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:37:41,682 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-registry stdout | 2024-04-22 04:37:41,685 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
storagereplication stdout | 2024-04-22 04:37:42,944 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
namespacegcworker stdout | 2024-04-22 04:37:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:37:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:38:22.058978+00:00 (in 39.001345 seconds)
namespacegcworker stdout | 2024-04-22 04:37:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:38:43 UTC)" (scheduled at 2024-04-22 04:37:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:37:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:37:43,059 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 37, 43, 58108), True, datetime.datetime(2024, 4, 22, 4, 37, 43, 58108), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:37:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:37:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:37:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:38:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:37:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:37:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:37:53.759375+00:00 (in 9.999536 seconds)
notificationworker stdout | 2024-04-22 04:37:43,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:37:53 UTC)" (scheduled at 2024-04-22 04:37:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:37:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:37:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 37, 43, 760086), True, datetime.datetime(2024, 4, 22, 4, 37, 43, 760086), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:37:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:37:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:37:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:37:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:37:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:37:44,953 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:38:14.952062+00:00 (in 29.998805 seconds)
gcworker stdout | 2024-04-22 04:37:44,953 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:38:14 UTC)" (scheduled at 2024-04-22 04:37:44.952062+00:00)
gcworker stdout | 2024-04-22 04:37:44,954 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712551064953, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:37:44,967 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:37:44,967 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:37:44,967 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:38:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:37:45,653 [281] [DEBUG] [app] Starting request: urn:request:9e5f5ede-8d8c-4f51-a0c3-219244ec7240 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:37:45,653 [282] [DEBUG] [app] Starting request: urn:request:ea201bc5-d0eb-442b-8393-67364d66727f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:37:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:37:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:37:45,656 [284] [DEBUG] [app] Starting request: urn:request:de3db5b6-4975-4b9e-bb42-86f0352b09d5 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:37:45,656 [291] [DEBUG] [app] Starting request: urn:request:112148b7-ff7c-48f7-82bb-8eb113a36e96 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:37:45,656 [291] [DEBUG] [app] Ending request: urn:request:112148b7-ff7c-48f7-82bb-8eb113a36e96 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:112148b7-ff7c-48f7-82bb-8eb113a36e96', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:37:45,656 [284] [DEBUG] [app] Ending request: urn:request:de3db5b6-4975-4b9e-bb42-86f0352b09d5 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:de3db5b6-4975-4b9e-bb42-86f0352b09d5', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:37:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:37:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:37:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:37:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:37:45,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:37:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:37:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:37:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:37:45,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:37:45,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:37:45,659 [281] [DEBUG] [app] Starting request: urn:request:40cbffd5-7654-4b65-8d51-91b1adda74d7 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:37:45,659 [281] [DEBUG] [app] Ending request: urn:request:40cbffd5-7654-4b65-8d51-91b1adda74d7 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:40cbffd5-7654-4b65-8d51-91b1adda74d7', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:37:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:37:45,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:37:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:37:45,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:37:45,660 [279] [DEBUG] [app] Starting request: urn:request:431e3610-9b21-4cd6-9b9a-f9a4510c422b (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:37:45,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:37:45,661 [279] [DEBUG] [app] Ending request: urn:request:431e3610-9b21-4cd6-9b9a-f9a4510c422b (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:431e3610-9b21-4cd6-9b9a-f9a4510c422b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:37:45,661 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:37:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:37:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.001)
gunicorn-web stdout | 2024-04-22 04:37:45,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:37:45,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:37:45,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:37:45,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:37:45,674 [281] [DEBUG] [app] Ending request: urn:request:9e5f5ede-8d8c-4f51-a0c3-219244ec7240 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:9e5f5ede-8d8c-4f51-a0c3-219244ec7240', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:37:45,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:37:45,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:37:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:37:45,675 [282] [DEBUG] [app] Ending request: urn:request:ea201bc5-d0eb-442b-8393-67364d66727f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:ea201bc5-d0eb-442b-8393-67364d66727f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:37:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:37:45,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:37:45,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:37:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:37:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotatotalworker stdout | 2024-04-22 04:37:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:37:46,054 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:38:01.054492+00:00 (in 14.999553 seconds)
quotatotalworker stdout | 2024-04-22 04:37:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:38:01 UTC)" (scheduled at 2024-04-22 04:37:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:37:46,055 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:37:46,064 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:37:46,064 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:38:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:37:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:37:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:38:17.052354+00:00 (in 29.999436 seconds)
buildlogsarchiver stdout | 2024-04-22 04:37:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:38:17 UTC)" (scheduled at 2024-04-22 04:37:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:37:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 37, 47, 53286), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:37:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:37:47,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:37:47,063 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:38:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:37:52,129 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:37:53,209 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:37:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:37:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:38:03.759375+00:00 (in 9.999438 seconds)
notificationworker stdout | 2024-04-22 04:37:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:38:03 UTC)" (scheduled at 2024-04-22 04:37:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:37:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:37:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 37, 53, 760285), True, datetime.datetime(2024, 4, 22, 4, 37, 53, 760285), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:37:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:37:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:37:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:38:03 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:37:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:37:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:38:05.871852+00:00 (in 8.998226 seconds)
securityworker stdout | 2024-04-22 04:37:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:38:26 UTC)" (scheduled at 2024-04-22 04:37:56.873109+00:00)
securityworker stdout | 2024-04-22 04:37:56,874 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:37:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:37:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:37:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:37:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:37:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:37:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:37:56,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:37:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
builder stdout | 2024-04-22 04:37:56,886 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
securityworker stdout | 2024-04-22 04:37:56,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:37:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:37:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:37:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 32, 56, 881040), 1, 2])
securityworker stdout | 2024-04-22 04:37:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:37:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:37:56,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 32, 56, 881040), 1, 2])
securityworker stdout | 2024-04-22 04:37:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:37:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:37:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:37:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:37:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:37:56,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:37:56,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:37:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:37:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:37:56,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:38:26 UTC)" executed successfully
repositoryactioncounter stdout | 2024-04-22 04:37:58,701 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:38:00,008 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:38:00,092 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:38:00,652 [278] [DEBUG] [app] Starting request: urn:request:57f7c0da-8d77-4665-b8d8-ea95d82af1b9 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:38:00,652 [279] [DEBUG] [app] Starting request: urn:request:9fd40c5c-9c40-42be-b7ed-c096c15c3287 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:38:00,654 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:38:00,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:38:00,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:38:00,655 [292] [DEBUG] [app] Starting request: urn:request:b9492e6e-532d-4572-b973-1cb8936af624 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:38:00,656 [284] [DEBUG] [app] Starting request: urn:request:6d80cd71-c4f1-40b8-9ba4-904fdc6e5e2c (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:38:00,656 [292] [DEBUG] [app] Ending request: urn:request:b9492e6e-532d-4572-b973-1cb8936af624 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b9492e6e-532d-4572-b973-1cb8936af624', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:38:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:38:00,656 [284] [DEBUG] [app] Ending request: urn:request:6d80cd71-c4f1-40b8-9ba4-904fdc6e5e2c (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:6d80cd71-c4f1-40b8-9ba4-904fdc6e5e2c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:38:00,656 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:38:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:38:00,656 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-registry stdout | 2024-04-22 04:38:00,656 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:38:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:38:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:38:00,656 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:38:00,657 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:38:00,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:38:00,658 [278] [DEBUG] [app] Starting request: urn:request:18f858c8-981c-42ed-8612-84e92123e9f6 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:38:00,659 [278] [DEBUG] [app] Ending request: urn:request:18f858c8-981c-42ed-8612-84e92123e9f6 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:18f858c8-981c-42ed-8612-84e92123e9f6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:38:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:38:00,659 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:38:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:38:00,659 [281] [DEBUG] [app] Starting request: urn:request:afa44d6e-dcb9-401b-8fc8-660389e1d059 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:38:00,659 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:38:00,660 [281] [DEBUG] [app] Ending request: urn:request:afa44d6e-dcb9-401b-8fc8-660389e1d059 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:afa44d6e-dcb9-401b-8fc8-660389e1d059', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:38:00,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:38:00,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:38:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:38:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:38:00,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:38:00,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:38:00,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:38:00,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:38:00,673 [278] [DEBUG] [app] Ending request: urn:request:57f7c0da-8d77-4665-b8d8-ea95d82af1b9 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:57f7c0da-8d77-4665-b8d8-ea95d82af1b9', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:38:00,674 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:38:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:38:00,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:38:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:38:00,674 [279] [DEBUG] [app] Ending request: urn:request:9fd40c5c-9c40-42be-b7ed-c096c15c3287 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:9fd40c5c-9c40-42be-b7ed-c096c15c3287', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:38:00,674 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:38:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:38:00,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:38:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:38:00,742 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:38:00,803 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:38:00,860 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:38:00,960 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
quotatotalworker stdout | 2024-04-22 04:38:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:38:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:38:16.054492+00:00 (in 14.999482 seconds)
quotatotalworker stdout | 2024-04-22 04:38:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:38:16 UTC)" (scheduled at 2024-04-22 04:38:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:38:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:38:01,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:38:01,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:38:16 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:38:01,924 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:38:01,984 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
securityscanningnotificationworker stdout | 2024-04-22 04:38:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:38:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:38:16.552337+00:00 (in 13.995617 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:38:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:39:02 UTC)" (scheduled at 2024-04-22 04:38:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:38:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:38:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:39:02 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:38:02,878 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:38:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:38:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:38:13.759375+00:00 (in 9.999441 seconds)
notificationworker stdout | 2024-04-22 04:38:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:38:13 UTC)" (scheduled at 2024-04-22 04:38:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:38:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:38:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 38, 3, 760231), True, datetime.datetime(2024, 4, 22, 4, 38, 3, 760231), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:38:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:38:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:38:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:38:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:38:04,616 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:38:05,229 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:38:05,233 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:38:05,236 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
securityworker stdout | 2024-04-22 04:38:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:38:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:38:26.873109+00:00 (in 21.000760 seconds)
securityworker stdout | 2024-04-22 04:38:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:38:35 UTC)" (scheduled at 2024-04-22 04:38:05.871852+00:00)
securityworker stdout | 2024-04-22 04:38:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:38:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:38:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:38:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:38:05,885 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:38:05,885 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:38:35 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:38:05,916 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:38:05,976 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:38:06,424 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
repositorygcworker stdout | 2024-04-22 04:38:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:38:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:38:13.555667+00:00 (in 7.002742 seconds)
repositorygcworker stdout | 2024-04-22 04:38:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:39:06 UTC)" (scheduled at 2024-04-22 04:38:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:38:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:38:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 38, 6, 553279), True, datetime.datetime(2024, 4, 22, 4, 38, 6, 553279), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:38:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:38:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:38:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:39:06 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:38:07,333 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-web stdout | 2024-04-22 04:38:07,696 [281] [DEBUG] [app] Starting request: urn:request:064f9752-f5de-4d02-943e-26aedc176dbe (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:38:07,696 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:38:07,696 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:38:07,697 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:38:07,706 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:38:07,706 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:38:07,706 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:38:07,706 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:38:07,707 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:38:07,707 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:38:07,707 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:38:07,707 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:38:07,709 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:38:07,716 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:38:07,717 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:38:07,721 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:38:07,725 [281] [DEBUG] [app] Ending request: urn:request:064f9752-f5de-4d02-943e-26aedc176dbe (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:064f9752-f5de-4d02-943e-26aedc176dbe', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:38:07,725 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:38:07,726 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:38:07 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:38:07 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.032 1536 0.031)
autopruneworker stdout | 2024-04-22 04:38:08,437 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:38:08,622 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:38:08,915 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:38:09,859 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:38:11,028 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:38:11,046 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
autopruneworker stdout | 2024-04-22 04:38:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:38:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:38:41.264267+00:00 (in 29.999411 seconds)
autopruneworker stdout | 2024-04-22 04:38:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:38:41 UTC)" (scheduled at 2024-04-22 04:38:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:38:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713760631271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:38:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:38:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:38:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:38:41 UTC)" executed successfully
manifestbackfillworker stdout | 2024-04-22 04:38:11,456 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:38:11,537 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
gunicorn-registry stdout | 2024-04-22 04:38:11,646 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:38:11,652 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:38:11,658 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:38:11,682 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:38:11,684 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:38:11,687 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:38:11,689 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:38:11,693 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:38:11,696 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
storagereplication stdout | 2024-04-22 04:38:12,954 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:38:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:38:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:39:06.552482+00:00 (in 52.996357 seconds)
repositorygcworker stdout | 2024-04-22 04:38:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:39:13 UTC)" (scheduled at 2024-04-22 04:38:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:38:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:38:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:39:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:38:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:38:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:38:19.762160+00:00 (in 6.002286 seconds)
notificationworker stdout | 2024-04-22 04:38:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:38:23 UTC)" (scheduled at 2024-04-22 04:38:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:38:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:38:13,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 38, 13, 760157), True, datetime.datetime(2024, 4, 22, 4, 38, 13, 760157), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:38:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:38:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:38:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:38:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:38:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:38:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:38:44.952062+00:00 (in 29.999517 seconds)
gcworker stdout | 2024-04-22 04:38:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:38:44 UTC)" (scheduled at 2024-04-22 04:38:14.952062+00:00)
gcworker stdout | 2024-04-22 04:38:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712551094952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:38:14,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:38:14,964 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:38:14,964 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:38:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:38:15,653 [281] [DEBUG] [app] Starting request: urn:request:79fdcd5d-c58a-404b-822b-a06bc84754e6 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:38:15,653 [279] [DEBUG] [app] Starting request: urn:request:9c4e30ee-4aa1-41e5-a67d-962ef95cd65d (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:38:15,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:38:15,655 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:38:15,656 [292] [DEBUG] [app] Starting request: urn:request:cc10c7ad-4912-4755-9729-93f38da13508 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:38:15,656 [288] [DEBUG] [app] Starting request: urn:request:a0a955b6-c165-4701-a871-e2e08150420d (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:38:15,657 [292] [DEBUG] [app] Ending request: urn:request:cc10c7ad-4912-4755-9729-93f38da13508 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:cc10c7ad-4912-4755-9729-93f38da13508', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:38:15,657 [288] [DEBUG] [app] Ending request: urn:request:a0a955b6-c165-4701-a871-e2e08150420d (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:a0a955b6-c165-4701-a871-e2e08150420d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:38:15,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:38:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:38:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:38:15,657 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:38:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:38:15,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:38:15,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:38:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:38:15,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:38:15,659 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:38:15,659 [281] [DEBUG] [app] Starting request: urn:request:5381d8b7-6c78-4dbf-8cb8-576d6476606b (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:38:15,660 [281] [DEBUG] [app] Ending request: urn:request:5381d8b7-6c78-4dbf-8cb8-576d6476606b (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:5381d8b7-6c78-4dbf-8cb8-576d6476606b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:38:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:38:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:38:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:38:15,660 [282] [DEBUG] [app] Starting request: urn:request:2722eadb-548d-4f02-9261-4782c5958e80 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:38:15,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:38:15,660 [282] [DEBUG] [app] Ending request: urn:request:2722eadb-548d-4f02-9261-4782c5958e80 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:2722eadb-548d-4f02-9261-4782c5958e80', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:38:15,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:38:15,661 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:38:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:38:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:38:15,661 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:38:15,661 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:38:15,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:38:15,667 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:38:15,675 [281] [DEBUG] [app] Ending request: urn:request:79fdcd5d-c58a-404b-822b-a06bc84754e6 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:79fdcd5d-c58a-404b-822b-a06bc84754e6', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:38:15,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:38:15,675 [279] [DEBUG] [app] Ending request: urn:request:9c4e30ee-4aa1-41e5-a67d-962ef95cd65d (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:9c4e30ee-4aa1-41e5-a67d-962ef95cd65d', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:38:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:38:15,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:38:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:38:15,675 [279] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:38:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:38:15,675 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:38:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:38:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:38:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:38:31.054492+00:00 (in 14.999474 seconds)
quotatotalworker stdout | 2024-04-22 04:38:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:38:31 UTC)" (scheduled at 2024-04-22 04:38:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:38:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:38:16,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:38:16,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:38:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:38:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:38:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:39:02.556208+00:00 (in 46.003278 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:38:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:39:16 UTC)" (scheduled at 2024-04-22 04:38:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:38:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:38:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 38, 16, 553367), True, datetime.datetime(2024, 4, 22, 4, 38, 16, 553367), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:38:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:38:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:38:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:39:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:38:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:38:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:38:47.052354+00:00 (in 29.999485 seconds)
buildlogsarchiver stdout | 2024-04-22 04:38:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:38:47 UTC)" (scheduled at 2024-04-22 04:38:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:38:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 38, 17, 53233), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:38:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:38:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:38:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:38:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:38:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:38:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:38:23.759375+00:00 (in 3.996722 seconds)
notificationworker stdout | 2024-04-22 04:38:19,762 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:43:19 UTC)" (scheduled at 2024-04-22 04:38:19.762160+00:00)
notificationworker stdout | 2024-04-22 04:38:19,763 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2024, 4, 22, 4, 38, 19, 762903), 'notification/%'])
notificationworker stdout | 2024-04-22 04:38:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:39:19 UTC)" (scheduled at 2024-04-22 04:38:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:38:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:38:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:39:19 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:38:19,773 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 38, 19, 762903), True, datetime.datetime(2024, 4, 22, 4, 38, 19, 762903), 0, 'notification/%'])
notificationworker stdout | 2024-04-22 04:38:19,776 [78] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2024, 4, 22, 4, 38, 19, 762903), True, datetime.datetime(2024, 4, 22, 4, 38, 19, 762903), 0, 'notification/%', False, datetime.datetime(2024, 4, 22, 4, 38, 19, 762903), 'notification/%'])
notificationworker stdout | 2024-04-22 04:38:19,778 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:38:19,778 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2024-04-22 04:43:19 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:38:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:38:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:38:43.057186+00:00 (in 20.997702 seconds)
namespacegcworker stdout | 2024-04-22 04:38:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:39:22 UTC)" (scheduled at 2024-04-22 04:38:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:38:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:38:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:39:22 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:38:22,157 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:38:23,246 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:38:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:38:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:38:33.759375+00:00 (in 9.999428 seconds)
notificationworker stdout | 2024-04-22 04:38:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:38:33 UTC)" (scheduled at 2024-04-22 04:38:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:38:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:38:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 38, 23, 760260), True, datetime.datetime(2024, 4, 22, 4, 38, 23, 760260), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:38:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:38:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:38:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:38:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:38:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:38:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:39:24.361582+00:00 (in 59.999449 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:38:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:39:24 UTC)" (scheduled at 2024-04-22 04:38:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:38:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:38:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:38:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:39:24 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:38:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:38:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:38:35.871852+00:00 (in 8.998268 seconds)
securityworker stdout | 2024-04-22 04:38:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:38:56 UTC)" (scheduled at 2024-04-22 04:38:26.873109+00:00)
securityworker stdout | 2024-04-22 04:38:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:38:26,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:38:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:38:26,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:38:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:38:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:38:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:38:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:38:26,880 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:38:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:38:26,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:38:26,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:38:26,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 33, 26, 880619), 1, 2])
securityworker stdout | 2024-04-22 04:38:26,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:38:26,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:38:26,896 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 33, 26, 880619), 1, 2])
securityworker stdout | 2024-04-22 04:38:26,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:38:26,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:38:26,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:38:26,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:38:26,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:38:26,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:38:26,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:38:26,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:38:26,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:38:26,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:38:56 UTC)" executed successfully
builder stdout | 2024-04-22 04:38:26,908 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 04:38:28,713 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:38:30,045 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:38:30,114 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:38:30,653 [279] [DEBUG] [app] Starting request: urn:request:2a4c3fcf-ac43-4d0f-b293-1873a6817d5c (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:38:30,653 [281] [DEBUG] [app] Starting request: urn:request:3ce55dd1-2280-4602-b6be-569542633607 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:38:30,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:38:30,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:38:30,656 [292] [DEBUG] [app] Starting request: urn:request:7dca8fba-293d-441d-bb8d-a21a3753df3e (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:38:30,656 [284] [DEBUG] [app] Starting request: urn:request:7af1eead-f324-45b6-9733-8c8282a276ae (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:38:30,657 [292] [DEBUG] [app] Ending request: urn:request:7dca8fba-293d-441d-bb8d-a21a3753df3e (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7dca8fba-293d-441d-bb8d-a21a3753df3e', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:38:30,657 [284] [DEBUG] [app] Ending request: urn:request:7af1eead-f324-45b6-9733-8c8282a276ae (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:7af1eead-f324-45b6-9733-8c8282a276ae', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:38:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:38:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:38:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:38:30,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:38:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:38:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:38:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:38:30,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:38:30,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:38:30,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:38:30,659 [279] [DEBUG] [app] Starting request: urn:request:506bb24c-f8ff-48a9-aeb9-cbc27eb0d0ab (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:38:30,660 [279] [DEBUG] [app] Ending request: urn:request:506bb24c-f8ff-48a9-aeb9-cbc27eb0d0ab (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:506bb24c-f8ff-48a9-aeb9-cbc27eb0d0ab', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:38:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:38:30,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:38:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:38:30,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:38:30,660 [278] [DEBUG] [app] Starting request: urn:request:4248aae8-2f1c-44db-8862-0783c50655d2 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:38:30,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:38:30,660 [278] [DEBUG] [app] Ending request: urn:request:4248aae8-2f1c-44db-8862-0783c50655d2 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:4248aae8-2f1c-44db-8862-0783c50655d2', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:38:30,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:38:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:38:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:38:30,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:38:30,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:38:30,662 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:38:30,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:38:30,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:38:30,674 [279] [DEBUG] [app] Ending request: urn:request:2a4c3fcf-ac43-4d0f-b293-1873a6817d5c (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2a4c3fcf-ac43-4d0f-b293-1873a6817d5c', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:38:30,674 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:38:30,674 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:38:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:38:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:38:30,674 [281] [DEBUG] [app] Ending request: urn:request:3ce55dd1-2280-4602-b6be-569542633607 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:3ce55dd1-2280-4602-b6be-569542633607', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:38:30,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:38:30,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:38:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:38:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:38:30,752 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:38:30,813 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:38:30,872 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:38:30,972 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
quotatotalworker stdout | 2024-04-22 04:38:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:38:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:38:46.054492+00:00 (in 14.999470 seconds)
quotatotalworker stdout | 2024-04-22 04:38:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:38:46 UTC)" (scheduled at 2024-04-22 04:38:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:38:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:38:31,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:38:31,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:38:46 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:38:31,960 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:38:32,008 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotaregistrysizeworker stdout | 2024-04-22 04:38:32,915 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:38:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:38:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:38:43.759375+00:00 (in 9.999420 seconds)
notificationworker stdout | 2024-04-22 04:38:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:38:43 UTC)" (scheduled at 2024-04-22 04:38:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:38:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:38:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 38, 33, 760267), True, datetime.datetime(2024, 4, 22, 4, 38, 33, 760267), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:38:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:38:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:38:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:38:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:38:34,628 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:38:35,239 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:38:35,241 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:38:35,244 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
securityworker stdout | 2024-04-22 04:38:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:38:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:38:56.873109+00:00 (in 21.000770 seconds)
securityworker stdout | 2024-04-22 04:38:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:39:05 UTC)" (scheduled at 2024-04-22 04:38:35.871852+00:00)
securityworker stdout | 2024-04-22 04:38:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:38:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:38:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:38:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:38:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:38:35,887 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:38:35,890 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:38:35,890 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:38:35,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 33, 35, 876215), 1, 2])
securityworker stdout | 2024-04-22 04:38:35,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:38:35,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:38:35,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 33, 35, 876215), 1, 2])
securityworker stdout | 2024-04-22 04:38:35,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:38:35,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:38:35,895 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:38:35,895 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:39:05 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:38:35,953 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:38:36,009 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:38:36,462 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
logrotateworker stdout | 2024-04-22 04:38:37,358 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
gunicorn-web stdout | 2024-04-22 04:38:38,083 [278] [DEBUG] [app] Starting request: urn:request:c9d76a1e-989e-49a5-8cdb-6b5b3ae4f346 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:38:38,083 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:38:38,083 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:38:38,084 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:38:38,094 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:38:38,094 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:38:38,094 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:38:38,094 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:38:38,094 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:38:38,094 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:38:38,094 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:38:38,094 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:38:38,096 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:38:38,102 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:38:38,103 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:38:38,108 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:38:38,112 [278] [DEBUG] [app] Ending request: urn:request:c9d76a1e-989e-49a5-8cdb-6b5b3ae4f346 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:c9d76a1e-989e-49a5-8cdb-6b5b3ae4f346', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:38:38,112 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:38:38,112 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:38:38 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:38:38 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1555 0.030)
autopruneworker stdout | 2024-04-22 04:38:38,463 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:38:38,660 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:38:38,951 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
exportactionlogsworker stdout | 2024-04-22 04:38:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:38:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:38:41.564959+00:00 (in 1.997491 seconds)
exportactionlogsworker stdout | 2024-04-22 04:38:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:39:39 UTC)" (scheduled at 2024-04-22 04:38:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:38:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:38:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:39:39 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 04:38:39,895 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:38:41,049 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:38:41,057 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
autopruneworker stdout | 2024-04-22 04:38:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:38:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:39:11.264267+00:00 (in 29.999508 seconds)
autopruneworker stdout | 2024-04-22 04:38:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:39:11 UTC)" (scheduled at 2024-04-22 04:38:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:38:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713760661271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:38:41,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:38:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:38:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:39:11 UTC)" executed successfully
manifestbackfillworker stdout | 2024-04-22 04:38:41,493 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
exportactionlogsworker stdout | 2024-04-22 04:38:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:38:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:39:39.566970+00:00 (in 58.001492 seconds)
exportactionlogsworker stdout | 2024-04-22 04:38:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:39:41 UTC)" (scheduled at 2024-04-22 04:38:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:38:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:38:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 38, 41, 565750), True, datetime.datetime(2024, 4, 22, 4, 38, 41, 565750), 0, 'exportactionlogs/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:38:41,572 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
exportactionlogsworker stdout | 2024-04-22 04:38:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:38:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:38:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:39:41 UTC)" executed successfully
gunicorn-registry stdout | 2024-04-22 04:38:41,654 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:38:41,659 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:38:41,665 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:38:41,693 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:38:41,696 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:38:41,698 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:38:41,701 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:38:41,705 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:38:41,708 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
storagereplication stdout | 2024-04-22 04:38:42,963 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
namespacegcworker stdout | 2024-04-22 04:38:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:38:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:39:22.058978+00:00 (in 39.001351 seconds)
namespacegcworker stdout | 2024-04-22 04:38:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:39:43 UTC)" (scheduled at 2024-04-22 04:38:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:38:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:38:43,059 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 38, 43, 58053), True, datetime.datetime(2024, 4, 22, 4, 38, 43, 58053), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:38:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:38:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:38:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:39:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:38:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:38:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:38:53.759375+00:00 (in 9.999524 seconds)
notificationworker stdout | 2024-04-22 04:38:43,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:38:53 UTC)" (scheduled at 2024-04-22 04:38:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:38:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:38:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 38, 43, 760125), True, datetime.datetime(2024, 4, 22, 4, 38, 43, 760125), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:38:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:38:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:38:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:38:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:38:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:38:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:39:14.952062+00:00 (in 29.999471 seconds)
gcworker stdout | 2024-04-22 04:38:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:39:14 UTC)" (scheduled at 2024-04-22 04:38:44.952062+00:00)
gcworker stdout | 2024-04-22 04:38:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712551124953, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:38:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:38:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:38:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:39:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:38:45,652 [278] [DEBUG] [app] Starting request: urn:request:d27f5b38-dc2e-4fca-9e8a-a336fcbafe62 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:38:45,652 [281] [DEBUG] [app] Starting request: urn:request:5e02edff-6646-4778-9921-35ab1e6746d8 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:38:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:38:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:38:45,655 [290] [DEBUG] [app] Starting request: urn:request:710bb7cd-4a97-4ec2-9fcd-e28740f5df85 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:38:45,655 [286] [DEBUG] [app] Starting request: urn:request:6b515fcb-037a-4f75-9250-321da20ae345 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:38:45,656 [290] [DEBUG] [app] Ending request: urn:request:710bb7cd-4a97-4ec2-9fcd-e28740f5df85 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:710bb7cd-4a97-4ec2-9fcd-e28740f5df85', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:38:45,656 [286] [DEBUG] [app] Ending request: urn:request:6b515fcb-037a-4f75-9250-321da20ae345 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:6b515fcb-037a-4f75-9250-321da20ae345', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:38:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:38:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:38:45,656 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:38:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:38:45,656 [286] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:38:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:38:45,656 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:38:45,656 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:38:45,657 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:38:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:38:45,658 [281] [DEBUG] [app] Starting request: urn:request:f089fb8a-5e89-4de2-845f-2d81bb285945 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:38:45,659 [281] [DEBUG] [app] Ending request: urn:request:f089fb8a-5e89-4de2-845f-2d81bb285945 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:f089fb8a-5e89-4de2-845f-2d81bb285945', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:38:45,659 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:38:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:38:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:38:45,659 [279] [DEBUG] [app] Starting request: urn:request:aca3d552-b8a9-4c0c-9cf4-54995bfac1ed (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:38:45,659 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:38:45,660 [279] [DEBUG] [app] Ending request: urn:request:aca3d552-b8a9-4c0c-9cf4-54995bfac1ed (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:aca3d552-b8a9-4c0c-9cf4-54995bfac1ed', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:38:45,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:38:45,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:38:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:38:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.001)
gunicorn-web stdout | 2024-04-22 04:38:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:38:45,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:38:45,665 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:38:45,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:38:45,673 [281] [DEBUG] [app] Ending request: urn:request:5e02edff-6646-4778-9921-35ab1e6746d8 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:5e02edff-6646-4778-9921-35ab1e6746d8', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:38:45,673 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:38:45,673 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:38:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:38:45,674 [278] [DEBUG] [app] Ending request: urn:request:d27f5b38-dc2e-4fca-9e8a-a336fcbafe62 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:d27f5b38-dc2e-4fca-9e8a-a336fcbafe62', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:38:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:38:45,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:38:45,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:38:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:38:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
quotatotalworker stdout | 2024-04-22 04:38:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:38:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:39:01.054492+00:00 (in 14.999476 seconds)
quotatotalworker stdout | 2024-04-22 04:38:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:39:01 UTC)" (scheduled at 2024-04-22 04:38:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:38:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:38:46,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:38:46,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:39:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:38:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:38:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:39:17.052354+00:00 (in 29.999515 seconds)
buildlogsarchiver stdout | 2024-04-22 04:38:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:39:17 UTC)" (scheduled at 2024-04-22 04:38:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:38:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 38, 47, 53208), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:38:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:38:47,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:38:47,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:39:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:38:52,193 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:38:53,282 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:38:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:38:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:39:03.759375+00:00 (in 9.999445 seconds)
notificationworker stdout | 2024-04-22 04:38:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:39:03 UTC)" (scheduled at 2024-04-22 04:38:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:38:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:38:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 38, 53, 760406), True, datetime.datetime(2024, 4, 22, 4, 38, 53, 760406), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:38:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:38:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:38:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:39:03 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:38:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:38:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:39:05.871852+00:00 (in 8.998243 seconds)
securityworker stdout | 2024-04-22 04:38:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:39:26 UTC)" (scheduled at 2024-04-22 04:38:56.873109+00:00)
securityworker stdout | 2024-04-22 04:38:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:38:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:38:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:38:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:38:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:38:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:38:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:38:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:38:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:38:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:38:56,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:38:56,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:38:56,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 33, 56, 881175), 1, 2])
securityworker stdout | 2024-04-22 04:38:56,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:38:56,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:38:56,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 33, 56, 881175), 1, 2])
securityworker stdout | 2024-04-22 04:38:56,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:38:56,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:38:56,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:38:56,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:38:56,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:38:56,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:38:56,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:38:56,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:38:56,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:38:56,901 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:39:26 UTC)" executed successfully
builder stdout | 2024-04-22 04:38:56,932 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 04:38:58,746 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:39:00,082 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:39:00,150 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:39:00,653 [278] [DEBUG] [app] Starting request: urn:request:64b7cd08-799e-408c-9093-3394294771fe (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:39:00,653 [282] [DEBUG] [app] Starting request: urn:request:7839b470-31a5-466e-8ab0-314d18e4c89c (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:39:00,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:39:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:39:00,656 [284] [DEBUG] [app] Starting request: urn:request:088b036a-5b18-49a0-a22d-67456af91587 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:39:00,656 [292] [DEBUG] [app] Starting request: urn:request:55d1b2b0-f206-4073-bc08-f0c6bf02aad3 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:39:00,656 [284] [DEBUG] [app] Ending request: urn:request:088b036a-5b18-49a0-a22d-67456af91587 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:088b036a-5b18-49a0-a22d-67456af91587', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:39:00,657 [292] [DEBUG] [app] Ending request: urn:request:55d1b2b0-f206-4073-bc08-f0c6bf02aad3 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:55d1b2b0-f206-4073-bc08-f0c6bf02aad3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:39:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:39:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:39:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:39:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:39:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:39:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:39:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:39:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.001)
gunicorn-web stdout | 2024-04-22 04:39:00,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:39:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:39:00,659 [278] [DEBUG] [app] Starting request: urn:request:6ea89cd5-1a1b-450c-8628-54afcd4adb53 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:39:00,659 [278] [DEBUG] [app] Ending request: urn:request:6ea89cd5-1a1b-450c-8628-54afcd4adb53 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:6ea89cd5-1a1b-450c-8628-54afcd4adb53', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:39:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:39:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:39:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:39:00,660 [281] [DEBUG] [app] Starting request: urn:request:2a371be1-6956-404a-acc7-32f0cbfd4b78 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:39:00,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:39:00,660 [281] [DEBUG] [app] Ending request: urn:request:2a371be1-6956-404a-acc7-32f0cbfd4b78 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:2a371be1-6956-404a-acc7-32f0cbfd4b78', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:39:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:39:00,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:39:00,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:39:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:39:00,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:39:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:39:00,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:39:00,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:39:00,670 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:39:00,674 [278] [DEBUG] [app] Ending request: urn:request:64b7cd08-799e-408c-9093-3394294771fe (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:64b7cd08-799e-408c-9093-3394294771fe', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:39:00,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:39:00,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:39:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:39:00,674 [282] [DEBUG] [app] Ending request: urn:request:7839b470-31a5-466e-8ab0-314d18e4c89c (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:7839b470-31a5-466e-8ab0-314d18e4c89c', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:39:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:39:00,674 [282] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:39:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.023)
gunicorn-web stdout | 2024-04-22 04:39:00,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:39:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:39:00,762 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:39:00,825 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:39:00,883 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:39:00,985 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
quotatotalworker stdout | 2024-04-22 04:39:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:39:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:39:16.054492+00:00 (in 14.999476 seconds)
quotatotalworker stdout | 2024-04-22 04:39:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:39:16 UTC)" (scheduled at 2024-04-22 04:39:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:39:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:39:01,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:39:01,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:39:16 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:39:01,996 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:39:02,044 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
securityscanningnotificationworker stdout | 2024-04-22 04:39:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:39:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:39:16.552337+00:00 (in 13.995591 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:39:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:40:02 UTC)" (scheduled at 2024-04-22 04:39:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:39:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:39:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:40:02 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:39:02,951 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:39:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:39:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:39:13.759375+00:00 (in 9.999476 seconds)
notificationworker stdout | 2024-04-22 04:39:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:39:13 UTC)" (scheduled at 2024-04-22 04:39:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:39:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:39:03,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 39, 3, 760199), True, datetime.datetime(2024, 4, 22, 4, 39, 3, 760199), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:39:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:39:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:39:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:39:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:39:04,666 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:39:05,246 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:39:05,250 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:39:05,252 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
securityworker stdout | 2024-04-22 04:39:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:39:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:39:26.873109+00:00 (in 21.000763 seconds)
securityworker stdout | 2024-04-22 04:39:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:39:35 UTC)" (scheduled at 2024-04-22 04:39:05.871852+00:00)
securityworker stdout | 2024-04-22 04:39:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:39:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:39:05,874 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:39:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:39:05,884 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:39:05,885 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:39:35 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:39:05,977 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:39:06,027 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:39:06,496 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
repositorygcworker stdout | 2024-04-22 04:39:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:39:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:39:13.555667+00:00 (in 7.002675 seconds)
repositorygcworker stdout | 2024-04-22 04:39:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:40:06 UTC)" (scheduled at 2024-04-22 04:39:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:39:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:39:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 39, 6, 553396), True, datetime.datetime(2024, 4, 22, 4, 39, 6, 553396), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:39:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:39:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:39:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:40:06 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:39:07,377 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:39:08,480 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:39:08,669 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:39:08,988 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
gunicorn-web stdout | 2024-04-22 04:39:09,201 [278] [DEBUG] [app] Starting request: urn:request:2aa789ab-39f6-4c9b-914e-d4a5900bc170 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:39:09,202 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:39:09,202 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:39:09,202 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:39:09,212 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:39:09,212 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:39:09,212 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:39:09,212 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:39:09,212 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:39:09,212 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:39:09,212 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:39:09,213 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:39:09,215 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:39:09,222 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:39:09,223 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:39:09,227 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:39:09,231 [278] [DEBUG] [app] Ending request: urn:request:2aa789ab-39f6-4c9b-914e-d4a5900bc170 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:2aa789ab-39f6-4c9b-914e-d4a5900bc170', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:39:09,232 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:39:09,232 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:39:09 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:39:09 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.032 1536 0.032)
blobuploadcleanupworker stdout | 2024-04-22 04:39:09,932 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:39:11,065 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:39:11,068 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
autopruneworker stdout | 2024-04-22 04:39:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:39:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:39:41.264267+00:00 (in 29.999458 seconds)
autopruneworker stdout | 2024-04-22 04:39:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:39:41 UTC)" (scheduled at 2024-04-22 04:39:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:39:11,274 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713760691273, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:39:11,278 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:39:11,278 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:39:11,278 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:39:41 UTC)" executed successfully
manifestbackfillworker stdout | 2024-04-22 04:39:11,529 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:39:11,578 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
gunicorn-registry stdout | 2024-04-22 04:39:11,665 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:39:11,670 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:39:11,676 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:39:11,699 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:39:11,706 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:39:11,709 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:39:11,712 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:39:11,716 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:39:11,719 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
storagereplication stdout | 2024-04-22 04:39:12,999 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:39:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:39:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:40:06.552482+00:00 (in 52.996322 seconds)
repositorygcworker stdout | 2024-04-22 04:39:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:40:13 UTC)" (scheduled at 2024-04-22 04:39:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:39:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:39:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:40:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:39:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:39:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:39:19.762424+00:00 (in 6.002584 seconds)
notificationworker stdout | 2024-04-22 04:39:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:39:23 UTC)" (scheduled at 2024-04-22 04:39:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:39:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:39:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 39, 13, 760098), True, datetime.datetime(2024, 4, 22, 4, 39, 13, 760098), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:39:13,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:39:13,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:39:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:39:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:39:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:39:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:39:44.952062+00:00 (in 29.999544 seconds)
gcworker stdout | 2024-04-22 04:39:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:39:44 UTC)" (scheduled at 2024-04-22 04:39:14.952062+00:00)
gcworker stdout | 2024-04-22 04:39:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712551154952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:39:14,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:39:14,964 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:39:14,964 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:39:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:39:15,653 [282] [DEBUG] [app] Starting request: urn:request:934e30be-ff6b-42a7-bcc3-3daaaee64515 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:39:15,653 [281] [DEBUG] [app] Starting request: urn:request:74dd0f35-d4df-4a62-b840-03e3f57638bf (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:39:15,655 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:39:15,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:39:15,657 [292] [DEBUG] [app] Starting request: urn:request:45fcb597-99e7-469b-aba9-ea200a3f20bb (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:39:15,657 [284] [DEBUG] [app] Starting request: urn:request:68ed21ba-d413-4cfe-8117-fef649fbe862 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:39:15,657 [292] [DEBUG] [app] Ending request: urn:request:45fcb597-99e7-469b-aba9-ea200a3f20bb (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:45fcb597-99e7-469b-aba9-ea200a3f20bb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:39:15,657 [284] [DEBUG] [app] Ending request: urn:request:68ed21ba-d413-4cfe-8117-fef649fbe862 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:68ed21ba-d413-4cfe-8117-fef649fbe862', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:39:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:39:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:39:15,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:39:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:39:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:39:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:39:15,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:39:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:39:15,659 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:39:15,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:39:15,660 [282] [DEBUG] [app] Starting request: urn:request:27d84b4d-7e6a-4572-9c94-be795bf58a01 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:39:15,660 [278] [DEBUG] [app] Starting request: urn:request:4febbdc2-8424-48b9-a30c-46d9ea533e20 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:39:15,660 [282] [DEBUG] [app] Ending request: urn:request:27d84b4d-7e6a-4572-9c94-be795bf58a01 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:27d84b4d-7e6a-4572-9c94-be795bf58a01', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:39:15,660 [278] [DEBUG] [app] Ending request: urn:request:4febbdc2-8424-48b9-a30c-46d9ea533e20 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:4febbdc2-8424-48b9-a30c-46d9ea533e20', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:39:15,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:39:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:39:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:39:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 04:39:15,661 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:39:15,661 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:39:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:39:15,661 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:39:15,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:39:15,661 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:39:15,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:39:15,667 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:39:15,674 [282] [DEBUG] [app] Ending request: urn:request:934e30be-ff6b-42a7-bcc3-3daaaee64515 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:934e30be-ff6b-42a7-bcc3-3daaaee64515', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:39:15,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:39:15,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:39:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:39:15,675 [281] [DEBUG] [app] Ending request: urn:request:74dd0f35-d4df-4a62-b840-03e3f57638bf (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:74dd0f35-d4df-4a62-b840-03e3f57638bf', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:39:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.022)
gunicorn-web stdout | 2024-04-22 04:39:15,675 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:39:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:39:15,675 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:39:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
quotatotalworker stdout | 2024-04-22 04:39:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:39:16,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:39:31.054492+00:00 (in 14.999476 seconds)
quotatotalworker stdout | 2024-04-22 04:39:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:39:31 UTC)" (scheduled at 2024-04-22 04:39:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:39:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:39:16,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:39:16,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:39:31 UTC)" executed successfully
securityscanningnotificationworker stdout | 2024-04-22 04:39:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:39:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:40:02.556208+00:00 (in 46.003263 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:39:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:40:16 UTC)" (scheduled at 2024-04-22 04:39:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:39:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:39:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 39, 16, 553346), True, datetime.datetime(2024, 4, 22, 4, 39, 16, 553346), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:39:16,564 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:39:16,564 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:39:16,564 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:40:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:39:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:39:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:39:47.052354+00:00 (in 29.999516 seconds)
buildlogsarchiver stdout | 2024-04-22 04:39:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:39:47 UTC)" (scheduled at 2024-04-22 04:39:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:39:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 39, 17, 53216), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:39:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:39:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:39:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:39:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:39:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:39:19,762 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:39:23.759375+00:00 (in 3.996429 seconds)
notificationworker stdout | 2024-04-22 04:39:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:40:19 UTC)" (scheduled at 2024-04-22 04:39:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:39:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:39:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:40:19 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:39:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:39:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:39:43.057186+00:00 (in 20.997705 seconds)
namespacegcworker stdout | 2024-04-22 04:39:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:40:22 UTC)" (scheduled at 2024-04-22 04:39:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:39:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:39:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:40:22 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:39:22,225 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:39:23,319 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:39:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:39:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:39:33.759375+00:00 (in 9.999433 seconds)
notificationworker stdout | 2024-04-22 04:39:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:39:33 UTC)" (scheduled at 2024-04-22 04:39:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:39:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:39:23,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 39, 23, 760309), True, datetime.datetime(2024, 4, 22, 4, 39, 23, 760309), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:39:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:39:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:39:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:39:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:39:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:39:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:40:24.361582+00:00 (in 59.999447 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:39:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:40:24 UTC)" (scheduled at 2024-04-22 04:39:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:39:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:39:24,371 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:39:24,371 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:40:24 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:39:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:39:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:39:35.871852+00:00 (in 8.998305 seconds)
securityworker stdout | 2024-04-22 04:39:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:39:56 UTC)" (scheduled at 2024-04-22 04:39:26.873109+00:00)
securityworker stdout | 2024-04-22 04:39:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:39:26,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:39:26,876 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:39:26,876 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:39:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:39:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:39:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:39:26,879 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:39:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:39:26,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:39:26,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:39:26,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:39:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 34, 26, 881514), 1, 2])
securityworker stdout | 2024-04-22 04:39:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:39:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:39:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 34, 26, 881514), 1, 2])
securityworker stdout | 2024-04-22 04:39:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:39:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:39:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:39:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:39:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:39:26,900 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:39:26,900 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:39:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:39:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:39:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:39:56 UTC)" executed successfully
builder stdout | 2024-04-22 04:39:26,964 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 04:39:28,755 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:39:30,118 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:39:30,186 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:39:30,653 [278] [DEBUG] [app] Starting request: urn:request:7020acb2-a66d-4ee9-adcd-44b0d1bef332 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:39:30,653 [282] [DEBUG] [app] Starting request: urn:request:9c459e98-f30e-4d58-8b01-0cb81ba6b436 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:39:30,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:39:30,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:39:30,656 [284] [DEBUG] [app] Starting request: urn:request:f140f3d3-f912-46ce-a6d2-e3f9de9786d3 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:39:30,656 [290] [DEBUG] [app] Starting request: urn:request:ffb791f3-0930-444e-a13f-94bd065eee4c (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:39:30,657 [284] [DEBUG] [app] Ending request: urn:request:f140f3d3-f912-46ce-a6d2-e3f9de9786d3 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f140f3d3-f912-46ce-a6d2-e3f9de9786d3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:39:30,657 [290] [DEBUG] [app] Ending request: urn:request:ffb791f3-0930-444e-a13f-94bd065eee4c (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:ffb791f3-0930-444e-a13f-94bd065eee4c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:39:30,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:39:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:39:30,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:39:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:39:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:39:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:39:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:39:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:39:30,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:39:30,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:39:30,660 [278] [DEBUG] [app] Starting request: urn:request:abeceae6-afa4-4129-98ea-7e13c8685823 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:39:30,660 [278] [DEBUG] [app] Ending request: urn:request:abeceae6-afa4-4129-98ea-7e13c8685823 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:abeceae6-afa4-4129-98ea-7e13c8685823', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:39:30,660 [281] [DEBUG] [app] Starting request: urn:request:46cb7ad4-5c33-4028-8fe1-848cdf651904 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:39:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:39:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:39:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:39:30,660 [281] [DEBUG] [app] Ending request: urn:request:46cb7ad4-5c33-4028-8fe1-848cdf651904 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:46cb7ad4-5c33-4028-8fe1-848cdf651904', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:39:30,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:39:30,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:39:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:39:30,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:39:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:39:30,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:39:30,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:39:30,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:39:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:39:30,675 [278] [DEBUG] [app] Ending request: urn:request:7020acb2-a66d-4ee9-adcd-44b0d1bef332 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:7020acb2-a66d-4ee9-adcd-44b0d1bef332', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:39:30,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:39:30,676 [282] [DEBUG] [app] Ending request: urn:request:9c459e98-f30e-4d58-8b01-0cb81ba6b436 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:9c459e98-f30e-4d58-8b01-0cb81ba6b436', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:39:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 04:39:30,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:39:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:39:30,676 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:39:30,676 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:39:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:39:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 04:39:30,678 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:39:30,773 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:39:30,836 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:39:30,894 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:39:30,998 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
quotatotalworker stdout | 2024-04-22 04:39:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:39:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:39:46.054492+00:00 (in 14.999479 seconds)
quotatotalworker stdout | 2024-04-22 04:39:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:39:46 UTC)" (scheduled at 2024-04-22 04:39:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:39:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:39:31,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:39:31,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:39:46 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:39:32,028 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:39:32,068 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotaregistrysizeworker stdout | 2024-04-22 04:39:32,988 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:39:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:39:33,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:39:43.759375+00:00 (in 9.999431 seconds)
notificationworker stdout | 2024-04-22 04:39:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:39:43 UTC)" (scheduled at 2024-04-22 04:39:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:39:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:39:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 39, 33, 760259), True, datetime.datetime(2024, 4, 22, 4, 39, 33, 760259), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:39:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:39:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:39:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:39:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:39:34,692 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:39:35,255 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:39:35,259 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:39:35,261 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
securityworker stdout | 2024-04-22 04:39:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:39:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:39:56.873109+00:00 (in 21.000734 seconds)
securityworker stdout | 2024-04-22 04:39:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:40:05 UTC)" (scheduled at 2024-04-22 04:39:35.871852+00:00)
securityworker stdout | 2024-04-22 04:39:35,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:39:35,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:39:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:39:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:39:35,885 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:39:35,888 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:39:35,890 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:39:35,890 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:39:35,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 34, 35, 876555), 1, 2])
securityworker stdout | 2024-04-22 04:39:35,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:39:35,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:39:35,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 34, 35, 876555), 1, 2])
securityworker stdout | 2024-04-22 04:39:35,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:39:35,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:39:35,897 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:39:35,897 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:40:05 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:39:36,013 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:39:36,062 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:39:36,513 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
logrotateworker stdout | 2024-04-22 04:39:37,392 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:39:38,491 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:39:38,696 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:39:39,024 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
exportactionlogsworker stdout | 2024-04-22 04:39:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:39:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:39:41.564959+00:00 (in 1.997478 seconds)
exportactionlogsworker stdout | 2024-04-22 04:39:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:40:39 UTC)" (scheduled at 2024-04-22 04:39:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:39:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:39:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:40:39 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:39:39,594 [278] [DEBUG] [app] Starting request: urn:request:077e98a6-10f0-4c6c-8ac8-09bb6a70b5fb (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:39:39,595 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:39:39,595 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:39:39,595 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:39:39,605 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:39:39,605 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:39:39,605 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:39:39,605 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:39:39,605 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:39:39,605 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:39:39,606 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:39:39,606 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:39:39,608 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:39:39,614 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:39:39,615 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:39:39,619 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:39:39,623 [278] [DEBUG] [app] Ending request: urn:request:077e98a6-10f0-4c6c-8ac8-09bb6a70b5fb (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:077e98a6-10f0-4c6c-8ac8-09bb6a70b5fb', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:39:39,623 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:39:39 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.031 1555 0.031)
gunicorn-web stdout | 2024-04-22 04:39:39,624 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:39:39 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
blobuploadcleanupworker stdout | 2024-04-22 04:39:39,968 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
queuecleanupworker stdout | 2024-04-22 04:39:41,093 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
securityworker stdout | 2024-04-22 04:39:41,095 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
autopruneworker stdout | 2024-04-22 04:39:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:39:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:40:11.264267+00:00 (in 29.999463 seconds)
autopruneworker stdout | 2024-04-22 04:39:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:40:11 UTC)" (scheduled at 2024-04-22 04:39:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:39:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713760721271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:39:41,275 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:39:41,275 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:39:41,275 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:40:11 UTC)" executed successfully
manifestbackfillworker stdout | 2024-04-22 04:39:41,549 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
exportactionlogsworker stdout | 2024-04-22 04:39:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:39:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:40:39.566970+00:00 (in 58.001513 seconds)
exportactionlogsworker stdout | 2024-04-22 04:39:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:40:41 UTC)" (scheduled at 2024-04-22 04:39:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:39:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:39:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 39, 41, 565928), True, datetime.datetime(2024, 4, 22, 4, 39, 41, 565928), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:39:41,577 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:39:41,577 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:39:41,577 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:40:41 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:39:41,612 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
gunicorn-registry stdout | 2024-04-22 04:39:41,676 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:39:41,682 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:39:41,687 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:39:41,711 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:39:41,717 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:39:41,722 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:39:41,724 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:39:41,727 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:39:41,730 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
storagereplication stdout | 2024-04-22 04:39:43,011 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
namespacegcworker stdout | 2024-04-22 04:39:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:39:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:40:22.058978+00:00 (in 39.001368 seconds)
namespacegcworker stdout | 2024-04-22 04:39:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:40:43 UTC)" (scheduled at 2024-04-22 04:39:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:39:43,057 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:39:43,058 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 39, 43, 57970), True, datetime.datetime(2024, 4, 22, 4, 39, 43, 57970), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:39:43,068 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:39:43,068 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:39:43,068 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:40:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:39:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:39:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:39:53.759375+00:00 (in 9.999441 seconds)
notificationworker stdout | 2024-04-22 04:39:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:39:53 UTC)" (scheduled at 2024-04-22 04:39:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:39:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:39:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 39, 43, 760202), True, datetime.datetime(2024, 4, 22, 4, 39, 43, 760202), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:39:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:39:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:39:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:39:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:39:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:39:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:40:14.952062+00:00 (in 29.999510 seconds)
gcworker stdout | 2024-04-22 04:39:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:40:14 UTC)" (scheduled at 2024-04-22 04:39:44.952062+00:00)
gcworker stdout | 2024-04-22 04:39:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712551184953, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:39:44,965 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:39:44,966 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:39:44,966 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:40:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:39:45,652 [282] [DEBUG] [app] Starting request: urn:request:b9cf31a2-d0a5-4739-a1db-cd5e74cc543f (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:39:45,653 [279] [DEBUG] [app] Starting request: urn:request:f0e5d4ad-cff3-4f49-b77f-cd44956750d0 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:39:45,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:39:45,654 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:39:45,656 [292] [DEBUG] [app] Starting request: urn:request:b1d4020a-2751-41e7-8ae1-19753b4a90fb (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:39:45,656 [290] [DEBUG] [app] Starting request: urn:request:fd8542d3-d2e8-4abb-86f5-436f26ab8d9d (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:39:45,656 [292] [DEBUG] [app] Ending request: urn:request:b1d4020a-2751-41e7-8ae1-19753b4a90fb (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b1d4020a-2751-41e7-8ae1-19753b4a90fb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:39:45,656 [290] [DEBUG] [app] Ending request: urn:request:fd8542d3-d2e8-4abb-86f5-436f26ab8d9d (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:fd8542d3-d2e8-4abb-86f5-436f26ab8d9d', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:39:45,656 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:39:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:39:45,656 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:39:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:39:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:39:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:39:45,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:39:45,657 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:39:45,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:39:45,658 [279] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:39:45,659 [281] [DEBUG] [app] Starting request: urn:request:00a1a074-aed6-4ba7-97e8-4a663dacddfc (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:39:45,659 [278] [DEBUG] [app] Starting request: urn:request:7b24c590-2a31-4101-8e0c-e12b875c4630 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:39:45,659 [278] [DEBUG] [app] Ending request: urn:request:7b24c590-2a31-4101-8e0c-e12b875c4630 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:7b24c590-2a31-4101-8e0c-e12b875c4630', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:39:45,659 [281] [DEBUG] [app] Ending request: urn:request:00a1a074-aed6-4ba7-97e8-4a663dacddfc (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:00a1a074-aed6-4ba7-97e8-4a663dacddfc', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:39:45,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:39:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:39:45,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:39:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:39:45,660 [279] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:39:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:39:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 159 0.002)
gunicorn-web stdout | 2024-04-22 04:39:45,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:39:45,660 [279] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:39:45,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:39:45,666 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:39:45,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:39:45,673 [279] [DEBUG] [app] Ending request: urn:request:f0e5d4ad-cff3-4f49-b77f-cd44956750d0 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f0e5d4ad-cff3-4f49-b77f-cd44956750d0', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:39:45,673 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:39:45,674 [279] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:39:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:39:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:39:45,674 [282] [DEBUG] [app] Ending request: urn:request:b9cf31a2-d0a5-4739-a1db-cd5e74cc543f (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:b9cf31a2-d0a5-4739-a1db-cd5e74cc543f', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:39:45,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:39:45,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:39:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:39:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.023)
quotatotalworker stdout | 2024-04-22 04:39:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:39:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:40:01.054492+00:00 (in 14.999478 seconds)
quotatotalworker stdout | 2024-04-22 04:39:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:40:01 UTC)" (scheduled at 2024-04-22 04:39:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:39:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:39:46,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:39:46,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:40:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:39:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:39:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:40:17.052354+00:00 (in 29.999530 seconds)
buildlogsarchiver stdout | 2024-04-22 04:39:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:40:17 UTC)" (scheduled at 2024-04-22 04:39:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:39:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 39, 47, 53161), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:39:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:39:47,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:39:47,063 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:40:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:39:52,241 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:39:53,341 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:39:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:39:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:40:03.759375+00:00 (in 9.999423 seconds)
notificationworker stdout | 2024-04-22 04:39:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:40:03 UTC)" (scheduled at 2024-04-22 04:39:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:39:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:39:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 39, 53, 760273), True, datetime.datetime(2024, 4, 22, 4, 39, 53, 760273), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:39:53,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:39:53,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:39:53,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:40:03 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:39:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:39:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:40:05.871852+00:00 (in 8.998298 seconds)
securityworker stdout | 2024-04-22 04:39:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:40:26 UTC)" (scheduled at 2024-04-22 04:39:56.873109+00:00)
securityworker stdout | 2024-04-22 04:39:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:39:56,873 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:39:56,875 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:39:56,875 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:39:56,875 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:39:56,875 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:39:56,875 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:39:56,878 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:39:56,879 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:39:56,889 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:39:56,892 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:39:56,892 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:39:56,893 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 34, 56, 879168), 1, 2])
securityworker stdout | 2024-04-22 04:39:56,895 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:39:56,895 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:39:56,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 34, 56, 879168), 1, 2])
securityworker stdout | 2024-04-22 04:39:56,898 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:39:56,898 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:39:56,898 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:39:56,898 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:39:56,898 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:39:56,898 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:39:56,898 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:39:56,899 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:39:56,899 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:39:56,899 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:40:26 UTC)" executed successfully
builder stdout | 2024-04-22 04:39:56,970 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 04:39:58,793 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:40:00,130 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:40:00,222 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:40:00,653 [282] [DEBUG] [app] Starting request: urn:request:5173f156-c4f3-4a5e-987b-8c789235a16b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:40:00,653 [278] [DEBUG] [app] Starting request: urn:request:ada44a12-bcef-4d6d-95e1-c98f0da2cb55 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:40:00,655 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:40:00,655 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:40:00,657 [284] [DEBUG] [app] Starting request: urn:request:a1bdca65-ec85-4035-ac90-8422ce29ae72 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:40:00,657 [292] [DEBUG] [app] Starting request: urn:request:93673600-e82a-4670-9d3a-47aa6e8088a6 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:40:00,657 [284] [DEBUG] [app] Ending request: urn:request:a1bdca65-ec85-4035-ac90-8422ce29ae72 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:a1bdca65-ec85-4035-ac90-8422ce29ae72', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:40:00,657 [292] [DEBUG] [app] Ending request: urn:request:93673600-e82a-4670-9d3a-47aa6e8088a6 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:93673600-e82a-4670-9d3a-47aa6e8088a6', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:40:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:40:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:40:00,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:40:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:40:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:40:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-web stdout | 2024-04-22 04:40:00,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:40:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:40:00,659 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:40:00,659 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:40:00,660 [278] [DEBUG] [app] Starting request: urn:request:8ead62ca-b2a8-4a3f-9010-66abb7d1458c (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:40:00,660 [281] [DEBUG] [app] Starting request: urn:request:d9eafd54-d848-43df-bd79-637a25a12a36 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:40:00,660 [278] [DEBUG] [app] Ending request: urn:request:8ead62ca-b2a8-4a3f-9010-66abb7d1458c (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:8ead62ca-b2a8-4a3f-9010-66abb7d1458c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:40:00,660 [281] [DEBUG] [app] Ending request: urn:request:d9eafd54-d848-43df-bd79-637a25a12a36 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:d9eafd54-d848-43df-bd79-637a25a12a36', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:40:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:40:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:40:00,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:40:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:40:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.002)
gunicorn-web stdout | 2024-04-22 04:40:00,661 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:40:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:40:00,661 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:40:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:40:00,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:40:00,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:40:00,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:40:00,674 [278] [DEBUG] [app] Ending request: urn:request:ada44a12-bcef-4d6d-95e1-c98f0da2cb55 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:ada44a12-bcef-4d6d-95e1-c98f0da2cb55', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:40:00,675 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:40:00,675 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:40:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:40:00,675 [282] [DEBUG] [app] Ending request: urn:request:5173f156-c4f3-4a5e-987b-8c789235a16b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:5173f156-c4f3-4a5e-987b-8c789235a16b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:40:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:40:00,675 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:40:00,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:40:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:40:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:40:00,686 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:40:00,783 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:40:00,847 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:40:00,905 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:40:01,011 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
quotatotalworker stdout | 2024-04-22 04:40:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:40:01,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:40:16.054492+00:00 (in 14.999482 seconds)
quotatotalworker stdout | 2024-04-22 04:40:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:40:16 UTC)" (scheduled at 2024-04-22 04:40:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:40:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:40:01,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:40:01,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:40:16 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:40:02,064 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:40:02,097 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
securityscanningnotificationworker stdout | 2024-04-22 04:40:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:40:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:40:16.552337+00:00 (in 13.995630 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:40:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:41:02 UTC)" (scheduled at 2024-04-22 04:40:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:40:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:40:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:41:02 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:40:03,024 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:40:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:40:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:40:13.759375+00:00 (in 9.999399 seconds)
notificationworker stdout | 2024-04-22 04:40:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:40:13 UTC)" (scheduled at 2024-04-22 04:40:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:40:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:40:03,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 40, 3, 760284), True, datetime.datetime(2024, 4, 22, 4, 40, 3, 760284), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:40:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:40:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:40:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:40:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:40:04,729 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:40:05,264 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:40:05,267 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:40:05,270 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
securityworker stdout | 2024-04-22 04:40:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:40:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:40:26.873109+00:00 (in 21.000843 seconds)
securityworker stdout | 2024-04-22 04:40:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:40:35 UTC)" (scheduled at 2024-04-22 04:40:05.871852+00:00)
securityworker stdout | 2024-04-22 04:40:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:40:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:40:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:40:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:40:05,885 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:40:05,885 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:40:35 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:40:06,028 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:40:06,068 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:40:06,548 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
repositorygcworker stdout | 2024-04-22 04:40:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:40:06,552 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:40:13.555667+00:00 (in 7.002706 seconds)
repositorygcworker stdout | 2024-04-22 04:40:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:41:06 UTC)" (scheduled at 2024-04-22 04:40:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:40:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:40:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 40, 6, 553295), True, datetime.datetime(2024, 4, 22, 4, 40, 6, 553295), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:40:06,564 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:40:06,564 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:40:06,564 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:41:06 UTC)" executed successfully
logrotateworker stdout | 2024-04-22 04:40:07,409 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:40:08,508 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:40:08,729 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:40:09,056 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:40:10,005 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
gunicorn-web stdout | 2024-04-22 04:40:10,732 [278] [DEBUG] [app] Starting request: urn:request:b11f465b-098c-4a2d-84af-0f6806ea88ba (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:40:10,732 [278] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:40:10,732 [278] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:40:10,733 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:40:10,742 [278] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:40:10,742 [278] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:40:10,742 [278] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:40:10,743 [278] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:40:10,743 [278] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:40:10,743 [278] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:40:10,743 [278] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:40:10,743 [278] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:40:10,745 [278] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:40:10,751 [278] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:40:10,752 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:40:10,756 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:40:10,760 [278] [DEBUG] [app] Ending request: urn:request:b11f465b-098c-4a2d-84af-0f6806ea88ba (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:b11f465b-098c-4a2d-84af-0f6806ea88ba', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:40:10,761 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:40:10,761 [278] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:40:10 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:40:10 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1536 0.030)
securityworker stdout | 2024-04-22 04:40:11,113 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:40:11,121 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
autopruneworker stdout | 2024-04-22 04:40:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:40:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:40:41.264267+00:00 (in 29.999434 seconds)
autopruneworker stdout | 2024-04-22 04:40:11,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:40:41 UTC)" (scheduled at 2024-04-22 04:40:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:40:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713760751271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:40:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:40:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:40:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:40:41 UTC)" executed successfully
manifestbackfillworker stdout | 2024-04-22 04:40:11,585 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:40:11,622 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
gunicorn-registry stdout | 2024-04-22 04:40:11,685 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:40:11,690 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:40:11,694 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:40:11,721 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:40:11,725 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:40:11,732 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:40:11,736 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:40:11,739 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:40:11,742 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
storagereplication stdout | 2024-04-22 04:40:13,024 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:40:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:40:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:41:06.552482+00:00 (in 52.996355 seconds)
repositorygcworker stdout | 2024-04-22 04:40:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:41:13 UTC)" (scheduled at 2024-04-22 04:40:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:40:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:40:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:41:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:40:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:40:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:40:19.762424+00:00 (in 6.002528 seconds)
notificationworker stdout | 2024-04-22 04:40:13,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:40:23 UTC)" (scheduled at 2024-04-22 04:40:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:40:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:40:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 40, 13, 760152), True, datetime.datetime(2024, 4, 22, 4, 40, 13, 760152), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:40:13,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:40:13,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:40:13,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:40:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:40:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:40:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:40:44.952062+00:00 (in 29.999526 seconds)
gcworker stdout | 2024-04-22 04:40:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:40:44 UTC)" (scheduled at 2024-04-22 04:40:14.952062+00:00)
gcworker stdout | 2024-04-22 04:40:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712551214952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:40:14,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:40:14,964 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:40:14,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:40:44 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:40:15,493 [282] [DEBUG] [app] Starting request: urn:request:0ed7692c-a62f-4e0d-9443-941bd11827c5 (/api/v1/user/notifications) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:40:15,494 [282] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:40:15,494 [282] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:40:15,494 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:40:15,504 [282] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:40:15,504 [282] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:40:15,504 [282] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:40:15,504 [282] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:40:15,504 [282] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:40:15,504 [282] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:40:15,504 [282] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:40:15,504 [282] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:40:15,506 [282] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."dismissed" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."dismissed" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', [False, 1, False, 1, 'admin', 6])
gunicorn-web stdout | 2024-04-22 04:40:15,511 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:40:15,513 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:40:15,515 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:40:15,517 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:40:15,520 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:40:15,522 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:40:15,524 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:40:15,527 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [12, 1, 0])
gunicorn-web stdout | 2024-04-22 04:40:15,529 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0])
gunicorn-web stdout | 2024-04-22 04:40:15,531 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "notificationkind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [10, 1, 0])
gunicorn-web stdout | 2024-04-22 04:40:15,534 [282] [DEBUG] [app] Ending request: urn:request:0ed7692c-a62f-4e0d-9443-941bd11827c5 (/api/v1/user/notifications) {'endpoint': 'api.usernotificationlist', 'request_id': 'urn:request:0ed7692c-a62f-4e0d-9443-941bd11827c5', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/notifications', 'path': '/api/v1/user/notifications', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:40:15,534 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:40:15,535 [282] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:40:15 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 3386 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:40:15 +0000] "GET /api/v1/user/notifications HTTP/1.1" 200 3386 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.043 1530 0.043)
gunicorn-web stdout | 2024-04-22 04:40:15,653 [282] [DEBUG] [app] Starting request: urn:request:2ab69b16-bf8e-43db-aadb-99cf491f22c1 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:40:15,653 [278] [DEBUG] [app] Starting request: urn:request:9e3a4d89-d9df-4922-bc79-f89032a3746e (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:40:15,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:40:15,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:40:15,656 [290] [DEBUG] [app] Starting request: urn:request:f3c8f057-ca30-45b6-a101-2bc5190b1458 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:40:15,656 [290] [DEBUG] [app] Ending request: urn:request:f3c8f057-ca30-45b6-a101-2bc5190b1458 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:f3c8f057-ca30-45b6-a101-2bc5190b1458', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:40:15,656 [284] [DEBUG] [app] Starting request: urn:request:46b5d67d-bdea-4d08-a7f8-ace1b247da83 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:40:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 162 0.001)
gunicorn-registry stdout | 2024-04-22 04:40:15,657 [290] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:40:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:40:15,657 [284] [DEBUG] [app] Ending request: urn:request:46b5d67d-bdea-4d08-a7f8-ace1b247da83 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:46b5d67d-bdea-4d08-a7f8-ace1b247da83', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:40:15,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:40:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:40:15,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:40:15 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:40:15,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:40:15,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:40:15,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:40:15,659 [282] [DEBUG] [app] Starting request: urn:request:b536cba9-b135-4399-a4e6-488f9070b948 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:40:15,659 [282] [DEBUG] [app] Ending request: urn:request:b536cba9-b135-4399-a4e6-488f9070b948 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b536cba9-b135-4399-a4e6-488f9070b948', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:40:15,659 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:40:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:40:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.000)
gunicorn-web stdout | 2024-04-22 04:40:15,660 [281] [DEBUG] [app] Starting request: urn:request:b68d0e98-c0be-4bc0-976b-30ab22049535 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:40:15,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:40:15,660 [281] [DEBUG] [app] Ending request: urn:request:b68d0e98-c0be-4bc0-976b-30ab22049535 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:b68d0e98-c0be-4bc0-976b-30ab22049535', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:40:15,660 [282] [INFO] [data.database] Connection pooling disabled for postgresql
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:40:15 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:40:15,660 [281] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:40:15 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:40:15,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:40:15,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:40:15,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:40:15,666 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:40:15,674 [278] [DEBUG] [app] Ending request: urn:request:9e3a4d89-d9df-4922-bc79-f89032a3746e (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:9e3a4d89-d9df-4922-bc79-f89032a3746e', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:40:15,674 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:40:15,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:40:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:40:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:40:15,685 [282] [DEBUG] [app] Ending request: urn:request:2ab69b16-bf8e-43db-aadb-99cf491f22c1 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2ab69b16-bf8e-43db-aadb-99cf491f22c1', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:40:15,685 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:40:15,686 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:40:15 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:40:15 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.034 118 0.034)
quotatotalworker stdout | 2024-04-22 04:40:16,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:40:16,054 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:40:31.054492+00:00 (in 14.999535 seconds)
quotatotalworker stdout | 2024-04-22 04:40:16,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:40:31 UTC)" (scheduled at 2024-04-22 04:40:16.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:40:16,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:40:16,066 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:40:16,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:40:31 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:40:16,216 [281] [DEBUG] [app] Starting request: urn:request:6b2eccc2-5317-4ab7-8cdd-dfc11ae51811 (/api/v1/user/apptoken) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:40:16,216 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:40:16,217 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:40:16,217 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:40:16,226 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:40:16,227 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:40:16,227 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:40:16,227 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.UserAdminPermission'> for user whuquay
gunicorn-web stdout | 2024-04-22 04:40:16,227 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:40:16,227 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:40:16,227 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:40:16,227 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:40:16,228 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."uuid", "t1"."title", "t1"."token_name", "t1"."token_secret", "t1"."created", "t1"."expiration", "t1"."last_accessed" FROM "appspecificauthtoken" AS "t1" WHERE ((("t1"."user_id" = %s) AND ("t1"."expiration" <= %s)) AND ("t1"."expiration" > %s))', [1, datetime.datetime(2024, 4, 24, 23, 52, 16, 227858), datetime.datetime(2024, 4, 22, 4, 40, 16, 227938)])
gunicorn-web stdout | 2024-04-22 04:40:16,230 [281] [DEBUG] [app] Ending request: urn:request:6b2eccc2-5317-4ab7-8cdd-dfc11ae51811 (/api/v1/user/apptoken) {'endpoint': 'api.apptokens', 'request_id': 'urn:request:6b2eccc2-5317-4ab7-8cdd-dfc11ae51811', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/user/apptoken?expiring=true', 'path': '/api/v1/user/apptoken', 'parameters': {'expiring': 'true'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:40:16,231 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:40:16,231 [281] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:40:16 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:40:16 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.1" 200 38 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.016 1520 0.016)
securityscanningnotificationworker stdout | 2024-04-22 04:40:16,552 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:40:16,552 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:41:02.556208+00:00 (in 46.003336 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:40:16,553 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:41:16 UTC)" (scheduled at 2024-04-22 04:40:16.552337+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:40:16,553 [91] [DEBUG] [workers.queueworker] Getting work item from queue.
securityscanningnotificationworker stdout | 2024-04-22 04:40:16,554 [91] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 40, 16, 553258), True, datetime.datetime(2024, 4, 22, 4, 40, 16, 553258), 0, 'secscanv4/%', 50, 1, 0])
securityscanningnotificationworker stdout | 2024-04-22 04:40:16,567 [91] [DEBUG] [workers.queueworker] No more work.
securityscanningnotificationworker stdout | 2024-04-22 04:40:16,567 [91] [DEBUG] [data.database] Disconnecting from database.
securityscanningnotificationworker stdout | 2024-04-22 04:40:16,567 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:41:16 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:40:17,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:40:17,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:40:47.052354+00:00 (in 29.999505 seconds)
buildlogsarchiver stdout | 2024-04-22 04:40:17,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:40:47 UTC)" (scheduled at 2024-04-22 04:40:17.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:40:17,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 40, 17, 53200), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:40:17,064 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:40:17,064 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:40:17,064 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:40:47 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:40:19,762 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:40:19,763 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:40:23.759375+00:00 (in 3.996382 seconds)
notificationworker stdout | 2024-04-22 04:40:19,763 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:41:19 UTC)" (scheduled at 2024-04-22 04:40:19.762424+00:00)
notificationworker stdout | 2024-04-22 04:40:19,763 [78] [DEBUG] [workers.queueworker] Running watchdog.
notificationworker stdout | 2024-04-22 04:40:19,763 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:41:19 UTC)" executed successfully
namespacegcworker stdout | 2024-04-22 04:40:22,059 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:40:22,059 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:40:43.057186+00:00 (in 20.997725 seconds)
namespacegcworker stdout | 2024-04-22 04:40:22,059 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:41:22 UTC)" (scheduled at 2024-04-22 04:40:22.058978+00:00)
namespacegcworker stdout | 2024-04-22 04:40:22,059 [76] [DEBUG] [workers.queueworker] Running watchdog.
namespacegcworker stdout | 2024-04-22 04:40:22,059 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:41:22 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:40:22,257 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:40:23,363 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:40:23,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:40:23,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:40:33.759375+00:00 (in 9.999493 seconds)
notificationworker stdout | 2024-04-22 04:40:23,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:40:33 UTC)" (scheduled at 2024-04-22 04:40:23.759375+00:00)
notificationworker stdout | 2024-04-22 04:40:23,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:40:23,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 40, 23, 760165), True, datetime.datetime(2024, 4, 22, 4, 40, 23, 760165), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:40:23,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:40:23,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:40:23,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:40:33 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:40:24,361 [81] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotaregistrysizeworker stdout | 2024-04-22 04:40:24,362 [81] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:41:24.361582+00:00 (in 59.999530 seconds)
quotaregistrysizeworker stdout | 2024-04-22 04:40:24,362 [81] [INFO] [apscheduler.executors.default] Running job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:41:24 UTC)" (scheduled at 2024-04-22 04:40:24.361582+00:00)
quotaregistrysizeworker stdout | 2024-04-22 04:40:24,362 [81] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."size_bytes", "t1"."running", "t1"."queued", "t1"."completed_ms" FROM "quotaregistrysize" AS "t1" LIMIT %s OFFSET %s', [1, 0])
quotaregistrysizeworker stdout | 2024-04-22 04:40:24,372 [81] [DEBUG] [data.database] Disconnecting from database.
quotaregistrysizeworker stdout | 2024-04-22 04:40:24,372 [81] [INFO] [apscheduler.executors.default] Job "QuotaRegistrySizeWorker._calculate_registry_size (trigger: interval[0:01:00], next run at: 2024-04-22 04:41:24 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:40:26,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:40:26,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:40:35.871852+00:00 (in 8.998262 seconds)
securityworker stdout | 2024-04-22 04:40:26,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:40:56 UTC)" (scheduled at 2024-04-22 04:40:26.873109+00:00)
securityworker stdout | 2024-04-22 04:40:26,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:40:26,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:40:26,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:40:26,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:40:26,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:40:26,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:40:26,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:40:26,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:40:26,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:40:26,890 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:40:26,893 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:40:26,893 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:40:26,894 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 35, 26, 881291), 1, 2])
securityworker stdout | 2024-04-22 04:40:26,896 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:40:26,896 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:40:26,897 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 35, 26, 881291), 1, 2])
securityworker stdout | 2024-04-22 04:40:26,899 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:40:26,899 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:40:26,899 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:40:26,899 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:40:26,899 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:40:26,899 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:40:26,899 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:40:26,900 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:40:26,900 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:40:26,900 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:40:56 UTC)" executed successfully
builder stdout | 2024-04-22 04:40:27,006 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 04:40:28,828 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:40:30,142 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:40:30,256 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:40:30,653 [282] [DEBUG] [app] Starting request: urn:request:4eab1462-fb7a-42a7-b86f-c0fe592f5d62 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:40:30,653 [278] [DEBUG] [app] Starting request: urn:request:2ac326a9-8b2a-4b42-a2b5-0764777268cd (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:40:30,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:40:30,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:40:30,656 [291] [DEBUG] [app] Starting request: urn:request:4b4623b1-a87b-4e4b-b428-fd8e97add3fa (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:40:30,656 [292] [DEBUG] [app] Starting request: urn:request:a005221f-e2f1-4d53-a8e2-1f52bbe1e744 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:40:30,656 [291] [DEBUG] [app] Ending request: urn:request:4b4623b1-a87b-4e4b-b428-fd8e97add3fa (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:4b4623b1-a87b-4e4b-b428-fd8e97add3fa', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:40:30,657 [292] [DEBUG] [app] Ending request: urn:request:a005221f-e2f1-4d53-a8e2-1f52bbe1e744 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:a005221f-e2f1-4d53-a8e2-1f52bbe1e744', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:40:30,657 [291] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:40:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:40:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:40:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:40:30,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:40:30 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:40:30,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:40:30,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:40:30,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:40:30,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:40:30,659 [278] [DEBUG] [app] Starting request: urn:request:531b04a3-858d-409b-a184-06a9ab3af58c (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:40:30,659 [278] [DEBUG] [app] Ending request: urn:request:531b04a3-858d-409b-a184-06a9ab3af58c (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:531b04a3-858d-409b-a184-06a9ab3af58c', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:40:30,660 [279] [DEBUG] [app] Starting request: urn:request:54162f1c-af9b-434e-adc6-2c7437499879 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:40:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:40:30,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:40:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:40:30,660 [279] [DEBUG] [app] Ending request: urn:request:54162f1c-af9b-434e-adc6-2c7437499879 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:54162f1c-af9b-434e-adc6-2c7437499879', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:40:30,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:40:30 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:40:30,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:40:30 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:40:30,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:40:30,660 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:40:30,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:40:30,666 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:40:30,667 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:40:30,674 [282] [DEBUG] [app] Ending request: urn:request:4eab1462-fb7a-42a7-b86f-c0fe592f5d62 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:4eab1462-fb7a-42a7-b86f-c0fe592f5d62', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:40:30,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:40:30,674 [278] [DEBUG] [app] Ending request: urn:request:2ac326a9-8b2a-4b42-a2b5-0764777268cd (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:2ac326a9-8b2a-4b42-a2b5-0764777268cd', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:40:30,674 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:40:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:40:30,674 [278] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:40:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:40:30,674 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:40:30 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:40:30 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
gunicorn-web stdout | 2024-04-22 04:40:30,695 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:40:30,793 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:40:30,858 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:40:30,917 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:40:31,023 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
quotatotalworker stdout | 2024-04-22 04:40:31,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:40:31,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:40:46.054492+00:00 (in 14.999494 seconds)
quotatotalworker stdout | 2024-04-22 04:40:31,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:40:46 UTC)" (scheduled at 2024-04-22 04:40:31.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:40:31,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:40:31,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:40:31,066 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:40:46 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:40:32,087 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:40:32,113 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
quotaregistrysizeworker stdout | 2024-04-22 04:40:33,049 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:40:33,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:40:33,760 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:40:43.759375+00:00 (in 9.999351 seconds)
notificationworker stdout | 2024-04-22 04:40:33,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:40:43 UTC)" (scheduled at 2024-04-22 04:40:33.759375+00:00)
notificationworker stdout | 2024-04-22 04:40:33,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:40:33,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 40, 33, 760346), True, datetime.datetime(2024, 4, 22, 4, 40, 33, 760346), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:40:33,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:40:33,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:40:33,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:40:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:40:34,765 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:40:35,274 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:40:35,277 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:40:35,280 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
securityworker stdout | 2024-04-22 04:40:35,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:40:35,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:40:56.873109+00:00 (in 21.000740 seconds)
securityworker stdout | 2024-04-22 04:40:35,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:41:05 UTC)" (scheduled at 2024-04-22 04:40:35.871852+00:00)
securityworker stdout | 2024-04-22 04:40:35,873 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:40:35,873 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:40:35,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:40:35,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:40:35,886 [92] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:40:35,888 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:40:35,891 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:40:35,891 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:40:35,892 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 35, 35, 876600), 1, 2])
securityworker stdout | 2024-04-22 04:40:35,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:40:35,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:40:35,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 35, 35, 876600), 1, 2])
securityworker stdout | 2024-04-22 04:40:35,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:40:35,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:40:35,897 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:40:35,897 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:41:05 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:40:36,038 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:40:36,104 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
exportactionlogsworker stdout | 2024-04-22 04:40:36,585 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
logrotateworker stdout | 2024-04-22 04:40:37,446 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:40:38,515 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:40:38,765 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:40:39,089 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
exportactionlogsworker stdout | 2024-04-22 04:40:39,567 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:40:39,567 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:40:41.564959+00:00 (in 1.997507 seconds)
exportactionlogsworker stdout | 2024-04-22 04:40:39,567 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:41:39 UTC)" (scheduled at 2024-04-22 04:40:39.566970+00:00)
exportactionlogsworker stdout | 2024-04-22 04:40:39,567 [67] [DEBUG] [workers.queueworker] Running watchdog.
exportactionlogsworker stdout | 2024-04-22 04:40:39,567 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:41:39 UTC)" executed successfully
blobuploadcleanupworker stdout | 2024-04-22 04:40:40,023 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
gunicorn-web stdout | 2024-04-22 04:40:41,122 [279] [DEBUG] [app] Starting request: urn:request:e1c61103-2b10-4dd7-b6ef-ee921dc3f7a4 (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.131.0.9'}
gunicorn-web stdout | 2024-04-22 04:40:41,122 [279] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:40:41,122 [279] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:40:41,123 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:40:41,133 [279] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:40:41,133 [279] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:40:41,133 [279] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:40:41,133 [279] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:40:41,133 [279] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:40:41,133 [279] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:40:41,133 [279] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:40:41,133 [279] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:40:41,135 [279] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
securityworker stdout | 2024-04-22 04:40:41,137 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
gunicorn-web stdout | 2024-04-22 04:40:41,141 [279] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:40:41,142 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:40:41,147 [279] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:40:41,151 [279] [DEBUG] [app] Ending request: urn:request:e1c61103-2b10-4dd7-b6ef-ee921dc3f7a4 (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:e1c61103-2b10-4dd7-b6ef-ee921dc3f7a4', 'remote_addr': '10.131.0.9', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:40:41,151 [279] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:40:41,151 [279] [INFO] [gunicorn.access] 10.131.0.9 - - [22/Apr/2024:04:40:41 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
nginx stdout | 10.131.0.9 (-) - - [22/Apr/2024:04:40:41 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1536 0.030)
queuecleanupworker stdout | 2024-04-22 04:40:41,157 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
autopruneworker stdout | 2024-04-22 04:40:41,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:40:41,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:41:11.264267+00:00 (in 29.999445 seconds)
autopruneworker stdout | 2024-04-22 04:40:41,264 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:41:11 UTC)" (scheduled at 2024-04-22 04:40:41.264267+00:00)
autopruneworker stdout | 2024-04-22 04:40:41,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713760781272, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:40:41,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:40:41,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:40:41,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:41:11 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:40:41,565 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
exportactionlogsworker stdout | 2024-04-22 04:40:41,565 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:41:39.566970+00:00 (in 58.001568 seconds)
exportactionlogsworker stdout | 2024-04-22 04:40:41,565 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:41:41 UTC)" (scheduled at 2024-04-22 04:40:41.564959+00:00)
exportactionlogsworker stdout | 2024-04-22 04:40:41,565 [67] [DEBUG] [workers.queueworker] Getting work item from queue.
exportactionlogsworker stdout | 2024-04-22 04:40:41,566 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 40, 41, 565803), True, datetime.datetime(2024, 4, 22, 4, 40, 41, 565803), 0, 'exportactionlogs/%', 50, 1, 0])
exportactionlogsworker stdout | 2024-04-22 04:40:41,576 [67] [DEBUG] [workers.queueworker] No more work.
exportactionlogsworker stdout | 2024-04-22 04:40:41,576 [67] [DEBUG] [data.database] Disconnecting from database.
exportactionlogsworker stdout | 2024-04-22 04:40:41,576 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:41:41 UTC)" executed successfully
manifestbackfillworker stdout | 2024-04-22 04:40:41,617 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:40:41,649 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
gunicorn-registry stdout | 2024-04-22 04:40:41,696 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:40:41,700 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:40:41,704 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:40:41,731 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:40:41,738 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:40:41,742 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:40:41,746 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:40:41,749 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:40:41,752 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
storagereplication stdout | 2024-04-22 04:40:43,035 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
namespacegcworker stdout | 2024-04-22 04:40:43,057 [76] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
namespacegcworker stdout | 2024-04-22 04:40:43,057 [76] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:41:22.058978+00:00 (in 39.001286 seconds)
namespacegcworker stdout | 2024-04-22 04:40:43,057 [76] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:41:43 UTC)" (scheduled at 2024-04-22 04:40:43.057186+00:00)
namespacegcworker stdout | 2024-04-22 04:40:43,058 [76] [DEBUG] [workers.queueworker] Getting work item from queue.
namespacegcworker stdout | 2024-04-22 04:40:43,059 [76] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 40, 43, 58181), True, datetime.datetime(2024, 4, 22, 4, 40, 43, 58181), 0, 'namespacegc/%', 50, 1, 0])
namespacegcworker stdout | 2024-04-22 04:40:43,069 [76] [DEBUG] [workers.queueworker] No more work.
namespacegcworker stdout | 2024-04-22 04:40:43,069 [76] [DEBUG] [data.database] Disconnecting from database.
namespacegcworker stdout | 2024-04-22 04:40:43,069 [76] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:41:43 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:40:43,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:40:43,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:40:53.759375+00:00 (in 9.999497 seconds)
notificationworker stdout | 2024-04-22 04:40:43,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:40:53 UTC)" (scheduled at 2024-04-22 04:40:43.759375+00:00)
notificationworker stdout | 2024-04-22 04:40:43,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:40:43,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 40, 43, 760133), True, datetime.datetime(2024, 4, 22, 4, 40, 43, 760133), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:40:43,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:40:43,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:40:43,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:40:53 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:40:44,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:40:44,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:41:14.952062+00:00 (in 29.999558 seconds)
gcworker stdout | 2024-04-22 04:40:44,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:41:14 UTC)" (scheduled at 2024-04-22 04:40:44.952062+00:00)
gcworker stdout | 2024-04-22 04:40:44,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712551244952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:40:44,964 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:40:44,965 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:40:44,965 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:41:14 UTC)" executed successfully
gunicorn-web stdout | 2024-04-22 04:40:45,653 [278] [DEBUG] [app] Starting request: urn:request:a2c5bf21-2896-4355-b63a-e7d9b24b189b (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:40:45,653 [281] [DEBUG] [app] Starting request: urn:request:93e0fd30-3585-4bdc-a450-30f2582a2b18 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:40:45,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:40:45,654 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:40:45,656 [284] [DEBUG] [app] Starting request: urn:request:9c6ee08e-6849-479f-9d7a-0f93547bc7cb (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:40:45,656 [288] [DEBUG] [app] Starting request: urn:request:b496fc31-7b58-4c05-8c5f-99587f2ad01b (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:40:45,656 [288] [DEBUG] [app] Ending request: urn:request:b496fc31-7b58-4c05-8c5f-99587f2ad01b (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:b496fc31-7b58-4c05-8c5f-99587f2ad01b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:40:45,656 [284] [DEBUG] [app] Ending request: urn:request:9c6ee08e-6849-479f-9d7a-0f93547bc7cb (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:9c6ee08e-6849-479f-9d7a-0f93547bc7cb', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:40:45,657 [288] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:40:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:40:45,657 [284] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:40:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:40:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:40:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-web stdout | 2024-04-22 04:40:45,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:40:45,657 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:40:45,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:40:45,658 [278] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:40:45,659 [279] [DEBUG] [app] Starting request: urn:request:936b3899-4e2f-45d5-9901-298ddcd01b2a (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:40:45,659 [282] [DEBUG] [app] Starting request: urn:request:af35b253-7965-41d1-862a-7dad9fc14352 (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:40:45,660 [282] [DEBUG] [app] Ending request: urn:request:af35b253-7965-41d1-862a-7dad9fc14352 (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:af35b253-7965-41d1-862a-7dad9fc14352', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:40:45,660 [279] [DEBUG] [app] Ending request: urn:request:936b3899-4e2f-45d5-9901-298ddcd01b2a (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:936b3899-4e2f-45d5-9901-298ddcd01b2a', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:40:45,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:40:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:40:45,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:40:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:40:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:40:45,660 [279] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:40:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:40:45,660 [278] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:40:45,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:40:45,661 [278] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:40:45,668 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:40:45,668 [278] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:40:45,675 [281] [DEBUG] [app] Ending request: urn:request:93e0fd30-3585-4bdc-a450-30f2582a2b18 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:93e0fd30-3585-4bdc-a450-30f2582a2b18', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:40:45,675 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:40:45,676 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:40:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:40:45,676 [278] [DEBUG] [app] Ending request: urn:request:a2c5bf21-2896-4355-b63a-e7d9b24b189b (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:a2c5bf21-2896-4355-b63a-e7d9b24b189b', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:40:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
gunicorn-web stdout | 2024-04-22 04:40:45,676 [278] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:40:45,676 [278] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:40:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:40:45 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.024 118 0.024)
quotatotalworker stdout | 2024-04-22 04:40:46,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:40:46,055 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:41:01.054492+00:00 (in 14.999475 seconds)
quotatotalworker stdout | 2024-04-22 04:40:46,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:41:01 UTC)" (scheduled at 2024-04-22 04:40:46.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:40:46,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:40:46,064 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:40:46,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:41:01 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:40:47,052 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
buildlogsarchiver stdout | 2024-04-22 04:40:47,052 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:41:17.052354+00:00 (in 29.999491 seconds)
buildlogsarchiver stdout | 2024-04-22 04:40:47,053 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:41:17 UTC)" (scheduled at 2024-04-22 04:40:47.052354+00:00)
buildlogsarchiver stdout | 2024-04-22 04:40:47,053 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2024, 4, 7, 4, 40, 47, 53228), False, 50, 1, 0])
buildlogsarchiver stdout | 2024-04-22 04:40:47,063 [63] [DEBUG] [__main__] No more builds to archive
buildlogsarchiver stdout | 2024-04-22 04:40:47,063 [63] [DEBUG] [data.database] Disconnecting from database.
buildlogsarchiver stdout | 2024-04-22 04:40:47,063 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2024-04-22 04:41:17 UTC)" executed successfully
expiredappspecifictokenworker stdout | 2024-04-22 04:40:52,274 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'}
securityscanningnotificationworker stdout | 2024-04-22 04:40:53,383 [91] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityscanningnotificationworker.py', 'pid': '91'}
notificationworker stdout | 2024-04-22 04:40:53,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:40:53,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:41:03.759375+00:00 (in 9.999440 seconds)
notificationworker stdout | 2024-04-22 04:40:53,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:41:03 UTC)" (scheduled at 2024-04-22 04:40:53.759375+00:00)
notificationworker stdout | 2024-04-22 04:40:53,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:40:53,761 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 40, 53, 760400), True, datetime.datetime(2024, 4, 22, 4, 40, 53, 760400), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:40:53,770 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:40:53,770 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:40:53,770 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:41:03 UTC)" executed successfully
securityworker stdout | 2024-04-22 04:40:56,873 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:40:56,873 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:41:05.871852+00:00 (in 8.998278 seconds)
securityworker stdout | 2024-04-22 04:40:56,873 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:41:26 UTC)" (scheduled at 2024-04-22 04:40:56.873109+00:00)
securityworker stdout | 2024-04-22 04:40:56,873 [92] [DEBUG] [util.locking] Acquiring global lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:40:56,874 [92] [DEBUG] [redis_lock.acquire] Getting 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST' ...
securityworker stdout | 2024-04-22 04:40:56,877 [92] [INFO] [redis_lock.acquire] Got lock for 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:40:56,877 [92] [DEBUG] [redis_lock.refresh.start] Starting thread to refresh lock every 200.0 seconds
securityworker stdout | 2024-04-22 04:40:56,877 [92] [DEBUG] [util.locking] Acquired lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:40:56,877 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:40:56,877 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:40:56,880 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:40:56,881 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:40:56,891 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" LEFT OUTER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE ((("t2"."id" IS %s) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [None, 1, 2])
securityworker stdout | 2024-04-22 04:40:56,894 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:40:56,894 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:40:56,895 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((("t2"."index_status" = %s) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-1, datetime.datetime(2024, 4, 22, 4, 35, 56, 881595), 1, 2])
securityworker stdout | 2024-04-22 04:40:56,897 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:40:56,897 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:40:56,898 [92] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."manifest_id", "t2"."repository_id", "t2"."index_status", "t2"."error_json", "t2"."last_indexed", "t2"."indexer_hash", "t2"."indexer_version", "t2"."metadata_json" FROM "manifest" AS "t1" INNER JOIN "manifestsecuritystatus" AS "t2" ON ("t2"."manifest_id" = "t1"."id") WHERE (((((("t2"."index_status" != %s) AND ("t2"."index_status" != %s)) AND ("t2"."indexer_hash" != %s)) AND ("t2"."last_indexed" < %s)) AND ("t1"."id" >= %s)) AND ("t1"."id" < %s)) ORDER BY "t1"."id"', [-2, -3, '746c21e6e713e5208118f7d54c52e391', datetime.datetime(2024, 4, 22, 4, 35, 56, 881595), 1, 2])
securityworker stdout | 2024-04-22 04:40:56,900 [92] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-2
securityworker stdout | 2024-04-22 04:40:56,900 [92] [INFO] [util.migrate.allocator] No more work
securityworker stdout | 2024-04-22 04:40:56,900 [92] [DEBUG] [util.locking] Releasing lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:40:56,900 [92] [DEBUG] [redis_lock.refresh.shutdown] Signalling the lock refresher to stop
securityworker stdout | 2024-04-22 04:40:56,900 [92] [DEBUG] [redis_lock.refresh.thread.exit] Exit requested, stopping lock refreshing
securityworker stdout | 2024-04-22 04:40:56,901 [92] [DEBUG] [redis_lock.refresh.exit] Lock refresher has stopped
securityworker stdout | 2024-04-22 04:40:56,901 [92] [DEBUG] [redis_lock.release] Releasing 'lock:SECURITYWORKER_INDEX_RECENT_MANIFEST'.
securityworker stdout | 2024-04-22 04:40:56,901 [92] [DEBUG] [util.locking] Released lock SECURITYWORKER_INDEX_RECENT_MANIFEST
securityworker stdout | 2024-04-22 04:40:56,901 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:40:56,902 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_recent_manifests_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:41:26 UTC)" executed successfully
builder stdout | 2024-04-22 04:40:57,020 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'builder.py', 'pid': '62'}
repositoryactioncounter stdout | 2024-04-22 04:40:58,860 [89] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositoryactioncounter.py', 'pid': '89'}
repositorygcworker stdout | 2024-04-22 04:41:00,179 [90] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'repositorygcworker.py', 'pid': '90'}
quotatotalworker stdout | 2024-04-22 04:41:00,293 [83] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotatotalworker.py', 'pid': '83'}
gunicorn-web stdout | 2024-04-22 04:41:00,652 [282] [DEBUG] [app] Starting request: urn:request:f7b8dd83-b62e-4b36-9274-de4b7686e1d0 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:41:00,652 [281] [DEBUG] [app] Starting request: urn:request:716f068d-2097-4b9d-9cf6-d2cec450cef7 (/health/instance) {'X-Forwarded-For': '10.131.0.2'}
gunicorn-web stdout | 2024-04-22 04:41:00,654 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:41:00,654 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-registry stdout | 2024-04-22 04:41:00,656 [286] [DEBUG] [app] Starting request: urn:request:d501bc27-dc07-46de-9ffc-45021bccc214 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:41:00,656 [292] [DEBUG] [app] Starting request: urn:request:5c7c2629-2280-4282-b327-b3810aed14f3 (/v1/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-registry stdout | 2024-04-22 04:41:00,656 [292] [DEBUG] [app] Ending request: urn:request:5c7c2629-2280-4282-b327-b3810aed14f3 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:5c7c2629-2280-4282-b327-b3810aed14f3', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
gunicorn-registry stdout | 2024-04-22 04:41:00,656 [286] [DEBUG] [app] Ending request: urn:request:d501bc27-dc07-46de-9ffc-45021bccc214 (/v1/_internal_ping) {'endpoint': 'v1.internal_ping', 'request_id': 'urn:request:d501bc27-dc07-46de-9ffc-45021bccc214', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/v1/_internal_ping', 'path': '/v1/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '47c10664', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:41:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:41:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.002 162 0.002)
gunicorn-registry stdout | 2024-04-22 04:41:00,657 [286] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:41:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-registry stdout | 2024-04-22 04:41:00,657 [292] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:41:00 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:41:00,657 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:41:00,657 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /v1/_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:41:00,658 [281] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:41:00,658 [282] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost
gunicorn-web stdout | 2024-04-22 04:41:00,659 [282] [DEBUG] [app] Starting request: urn:request:f9aa9984-62b5-446a-a898-bf9ee9448a9b (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:41:00,659 [282] [DEBUG] [app] Ending request: urn:request:f9aa9984-62b5-446a-a898-bf9ee9448a9b (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:f9aa9984-62b5-446a-a898-bf9ee9448a9b', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
gunicorn-web stdout | 2024-04-22 04:41:00,659 [278] [DEBUG] [app] Starting request: urn:request:aa50d86c-5997-4e8e-aef2-dfb7e8249dda (/_internal_ping) {'X-Forwarded-For': '127.0.0.1'}
gunicorn-web stdout | 2024-04-22 04:41:00,660 [282] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:41:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
gunicorn-web stdout | 2024-04-22 04:41:00,660 [278] [DEBUG] [app] Ending request: urn:request:aa50d86c-5997-4e8e-aef2-dfb7e8249dda (/_internal_ping) {'endpoint': 'web.internal_ping', 'request_id': 'urn:request:aa50d86c-5997-4e8e-aef2-dfb7e8249dda', 'remote_addr': '127.0.0.1', 'http_method': 'GET', 'original_url': 'http://localhost/_internal_ping', 'path': '/_internal_ping', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'python-requests/2.31.0'}
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:41:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:41:00,660 [281] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:41:00,660 [278] [INFO] [gunicorn.access] 127.0.0.1 - - [22/Apr/2024:04:41:00 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.31.0"
nginx stdout | 127.0.0.1 (-) - - [22/Apr/2024:04:41:00 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.31.0" (0.001 159 0.001)
gunicorn-web stdout | 2024-04-22 04:41:00,660 [282] [DEBUG] [urllib3.connectionpool] http://localhost:8080 "GET /_internal_ping HTTP/1.1" 200 4
gunicorn-web stdout | 2024-04-22 04:41:00,660 [281] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:41:00,661 [282] [INFO] [data.database] Connection pooling disabled for postgresql
gunicorn-web stdout | 2024-04-22 04:41:00,666 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:41:00,667 [282] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1])
gunicorn-web stdout | 2024-04-22 04:41:00,674 [281] [DEBUG] [app] Ending request: urn:request:716f068d-2097-4b9d-9cf6-d2cec450cef7 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:716f068d-2097-4b9d-9cf6-d2cec450cef7', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:41:00,674 [281] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:41:00,674 [282] [DEBUG] [app] Ending request: urn:request:f7b8dd83-b62e-4b36-9274-de4b7686e1d0 (/health/instance) {'endpoint': 'web.instance_health', 'request_id': 'urn:request:f7b8dd83-b62e-4b36-9274-de4b7686e1d0', 'remote_addr': '10.131.0.2', 'http_method': 'GET', 'original_url': 'http://10.131.0.31/health/instance', 'path': '/health/instance', 'parameters': {}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'kube-probe/1.28'}
gunicorn-web stdout | 2024-04-22 04:41:00,674 [282] [DEBUG] [data.database] Disconnecting from database.
gunicorn-web stdout | 2024-04-22 04:41:00,674 [281] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:41:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
gunicorn-web stdout | 2024-04-22 04:41:00,675 [282] [INFO] [gunicorn.access] 10.131.0.2 - - [22/Apr/2024:04:41:00 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.28"
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:41:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.022 118 0.022)
nginx stdout | 10.131.0.2 (-) - - [22/Apr/2024:04:41:00 +0000] "GET /health/instance HTTP/1.1" 200 152 "-" "kube-probe/1.28" (0.023 118 0.024)
gunicorn-web stdout | 2024-04-22 04:41:00,703 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '72'}
gunicorn-web stdout | 2024-04-22 04:41:00,802 [279] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '279'}
gunicorn-web stdout | 2024-04-22 04:41:00,868 [281] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '281'}
gunicorn-web stdout | 2024-04-22 04:41:00,928 [282] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '282'}
gunicorn-web stdout | 2024-04-22 04:41:01,035 [278] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'web:application', 'pid': '278'}
quotatotalworker stdout | 2024-04-22 04:41:01,054 [83] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
quotatotalworker stdout | 2024-04-22 04:41:01,054 [83] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:41:16.054492+00:00 (in 14.999513 seconds)
quotatotalworker stdout | 2024-04-22 04:41:01,055 [83] [INFO] [apscheduler.executors.default] Running job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:41:16 UTC)" (scheduled at 2024-04-22 04:41:01.054492+00:00)
quotatotalworker stdout | 2024-04-22 04:41:01,056 [83] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((NOT EXISTS(SELECT "t2"."id" FROM "quotanamespacesize" AS "t2" WHERE (("t2"."namespace_user_id" = "t1"."id") AND ("t2"."backfill_start_ms" IS NOT %s))) AND ("t1"."enabled" = %s)) AND ("t1"."robot" = %s)) LIMIT %s', [None, True, False, 100])
quotatotalworker stdout | 2024-04-22 04:41:01,065 [83] [DEBUG] [data.database] Disconnecting from database.
quotatotalworker stdout | 2024-04-22 04:41:01,065 [83] [INFO] [apscheduler.executors.default] Job "QuotaTotalWorker.backfill (trigger: interval[0:00:15], next run at: 2024-04-22 04:41:16 UTC)" executed successfully
teamsyncworker stdout | 2024-04-22 04:41:02,118 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'teamsyncworker.py', 'pid': '98'}
chunkcleanupworker stdout | 2024-04-22 04:41:02,129 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'chunkcleanupworker.py', 'pid': '64'}
securityscanningnotificationworker stdout | 2024-04-22 04:41:02,556 [91] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityscanningnotificationworker stdout | 2024-04-22 04:41:02,556 [91] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:41:16.552337+00:00 (in 13.995622 seconds)
securityscanningnotificationworker stdout | 2024-04-22 04:41:02,556 [91] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:42:02 UTC)" (scheduled at 2024-04-22 04:41:02.556208+00:00)
securityscanningnotificationworker stdout | 2024-04-22 04:41:02,557 [91] [DEBUG] [workers.queueworker] Running watchdog.
securityscanningnotificationworker stdout | 2024-04-22 04:41:02,557 [91] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:42:02 UTC)" executed successfully
quotaregistrysizeworker stdout | 2024-04-22 04:41:03,063 [81] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'quotaregistrysizeworker.py', 'pid': '81'}
notificationworker stdout | 2024-04-22 04:41:03,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:41:03,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:41:13.759375+00:00 (in 9.999461 seconds)
notificationworker stdout | 2024-04-22 04:41:03,760 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:41:13 UTC)" (scheduled at 2024-04-22 04:41:03.759375+00:00)
notificationworker stdout | 2024-04-22 04:41:03,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:41:03,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 41, 3, 760213), True, datetime.datetime(2024, 4, 22, 4, 41, 3, 760213), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:41:03,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:41:03,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:41:03,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:41:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:41:04,779 [78] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'notificationworker.py', 'pid': '78'}
gunicorn-secscan stdout | 2024-04-22 04:41:05,283 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '71'}
gunicorn-secscan stdout | 2024-04-22 04:41:05,286 [260] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '260'}
gunicorn-secscan stdout | 2024-04-22 04:41:05,289 [259] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'secscan:application', 'pid': '259'}
securityworker stdout | 2024-04-22 04:41:05,872 [92] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
securityworker stdout | 2024-04-22 04:41:05,872 [92] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:41:26.873109+00:00 (in 21.000828 seconds)
securityworker stdout | 2024-04-22 04:41:05,872 [92] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:41:35 UTC)" (scheduled at 2024-04-22 04:41:05.871852+00:00)
securityworker stdout | 2024-04-22 04:41:05,872 [92] [DEBUG] [util.secscan.v4.api] generated jwt for security scanner request
securityworker stdout | 2024-04-22 04:41:05,872 [92] [DEBUG] [util.secscan.v4.api] GETing security URL http://quayregistry-clair-app.quay-enterprise.svc.cluster.local/indexer/api/v1/index_state
securityworker stdout | 2024-04-22 04:41:05,875 [92] [DEBUG] [urllib3.connectionpool] http://quayregistry-clair-app.quay-enterprise.svc.cluster.local:80 "GET /indexer/api/v1/index_state HTTP/1.1" 200 None
securityworker stdout | 2024-04-22 04:41:05,876 [92] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "manifest" AS "t1"', [])
securityworker stdout | 2024-04-22 04:41:05,885 [92] [DEBUG] [data.database] Disconnecting from database.
securityworker stdout | 2024-04-22 04:41:05,885 [92] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2024-04-22 04:41:35 UTC)" executed successfully
buildlogsarchiver stdout | 2024-04-22 04:41:06,069 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'buildlogsarchiver.py', 'pid': '63'}
gcworker stdout | 2024-04-22 04:41:06,134 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'gcworker.py', 'pid': '68'}
repositorygcworker stdout | 2024-04-22 04:41:06,552 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:41:06,553 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:41:13.555667+00:00 (in 7.002644 seconds)
repositorygcworker stdout | 2024-04-22 04:41:06,553 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:42:06 UTC)" (scheduled at 2024-04-22 04:41:06.552482+00:00)
repositorygcworker stdout | 2024-04-22 04:41:06,553 [90] [DEBUG] [workers.queueworker] Getting work item from queue.
repositorygcworker stdout | 2024-04-22 04:41:06,554 [90] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 41, 6, 553424), True, datetime.datetime(2024, 4, 22, 4, 41, 6, 553424), 0, 'repositorygc/%', 50, 1, 0])
repositorygcworker stdout | 2024-04-22 04:41:06,567 [90] [DEBUG] [workers.queueworker] No more work.
repositorygcworker stdout | 2024-04-22 04:41:06,567 [90] [DEBUG] [data.database] Disconnecting from database.
repositorygcworker stdout | 2024-04-22 04:41:06,567 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2024-04-22 04:42:06 UTC)" executed successfully
exportactionlogsworker stdout | 2024-04-22 04:41:06,622 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'exportactionlogsworker.py', 'pid': '67'}
logrotateworker stdout | 2024-04-22 04:41:07,457 [73] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'logrotateworker.py', 'pid': '73'}
autopruneworker stdout | 2024-04-22 04:41:08,552 [60] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'autopruneworker.py', 'pid': '60'}
servicekey stdout | 2024-04-22 04:41:08,790 [93] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'servicekeyworker.py', 'pid': '93'}
globalpromstats stdout | 2024-04-22 04:41:09,095 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'globalpromstats.py', 'pid': '69'}
blobuploadcleanupworker stdout | 2024-04-22 04:41:10,059 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'}
securityworker stdout | 2024-04-22 04:41:11,168 [92] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'securityworker.py', 'pid': '92'}
queuecleanupworker stdout | 2024-04-22 04:41:11,193 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'queuecleanupworker.py', 'pid': '80'}
autopruneworker stdout | 2024-04-22 04:41:11,264 [60] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
autopruneworker stdout | 2024-04-22 04:41:11,264 [60] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:41:41.264267+00:00 (in 29.999419 seconds)
autopruneworker stdout | 2024-04-22 04:41:11,265 [60] [INFO] [apscheduler.executors.default] Running job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:41:41 UTC)" (scheduled at 2024-04-22 04:41:11.264267+00:00)
autopruneworker stdout | 2024-04-22 04:41:11,272 [60] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_id", "t1"."last_ran_ms", "t1"."status" FROM "autoprunetaskstatus" AS "t1" WHERE (("t1"."namespace_id" NOT IN (SELECT "t2"."id" FROM "user" AS "t2" WHERE (("t2"."enabled" = %s) AND ("t2"."id" = "t1"."namespace_id")))) AND (("t1"."last_ran_ms" < %s) OR ("t1"."last_ran_ms" IS %s))) ORDER BY "t1"."last_ran_ms" ASC NULLS first LIMIT %s OFFSET %s FOR UPDATE SKIP LOCKED', [False, 1713760811271, None, 1, 0])
autopruneworker stdout | 2024-04-22 04:41:11,276 [60] [INFO] [__main__] no autoprune tasks found, exiting...
autopruneworker stdout | 2024-04-22 04:41:11,276 [60] [DEBUG] [data.database] Disconnecting from database.
autopruneworker stdout | 2024-04-22 04:41:11,276 [60] [INFO] [apscheduler.executors.default] Job "AutoPruneWorker.prune (trigger: interval[0:00:30], next run at: 2024-04-22 04:41:41 UTC)" executed successfully
manifestbackfillworker stdout | 2024-04-22 04:41:11,653 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'manifestbackfillworker.py', 'pid': '74'}
namespacegcworker stdout | 2024-04-22 04:41:11,685 [76] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'namespacegcworker.py', 'pid': '76'}
gunicorn-registry stdout | 2024-04-22 04:41:11,705 [285] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '285'}
gunicorn-registry stdout | 2024-04-22 04:41:11,710 [289] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '289'}
gunicorn-registry stdout | 2024-04-22 04:41:11,713 [286] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '286'}
gunicorn-registry stdout | 2024-04-22 04:41:11,741 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '70'}
gunicorn-registry stdout | 2024-04-22 04:41:11,751 [284] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '284'}
gunicorn-registry stdout | 2024-04-22 04:41:11,754 [288] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '288'}
gunicorn-registry stdout | 2024-04-22 04:41:11,757 [290] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '290'}
gunicorn-registry stdout | 2024-04-22 04:41:11,760 [292] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '292'}
gunicorn-registry stdout | 2024-04-22 04:41:11,763 [291] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'registry:application', 'pid': '291'}
gunicorn-web stdout | 2024-04-22 04:41:12,229 [281] [DEBUG] [app] Starting request: urn:request:f82d0f6a-41af-42a9-ace5-f94253aa23be (/api/v1/repository/build_test/pushno/build/) {'X-Forwarded-For': '209.132.188.14, 10.128.2.8'}
gunicorn-web stdout | 2024-04-22 04:41:12,229 [281] [DEBUG] [app] User loader loading deferred user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:41:12,229 [281] [DEBUG] [auth.cookie] Loading user from cookie: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:41:12,230 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['a1442566-a2e4-4fbd-86d7-cdbe44891b3e', False, 1, 0])
gunicorn-web stdout | 2024-04-22 04:41:12,239 [281] [DEBUG] [auth.decorators] Found valid auth result: (<AuthKind.cookie: 'cookie'>, False, None, [<User: 1>, None, None, None, None, None, None])
gunicorn-web stdout | 2024-04-22 04:41:12,239 [281] [DEBUG] [auth.permissions] Identity loaded: <QuayDeferredPermissionUser id="a1442566-a2e4-4fbd-86d7-cdbe44891b3e" auth_type="user_uuid" provides=set()>
gunicorn-web stdout | 2024-04-22 04:41:12,239 [281] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:41:12,240 [281] [DEBUG] [endpoints.api] Checking permission <class 'auth.permissions.ReadRepositoryPermission'> for repo: build_test/pushno
gunicorn-web stdout | 2024-04-22 04:41:12,240 [281] [DEBUG] [auth.permissions] Loading user permissions after deferring for: a1442566-a2e4-4fbd-86d7-cdbe44891b3e
gunicorn-web stdout | 2024-04-22 04:41:12,240 [281] [DEBUG] [auth.permissions] User permission: _UserTypeNeed(type='user', username='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:41:12,240 [281] [DEBUG] [auth.permissions] User namespace permission: _NamespaceWideNeed(type='organization', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:41:12,240 [281] [DEBUG] [auth.permissions] User namespace repo permission: _NamespaceWideNeed(type='organizationrepo', namespace='whuquay', role='admin')
gunicorn-web stdout | 2024-04-22 04:41:12,242 [281] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."team_id", "t1"."user_id", "t1"."repository_id", "t1"."role_id", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state", "t4"."id", "t4"."uuid", "t4"."username", "t4"."password_hash", "t4"."email", "t4"."verified", "t4"."stripe_id", "t4"."organization", "t4"."robot", "t4"."invoice_email", "t4"."invalid_login_attempts", "t4"."last_invalid_login", "t4"."removed_tag_expiration_s", "t4"."enabled", "t4"."invoice_email_address", "t4"."given_name", "t4"."family_name", "t4"."company", "t4"."location", "t4"."maximum_queued_builds_count", "t4"."creation_date", "t4"."last_accessed" FROM "repositorypermission" AS "t1" INNER JOIN "role" AS "t2" ON ("t1"."role_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t1"."user_id" = "t5"."id") WHERE ((("t3"."name" = %s) AND ("t4"."username" = %s)) AND ("t5"."id" = %s))) UNION (SELECT "t6"."id", "t6"."team_id", "t6"."user_id", "t6"."repository_id", "t6"."role_id", "t7"."id", "t7"."name", "t8"."id", "t8"."namespace_user_id", "t8"."name", "t8"."visibility_id", "t8"."description", "t8"."badge_token", "t8"."kind_id", "t8"."trust_enabled", "t8"."state", "t9"."id", "t9"."uuid", "t9"."username", "t9"."password_hash", "t9"."email", "t9"."verified", "t9"."stripe_id", "t9"."organization", "t9"."robot", "t9"."invoice_email", "t9"."invalid_login_attempts", "t9"."last_invalid_login", "t9"."removed_tag_expiration_s", "t9"."enabled", "t9"."invoice_email_address", "t9"."given_name", "t9"."family_name", "t9"."company", "t9"."location", "t9"."maximum_queued_builds_count", "t9"."creation_date", "t9"."last_accessed" FROM "repositorypermission" AS "t6" INNER JOIN "role" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "repository" AS "t8" ON ("t6"."repository_id" = "t8"."id") INNER JOIN "user" AS "t9" ON ("t8"."namespace_user_id" = "t9"."id") INNER JOIN "team" AS "t10" ON ("t6"."team_id" = "t10"."id") INNER JOIN "teammember" AS "t11" ON ("t11"."team_id" = "t10"."id") INNER JOIN "user" AS "t12" ON ("t12"."id" = "t11"."user_id") WHERE ((("t8"."name" = %s) AND ("t9"."username" = %s)) AND ("t12"."id" = %s)))', ['pushno', 'build_test', 1, 'pushno', 'build_test', 1])
gunicorn-web stdout | 2024-04-22 04:41:12,248 [281] [DEBUG] [auth.permissions] User added permission: _ResourceNeed(type='repository', namespace='build_test', name='pushno', role='admin')
gunicorn-web stdout | 2024-04-22 04:41:12,249 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['build_test', 'pushno', 3, 'application', 1, 0])
gunicorn-web stdout | 2024-04-22 04:41:12,253 [281] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', ['pushno', 'build_test', 3])
gunicorn-web stdout | 2024-04-22 04:41:12,257 [281] [DEBUG] [app] Ending request: urn:request:f82d0f6a-41af-42a9-ace5-f94253aa23be (/api/v1/repository/build_test/pushno/build/) {'endpoint': 'api.repositorybuildlist', 'request_id': 'urn:request:f82d0f6a-41af-42a9-ace5-f94253aa23be', 'remote_addr': '10.128.2.8', 'http_method': 'GET', 'original_url': 'https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/api/v1/repository/build_test/pushno/build/?limit=3', 'path': '/api/v1/repository/build_test/pushno/build/', 'parameters': {'limit': '3'}, 'json_body': None, 'confsha': '38f2adc2', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0'}
gunicorn-web stdout | 2024-04-22 04:41:12,257 [281] [DEBUG] [data.database] Disconnecting from database.
nginx stdout | 10.128.2.8 (-) - - [22/Apr/2024:04:41:12 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.1" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0" (0.030 1536 0.030)
gunicorn-web stdout | 2024-04-22 04:41:12,258 [281] [INFO] [gunicorn.access] 10.128.2.8 - - [22/Apr/2024:04:41:12 +0000] "GET /api/v1/repository/build_test/pushno/build/?limit=3 HTTP/1.0" 200 15 "https://quayregistry-quay-quay-enterprise.apps.whu415az15.qe.azure.devcluster.openshift.com/repository/build_test/pushno?tab=settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:109.0) Gecko/20100101 Firefox/115.0"
storagereplication stdout | 2024-04-22 04:41:13,052 [94] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'quayregistry-quay-app-57fc58dcd5-x5kcs', 'process_name': 'storagereplication.py', 'pid': '94'}
repositorygcworker stdout | 2024-04-22 04:41:13,555 [90] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
repositorygcworker stdout | 2024-04-22 04:41:13,556 [90] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:41:51.555445+00:00 (in 37.999289 seconds)
repositorygcworker stdout | 2024-04-22 04:41:13,556 [90] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:42:13 UTC)" (scheduled at 2024-04-22 04:41:13.555667+00:00)
repositorygcworker stdout | 2024-04-22 04:41:13,556 [90] [DEBUG] [workers.queueworker] Running watchdog.
repositorygcworker stdout | 2024-04-22 04:41:13,556 [90] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2024-04-22 04:42:13 UTC)" executed successfully
notificationworker stdout | 2024-04-22 04:41:13,759 [78] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
notificationworker stdout | 2024-04-22 04:41:13,759 [78] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:41:19.762424+00:00 (in 6.002587 seconds)
notificationworker stdout | 2024-04-22 04:41:13,759 [78] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:41:23 UTC)" (scheduled at 2024-04-22 04:41:13.759375+00:00)
notificationworker stdout | 2024-04-22 04:41:13,760 [78] [DEBUG] [workers.queueworker] Getting work item from queue.
notificationworker stdout | 2024-04-22 04:41:13,760 [78] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2024, 4, 22, 4, 41, 13, 760086), True, datetime.datetime(2024, 4, 22, 4, 41, 13, 760086), 0, 'notification/%', 50, 1, 0])
notificationworker stdout | 2024-04-22 04:41:13,771 [78] [DEBUG] [workers.queueworker] No more work.
notificationworker stdout | 2024-04-22 04:41:13,771 [78] [DEBUG] [data.database] Disconnecting from database.
notificationworker stdout | 2024-04-22 04:41:13,771 [78] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2024-04-22 04:41:23 UTC)" executed successfully
gcworker stdout | 2024-04-22 04:41:14,952 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run
gcworker stdout | 2024-04-22 04:41:14,952 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2024-04-22 04:41:44.952062+00:00 (in 29.999547 seconds)
gcworker stdout | 2024-04-22 04:41:14,952 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:41:44 UTC)" (scheduled at 2024-04-22 04:41:14.952062+00:00)
gcworker stdout | 2024-04-22 04:41:14,953 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1712551274952, 1209600, True, 3, 500, 1, 0])
gcworker stdout | 2024-04-22 04:41:14,969 [68] [DEBUG] [__main__] No repository with garbage found
gcworker stdout | 2024-04-22 04:41:14,969 [68] [DEBUG] [data.database] Disconnecting from database.
gcworker stdout | 2024-04-22 04:41:14,969 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2024-04-22 04:41:44 UTC)" executed successfully